-- Logs begin at Thu 2022-05-26 12:56:51 UTC, end at Thu 2022-05-26 14:08:13 UTC. -- May 26 13:38:21.140920 dv-cinder-842130-1-smb systemd[1]: Starting Devstack devstack@keystone.service... May 26 13:38:21.148841 dv-cinder-842130-1-smb devstack@keystone.service[91757]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 13:38:21.152116 dv-cinder-842130-1-smb devstack@keystone.service[91757]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 13:38:21 2022] *** May 26 13:38:21.152116 dv-cinder-842130-1-smb devstack@keystone.service[91757]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 13:38:21.152116 dv-cinder-842130-1-smb devstack@keystone.service[91757]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 13:38:21.152116 dv-cinder-842130-1-smb devstack@keystone.service[91757]: nodename: dv-cinder-842130-1-smb May 26 13:38:21.152116 dv-cinder-842130-1-smb devstack@keystone.service[91757]: machine: x86_64 May 26 13:38:21.152116 dv-cinder-842130-1-smb devstack@keystone.service[91757]: clock source: unix May 26 13:38:21.152116 dv-cinder-842130-1-smb devstack@keystone.service[91757]: pcre jit disabled May 26 13:38:21.152116 dv-cinder-842130-1-smb devstack@keystone.service[91757]: detected number of CPU cores: 4 May 26 13:38:21.152116 dv-cinder-842130-1-smb devstack@keystone.service[91757]: current working directory: / May 26 13:38:21.152116 dv-cinder-842130-1-smb devstack@keystone.service[91757]: detected binary path: /usr/bin/uwsgi-core May 26 13:38:21.152116 dv-cinder-842130-1-smb devstack@keystone.service[91757]: your processes number limit is 47680 May 26 13:38:21.152116 dv-cinder-842130-1-smb devstack@keystone.service[91757]: your memory page size is 4096 bytes May 26 13:38:21.152897 dv-cinder-842130-1-smb devstack@keystone.service[91757]: detected max file descriptor number: 2048 May 26 13:38:21.152897 dv-cinder-842130-1-smb devstack@keystone.service[91757]: lock engine: pthread robust mutexes May 26 13:38:21.152897 dv-cinder-842130-1-smb devstack@keystone.service[91757]: thunder lock: enabled May 26 13:38:21.152897 dv-cinder-842130-1-smb devstack@keystone.service[91757]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 13:38:21.152897 dv-cinder-842130-1-smb devstack@keystone.service[91757]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 13:38:21.196118 dv-cinder-842130-1-smb devstack@keystone.service[91757]: Python main interpreter initialized at 0x561bfd7d09c0 May 26 13:38:21.196118 dv-cinder-842130-1-smb devstack@keystone.service[91757]: python threads support enabled May 26 13:38:21.196118 dv-cinder-842130-1-smb devstack@keystone.service[91757]: your server socket listen backlog is limited to 100 connections May 26 13:38:21.196118 dv-cinder-842130-1-smb devstack@keystone.service[91757]: your mercy for graceful operations on workers is 90 seconds May 26 13:38:21.196445 dv-cinder-842130-1-smb devstack@keystone.service[91757]: mapped 403077 bytes (393 KB) for 2 cores May 26 13:38:21.196520 dv-cinder-842130-1-smb devstack@keystone.service[91757]: *** Operational MODE: preforking *** May 26 13:38:21.196801 dv-cinder-842130-1-smb devstack@keystone.service[91757]: *** uWSGI is running in multiple interpreter mode *** May 26 13:38:21.196801 dv-cinder-842130-1-smb devstack@keystone.service[91757]: spawned uWSGI master process (pid: 91757) May 26 13:38:21.196993 dv-cinder-842130-1-smb systemd[1]: Started Devstack devstack@keystone.service. May 26 13:38:21.198587 dv-cinder-842130-1-smb devstack@keystone.service[91757]: spawned uWSGI worker 1 (pid: 91766, cores: 1) May 26 13:38:21.198587 dv-cinder-842130-1-smb devstack@keystone.service[91757]: spawned uWSGI worker 2 (pid: 91767, cores: 1) May 26 13:38:21.198587 dv-cinder-842130-1-smb devstack@keystone.service[91757]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 13:38:26.805201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:38:26.805201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: from cryptography.utils import int_from_bytes May 26 13:38:26.805987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:38:26.805987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: from cryptography.utils import int_from_bytes May 26 13:38:26.828952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:38:26.828952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: from cryptography.utils import int_from_bytes May 26 13:38:26.829509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:38:26.829509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: from cryptography.utils import int_from_bytes May 26 13:38:26.856046 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 13:38:26.856469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 13:38:26.856811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] command line args: [] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 13:38:26.857240 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 13:38:26.857594 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ================================================================================ {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 13:38:26.857999 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] admin_token = **** {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.858391 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] config_dir = [] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.858722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.859042 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] config_source = [] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.859364 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] debug = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.859829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.860457 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.860841 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.861321 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.861794 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.862224 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] list_limit = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.862607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] log_config_append = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.862985 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.863356 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] log_dir = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.863731 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] log_file = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.864168 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.864610 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.865065 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.865541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.865918 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.866303 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.866757 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.867216 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.867666 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.867980 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.868296 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.868610 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.869486 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.869814 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.870172 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.870741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.870990 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] publish_errors = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.871299 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.871603 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.871862 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.872179 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.872488 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.872798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] standard_threads = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.873112 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.873444 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.873688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.873927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] use_journal = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.874169 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] use_json = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.874408 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] use_stderr = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.874649 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] use_syslog = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.874951 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.875283 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.875593 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.875936 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.876242 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.876455 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 13:38:26.876580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.876667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 13:38:26.876824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] command line args: [] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 13:38:26.876958 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.877104 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 13:38:26.877294 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ================================================================================ {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 13:38:26.877386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.877558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] admin_token = **** {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.877677 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.877805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] config_dir = [] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.878096 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.878303 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.878456 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.878633 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] config_source = [] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.878820 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] debug = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.878899 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.879027 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.879154 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.879478 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.879655 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.879830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.879971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.880218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.880302 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.880491 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.880653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.880738 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] list_limit = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.880803 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.880902 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] log_config_append = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.881082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.881169 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.881323 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] log_dir = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.881485 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] log_file = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.881565 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.881730 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.881813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.881980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.882069 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.882236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.882319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.882481 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.882566 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.882658 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.882807 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.883067 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.883156 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.883304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.883393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.883538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.883630 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.883775 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.883856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.884012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.884095 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.884264 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.884355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.885045 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.885164 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.885329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.885584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.885865 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.886361 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.886545 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] publish_errors = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.886779 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.887010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.887189 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.887436 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.887670 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.887906 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] standard_threads = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.888397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.888640 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.888816 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.888993 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] use_journal = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.889171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] use_json = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.889384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] use_stderr = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.889563 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] use_syslog = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.889795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:38:26.890053 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.890296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.890560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.890801 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.891055 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.891296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.891550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.891634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.891791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.891889 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.892040 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.892122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.892290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.892371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.892539 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.892627 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.892776 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.892890 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.893024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.893143 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.893279 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.893423 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.893531 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.893677 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.893924 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.894014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.894166 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.894254 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.894405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.894490 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.894646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.894756 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.894884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.894973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.895132 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.895218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.895385 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.895475 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.895614 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.895727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.895897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.896149 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.896395 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.896503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.896626 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.896860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.896989 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.897101 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.897363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.897490 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.897618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.897852 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.897935 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.898092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.898176 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.898341 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.898423 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.898589 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.898677 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.898827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.898916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.899069 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.899156 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.899300 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.899386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.899539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.899622 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.899781 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.899867 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.900020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.900124 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.900276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.900361 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.900505 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.900627 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.900776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.901018 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.901151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.901258 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.901385 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.901639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.901878 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.902050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.902159 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.902302 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.902405 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.902565 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.902804 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.903057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.903211 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.903314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.903516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.903755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.903844 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.903998 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.904100 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.904234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.904342 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.904593 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.904704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.904844 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.905096 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.905377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.905466 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.905633 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.905730 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.905872 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.905955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.906115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.906232 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.906358 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.906607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.906848 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.906988 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.907089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.907319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.907494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.907588 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.907743 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.907833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.907986 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.908083 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.908233 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.908323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.908496 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.908585 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.908740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.908885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.908969 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.909043 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.909210 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.909320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.909473 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.909562 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.909708 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.909797 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.909951 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.910041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.910191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.910295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.910426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.910516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.910669 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.910777 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.910912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.911001 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.911159 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.911246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.911399 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.911489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.911640 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.911772 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.911864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.911940 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.912105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.912192 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.912346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.912430 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] auth.external = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.912575 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.912662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.912845 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.912932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.913074 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.913162 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.913331 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.913419 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] auth.password = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.913559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] auth.token = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.913651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.913798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.913881 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.914031 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.914119 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.914262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.914346 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.914491 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.914580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.914718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.914812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.914944 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.915031 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.915174 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.915264 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.915400 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.915491 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] credential.caching = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.915636 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.915779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.915896 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.915980 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.916152 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.916288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.916418 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.916538 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.916656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.916773 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.916851 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.916925 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.917089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.917179 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.917355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] auth.external = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.917442 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.917590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.917686 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.917893 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.917986 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.918111 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.918199 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.918343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] auth.password = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.918438 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.918575 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] auth.token = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.918693 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.918809 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.918929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.919057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.919178 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.919290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.919406 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] federation.caching = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.919508 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.919640 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.919751 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.919882 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.919993 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.920133 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.920218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.920361 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.920449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] credential.caching = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.920602 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.920690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.920838 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.920934 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.921087 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.921176 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.921343 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.921433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.921594 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.921682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.921828 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.921918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.922073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.922160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.922305 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] identity.caching = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.922396 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.922547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.922637 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.922779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.922857 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.923012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.923122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.923266 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.923386 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.923515 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.923637 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.923726 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.923874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.923963 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.924130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.924221 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.924396 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] federation.caching = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.924483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.924608 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.924696 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.924847 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.924942 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.925095 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.925185 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.925355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.925448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.925595 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.925696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.925829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.925911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.926080 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.926163 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.926326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.926465 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.926592 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.926711 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.926829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.926952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.927080 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.927199 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.927317 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] identity.caching = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.927434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.927551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.927697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.927823 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.927942 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.928058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.928177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.928754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.928946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.929145 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.929353 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.929526 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.929716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.929915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.930117 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.930247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.930366 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.930484 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.930601 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.930718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.930878 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.931013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.931132 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.931803 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.933016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.933170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.933434 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.933636 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.933837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.934025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.934260 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.934409 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.934600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.934797 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.934992 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.935184 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.935354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.935545 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.935733 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.935931 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.936125 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.936315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.936510 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.936698 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.936882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.937034 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.937340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.937506 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.937681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.937870 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.938061 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.938256 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.938501 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.938651 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.938838 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.939021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.939208 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.939403 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.939584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.939772 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.939958 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.940144 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.user = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.940316 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.940518 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.940518 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.940875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.941018 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.941137 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.941300 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.941434 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.941553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.941677 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.941796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.941914 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.942534 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.942847 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.943024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.943213 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.943399 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.943584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.943770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.943968 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.944156 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.944350 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.944528 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.944761 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.944909 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.945103 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.945323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.945499 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.945669 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.945837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.946003 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.946210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.946365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.946564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.946708 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.946875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.947598 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.947821 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.947941 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.948060 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.user = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.948177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.948296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.948421 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.949162 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.949367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.949523 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.949707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.949874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.950060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.950245 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.950419 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.950603 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.950759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.950926 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.951109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.951294 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.951524 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.951647 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.951811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.951983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.952162 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.952342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.952572 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.952695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.952847 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.953019 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.953200 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.953399 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.953631 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.953631 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.953913 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.954085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] resource.caching = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.954377 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.954377 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.954748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.954880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.955057 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.955227 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.955407 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.955584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.955735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.955853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.955969 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.956085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.956209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.956330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.956449 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.956566 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.956682 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.956798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.956992 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.957113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.957231 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] role.caching = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.957373 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.957492 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] role.driver = sql {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.957609 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.957739 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.957859 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.957976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.958094 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.958210 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.958328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.958458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.958578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.958695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.958813 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.958931 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.959049 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.959174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.959861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.959980 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.960098 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.960176 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.960251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] resource.caching = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.960333 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.960408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.960481 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.960553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.960626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.960699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.960779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.960855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.960927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.961001 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.961001 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.961132 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.961214 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.961304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.961380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.961454 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.961568 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.961661 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.961739 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] role.caching = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.961812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.961886 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] role.driver = sql {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.961958 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.962031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.962111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.962186 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.962259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.962332 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.962405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.962478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.962580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.962657 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.962731 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.962811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.962885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.962959 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.963039 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.963114 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.963187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.963260 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.963334 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.963406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.963486 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.963561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.963633 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.963706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.963778 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.963850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.963930 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.964005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.964078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] token.caching = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.964078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.964215 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.964295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.964376 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.964451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.964524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.964597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.964669 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.964741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.964821 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.964895 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.964968 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.965048 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.965180 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.965275 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.965366 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.965442 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.965514 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.965587 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.965660 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.965733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.965814 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.965888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.965961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.966034 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.966106 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.966186 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.966261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.966338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.966411 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.966484 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.966556 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.966636 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.966710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.966782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.connection = **** {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.966864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.966946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.967020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.967092 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.967165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] token.caching = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.967245 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.967320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.967392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.967465 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.967544 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.967617 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.967697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.967771 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.967845 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.967918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.967991 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.968106 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.968196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.968272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.968272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.968404 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.968477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.968549 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.968630 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.968704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.968777 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.968849 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.968922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.968994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.969075 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.969149 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.969221 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.969340 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.969417 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.969539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.969630 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.969707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.969707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 13:38:26.969839 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.969839 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.connection = **** {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.969839 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.969839 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.969839 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.969839 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.969839 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.969839 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.969839 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.970471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.970471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.970471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.970471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.970471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.970471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.970471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.970471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.970471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.971093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.971093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:38:26.971093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 13:38:26.995977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:26.996187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:26.996419 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:26.997590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:26.997826 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:26.998057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.005242 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.008207 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.034057 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.034293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.035343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.035581 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.088169 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.088339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.144057 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.144287 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.144575 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.144815 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.210612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.210749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.210832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.210909 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.210999 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.211107 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.211194 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.211329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.211422 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.211548 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.211635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.211765 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.235257 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.235532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.235651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.235779 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.235864 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.236072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.236154 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.236295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.236443 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.236529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.236769 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.236853 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.237120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.237509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.248999 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.249841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.261531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.261767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.261992 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.262077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.262214 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.262298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.262435 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.262527 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.262653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.262738 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.262869 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.263203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.263337 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.263551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 13:38:27.280942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.281152 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 13:38:27.281354 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.281516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.281617 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 13:38:27.281721 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 13:38:27.281899 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.281982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.282102 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 13:38:27.282228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.282369 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.282483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.282629 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.282736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.282886 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.283144 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.294717 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.294991 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.295259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.295534 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.295999 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.296277 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.296547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.296830 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.303685 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.304952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.307556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.307836 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.308115 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.308391 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.308667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.308826 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.308911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.309106 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.309299 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.309415 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.309578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.309808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.309892 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.310092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.310174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.310353 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.310443 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.310630 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.310905 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.311177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.311448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.311716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.336760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.338192 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.338547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.338824 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.339823 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.340144 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.344122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.344403 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.344681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.345623 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.345903 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.346182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.352025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.352307 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.354111 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.354400 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.357334 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.357737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.358020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.358301 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.358573 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.358842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.359092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.359177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.359362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.359444 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.359640 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.359921 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.360207 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.360482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.360747 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.361033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.378853 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.379132 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.380472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.380746 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.383819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.385372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.387522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.387817 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.389327 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.389619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.393286 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.394773 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.396892 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.398409 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.401222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.401549 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.401833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.402129 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.402406 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.402691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.402852 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.403004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.403284 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.403570 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.403853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.404146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.422221 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.422501 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.422768 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.423030 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.423648 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.424023 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.424292 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.424555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.431041 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.432522 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.432794 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.433071 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.434241 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.434523 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.436138 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.436417 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.436697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.436990 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.437282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.437596 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.437874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.438156 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.438438 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.438713 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.450746 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.451022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.451308 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.451585 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.451861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.452147 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.452299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.452425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.452579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.452858 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.453145 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.453451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.453726 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.454006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.471333 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.472533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.474572 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.475821 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.477919 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.479716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.480067 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.481364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.481736 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.482022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.482302 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.483002 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.483285 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.483576 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.489763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.491048 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.491378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.492659 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.495170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.495464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.495744 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.496015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.496543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.496874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.497215 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.497565 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.505146 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.505454 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.505835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.506832 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.507118 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.507399 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.514541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.514821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.515101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.515373 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.515641 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.515908 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.516131 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 13:38:27.516216 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.516409 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.516494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.516694 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.516776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.516965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.517055 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.517234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.517342 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.517520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.517659 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.517788 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.517871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.518052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.518133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.518334 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.518619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.518887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.519147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.519410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.519678 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 13:38:27.557183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561bfd7d09c0 pid: 91766 (default app) May 26 13:38:27.558820 dv-cinder-842130-1-smb devstack@keystone.service[91767]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561bfd7d09c0 pid: 91767 (default app) May 26 13:38:27.560441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd4ae-dff9-4f7d-84e6-d7a37736f326 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:27.560734 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd4ae-dff9-4f7d-84e6-d7a37736f326 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:27.561013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd4ae-dff9-4f7d-84e6-d7a37736f326 None None] PATH_INFO: `/v3` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:27.565382 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Thu May 26 13:38:27 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:35.406284 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b943e-22ea-4ae8-9bc5-83f370ad3207 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:35.407110 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b943e-22ea-4ae8-9bc5-83f370ad3207 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:35.407110 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b943e-22ea-4ae8-9bc5-83f370ad3207 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:35.411267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:38:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:38:35.416389 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb3af6-a36b-439e-aa42-5963db600006 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:35.416833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb3af6-a36b-439e-aa42-5963db600006 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:35.416926 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb3af6-a36b-439e-aa42-5963db600006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:35.484546 dv-cinder-842130-1-smb devstack@keystone.service[91766]: INFO dbcounter [None req-e5cb3af6-a36b-439e-aa42-5963db600006 None None] Registered counter for database keystone May 26 13:38:35.505316 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG oslo_db.sqlalchemy.engines [None req-e5cb3af6-a36b-439e-aa42-5963db600006 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:38:35.517641 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writer thread running {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:38:35.693785 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG passlib.handlers.bcrypt [None req-e5cb3af6-a36b-439e-aa42-5963db600006 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91766) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 13:38:35.694211 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG passlib.handlers.bcrypt [None req-e5cb3af6-a36b-439e-aa42-5963db600006 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91766) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 13:38:35.749791 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-e5cb3af6-a36b-439e-aa42-5963db600006 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:38:35.751378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e5cb3af6-a36b-439e-aa42-5963db600006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:38:35.874882 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:38:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 26 13:38:36.015163 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b943e-22ea-4ae8-9bc5-83f370ad3207 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:36.082467 dv-cinder-842130-1-smb devstack@keystone.service[91767]: INFO dbcounter [None req-a06b943e-22ea-4ae8-9bc5-83f370ad3207 None None] Registered counter for database keystone May 26 13:38:36.102178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG oslo_db.sqlalchemy.engines [None req-a06b943e-22ea-4ae8-9bc5-83f370ad3207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:38:36.108784 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writer thread running {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:38:36.226240 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b943e-22ea-4ae8-9bc5-83f370ad3207 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:36.230976 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc752cf2-ec75-44bd-b84c-50161c37fa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:36.231629 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc752cf2-ec75-44bd-b84c-50161c37fa69 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:36.231915 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc752cf2-ec75-44bd-b84c-50161c37fa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:36.232196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc752cf2-ec75-44bd-b84c-50161c37fa69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:36.240216 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc752cf2-ec75-44bd-b84c-50161c37fa69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:36.291624 dv-cinder-842130-1-smb devstack@keystone.service[91767]: WARNING keystone.common.rbac_enforcer.enforcer [None req-dc752cf2-ec75-44bd-b84c-50161c37fa69 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 13:38:36.291969 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc752cf2-ec75-44bd-b84c-50161c37fa69 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:36.301278 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Thu May 26 13:38:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 13:38:36.307865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb3af6-a36b-439e-aa42-5963db600006 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:36.322600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb3af6-a36b-439e-aa42-5963db600006 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:36.326949 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f265dc-1435-45a1-982e-08eefc69dd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:36.328050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f265dc-1435-45a1-982e-08eefc69dd93 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:36.328331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f265dc-1435-45a1-982e-08eefc69dd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:36.328603 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f265dc-1435-45a1-982e-08eefc69dd93 admin admin] PATH_INFO: `/v3/projects/066fbe760dac4adba6eafb0592a4a0b1` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:36.330107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f265dc-1435-45a1-982e-08eefc69dd93 admin admin] RBAC: Authorizing `identity:get_project(project_id=066fbe760dac4adba6eafb0592a4a0b1)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:36.491273 dv-cinder-842130-1-smb devstack@keystone.service[91766]: WARNING keystone.common.rbac_enforcer.enforcer [None req-44f265dc-1435-45a1-982e-08eefc69dd93 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 13:38:36.492046 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f265dc-1435-45a1-982e-08eefc69dd93 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:36.496872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Thu May 26 13:38:36 2022] GET /identity/v3/projects/066fbe760dac4adba6eafb0592a4a0b1 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:38.642985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab7131-be76-40ae-9c72-caf6876f6f7a None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:38.643500 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab7131-be76-40ae-9c72-caf6876f6f7a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:38.643603 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab7131-be76-40ae-9c72-caf6876f6f7a None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:38.648041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:38:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:38:38.653825 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe364a1-50b1-476f-a5c9-773a05cf2a4b None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:38.654219 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe364a1-50b1-476f-a5c9-773a05cf2a4b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:38.654383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe364a1-50b1-476f-a5c9-773a05cf2a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:38.673890 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-5fe364a1-50b1-476f-a5c9-773a05cf2a4b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:38:38.675402 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-5fe364a1-50b1-476f-a5c9-773a05cf2a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:38:38.683903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:38:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 13:38:38.706530 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab7131-be76-40ae-9c72-caf6876f6f7a None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:38.718566 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab7131-be76-40ae-9c72-caf6876f6f7a None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:38.722756 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c7ed1-0dcd-499e-af3c-94d108e27048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:38.723382 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c7ed1-0dcd-499e-af3c-94d108e27048 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:38.723665 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c7ed1-0dcd-499e-af3c-94d108e27048 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:38.723941 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c7ed1-0dcd-499e-af3c-94d108e27048 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:38.731488 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c7ed1-0dcd-499e-af3c-94d108e27048 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:38.733242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c7ed1-0dcd-499e-af3c-94d108e27048 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:38.741891 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Thu May 26 13:38:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 13:38:38.747499 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe364a1-50b1-476f-a5c9-773a05cf2a4b None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:38.756377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe364a1-50b1-476f-a5c9-773a05cf2a4b None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:38.761342 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920edad0-546b-43b4-90fa-9c737f11a010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:38.762183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920edad0-546b-43b4-90fa-9c737f11a010 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:38.762464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920edad0-546b-43b4-90fa-9c737f11a010 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:38.762993 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920edad0-546b-43b4-90fa-9c737f11a010 admin admin] PATH_INFO: `/v3/users/210b2db5e18c45edbd9a1a18b78d6586` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:38.764350 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920edad0-546b-43b4-90fa-9c737f11a010 admin admin] RBAC: Authorizing `identity:get_user(user_id=210b2db5e18c45edbd9a1a18b78d6586)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:38.766197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920edad0-546b-43b4-90fa-9c737f11a010 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:38.767726 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Thu May 26 13:38:38 2022] GET /identity/v3/users/210b2db5e18c45edbd9a1a18b78d6586 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:41.016939 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec0dd3-bdca-4b7a-a519-9a07ac441920 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:41.017480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec0dd3-bdca-4b7a-a519-9a07ac441920 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:41.017480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec0dd3-bdca-4b7a-a519-9a07ac441920 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:41.018810 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:38:41.024013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf6569-c00f-444f-a253-ac10419fa899 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:41.024966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf6569-c00f-444f-a253-ac10419fa899 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:41.025090 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf6569-c00f-444f-a253-ac10419fa899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:41.029042 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68668bb9-604e-4b3c-92b7-903e1de712e7 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:41.029360 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68668bb9-604e-4b3c-92b7-903e1de712e7 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:41.029644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68668bb9-604e-4b3c-92b7-903e1de712e7 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:41.030890 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 6/11] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:38:41.035904 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9fb6f-797a-4ca3-ae37-92a0e547e5f3 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:41.036190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9fb6f-797a-4ca3-ae37-92a0e547e5f3 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:41.036469 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9fb6f-797a-4ca3-ae37-92a0e547e5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:41.042326 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-59bf6569-c00f-444f-a253-ac10419fa899 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:38:41.043500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-59bf6569-c00f-444f-a253-ac10419fa899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:38:41.075870 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG passlib.handlers.bcrypt [None req-8ce9fb6f-797a-4ca3-ae37-92a0e547e5f3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91767) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 13:38:41.076295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG passlib.handlers.bcrypt [None req-8ce9fb6f-797a-4ca3-ae37-92a0e547e5f3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91767) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 13:38:41.121794 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:38:41.123125 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-8ce9fb6f-797a-4ca3-ae37-92a0e547e5f3 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:38:41.124700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8ce9fb6f-797a-4ca3-ae37-92a0e547e5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:38:41.144531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf6569-c00f-444f-a253-ac10419fa899 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:41.168840 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:41.225547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:38:41.246785 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9fb6f-797a-4ca3-ae37-92a0e547e5f3 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:41.248565 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf6569-c00f-444f-a253-ac10419fa899 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:41.284462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d43d4-89fc-44a4-826a-6532a8fa388a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:41.285253 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d43d4-89fc-44a4-826a-6532a8fa388a None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:41.285560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d43d4-89fc-44a4-826a-6532a8fa388a None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:41.285838 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d43d4-89fc-44a4-826a-6532a8fa388a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:41.298087 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d43d4-89fc-44a4-826a-6532a8fa388a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:38:41.309907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-139d43d4-89fc-44a4-826a-6532a8fa388a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:38:41.309907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:38:41.309907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:38:41.309907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:38:41.309907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:38:41.309907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:38:41.309907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:38:41.309907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:38:41.309907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:38:41.309907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:38:41.309907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:38:41.309907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:38:41.309907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:38:41.309907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:38:41.309907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:38:41.309907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:38:41.310885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:38:41.310885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:38:41.310885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:38:41.310885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:38:41.310885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:38:41.310885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:38:41.310885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:38:41.310885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:38:41.310885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:38:41.310885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:38:41.310885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:38:41.310885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:38:41.310885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:38:41.310885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:38:41.310885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:38:41.310885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:38:41.311913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:38:41.311913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:38:41.311913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:38:41.311913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:38:41.311913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:38:41.311913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:38:41.311913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:38:41.311913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:38:41.311913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:38:41.311913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:38:41.311913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:38:41.311913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:38:41.311913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 7/14] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:38:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:38:41.316840 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d43d4-89fc-44a4-826a-6532a8fa388a None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:41.349041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9fb6f-797a-4ca3-ae37-92a0e547e5f3 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:41.351332 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:41.387078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498c04d-6d07-4df5-88c0-085b4845cc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:41.388257 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498c04d-6d07-4df5-88c0-085b4845cc42 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:41.388541 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498c04d-6d07-4df5-88c0-085b4845cc42 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:41.388817 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498c04d-6d07-4df5-88c0-085b4845cc42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:41.398230 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:41.417151 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d43d4-89fc-44a4-826a-6532a8fa388a None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:41.450448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e35585-6ecf-434d-a1c5-b84c2c056283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:41.451102 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e35585-6ecf-434d-a1c5-b84c2c056283 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:41.451387 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e35585-6ecf-434d-a1c5-b84c2c056283 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:41.451657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e35585-6ecf-434d-a1c5-b84c2c056283 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:41.452399 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e35585-6ecf-434d-a1c5-b84c2c056283 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:38:41.452700 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e35585-6ecf-434d-a1c5-b84c2c056283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:41.454128 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e35585-6ecf-434d-a1c5-b84c2c056283 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:41.454438 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498c04d-6d07-4df5-88c0-085b4845cc42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:41.455928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498c04d-6d07-4df5-88c0-085b4845cc42 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:41.465516 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 8/15] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:38:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:38:41.470914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e35585-6ecf-434d-a1c5-b84c2c056283 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:41.551954 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 8/16] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:38:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 13:38:41.558038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498c04d-6d07-4df5-88c0-085b4845cc42 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:41.560615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:41.574041 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e35585-6ecf-434d-a1c5-b84c2c056283 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:41.607523 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca19203-c1f7-4c71-889b-7c514524478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:41.608393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca19203-c1f7-4c71-889b-7c514524478f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:41.608678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca19203-c1f7-4c71-889b-7c514524478f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:41.608954 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca19203-c1f7-4c71-889b-7c514524478f None admin] PATH_INFO: `/v3/users/210b2db5e18c45edbd9a1a18b78d6586` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:41.610201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca19203-c1f7-4c71-889b-7c514524478f None admin] RBAC: Authorizing `identity:get_user(user_id=210b2db5e18c45edbd9a1a18b78d6586)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:41.611663 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca19203-c1f7-4c71-889b-7c514524478f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:41.613287 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 9/17] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:38:41 2022] GET /identity/v3/users/210b2db5e18c45edbd9a1a18b78d6586 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:38:41.619047 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca19203-c1f7-4c71-889b-7c514524478f None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:41.632709 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:41.658207 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498c04d-6d07-4df5-88c0-085b4845cc42 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:41.694871 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121408c6-2436-42d7-a4bb-beac2bc0a066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:41.695659 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121408c6-2436-42d7-a4bb-beac2bc0a066 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:41.695938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121408c6-2436-42d7-a4bb-beac2bc0a066 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:41.696828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121408c6-2436-42d7-a4bb-beac2bc0a066 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:41.714767 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121408c6-2436-42d7-a4bb-beac2bc0a066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:41.716208 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121408c6-2436-42d7-a4bb-beac2bc0a066 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:41.718842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca19203-c1f7-4c71-889b-7c514524478f None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:41.736472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-121408c6-2436-42d7-a4bb-beac2bc0a066 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:38:41.736472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:38:41.736472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:38:41.736472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:38:41.736472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:38:41.736472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:38:41.736472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:38:41.736472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:38:41.736472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:38:41.736472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:38:41.736472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:38:41.736472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:38:41.736472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:38:41.736472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:38:41.736472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:38:41.737502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:38:41.737502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:38:41.737502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:38:41.737502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:38:41.737502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:38:41.737502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:38:41.737502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:38:41.737502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:38:41.737502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:38:41.737502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:38:41.737502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:38:41.737502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:38:41.737502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:38:41.737502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:38:41.737502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:38:41.737502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:38:41.737502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:38:41.738339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:38:41.738339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:38:41.738339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:38:41.738339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:38:41.738339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 9/18] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:38:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:38:41.743991 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121408c6-2436-42d7-a4bb-beac2bc0a066 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:41.753241 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c8495-3501-459b-9220-eb7b3a04e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:41.754052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8495-3501-459b-9220-eb7b3a04e256 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:41.754337 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8495-3501-459b-9220-eb7b3a04e256 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:41.754613 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8495-3501-459b-9220-eb7b3a04e256 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:41.755777 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c8495-3501-459b-9220-eb7b3a04e256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:41.757222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c8495-3501-459b-9220-eb7b3a04e256 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:41.759425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 10/19] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:38:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:38:41.765284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c8495-3501-459b-9220-eb7b3a04e256 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:41.798876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:41.843651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121408c6-2436-42d7-a4bb-beac2bc0a066 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:41.845069 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:41.864229 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c8495-3501-459b-9220-eb7b3a04e256 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:41.876420 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0765fc-7609-4ca2-942b-7f0d332adc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:41.877068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0765fc-7609-4ca2-942b-7f0d332adc01 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:41.877378 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0765fc-7609-4ca2-942b-7f0d332adc01 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:41.877652 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0765fc-7609-4ca2-942b-7f0d332adc01 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:41.878371 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0765fc-7609-4ca2-942b-7f0d332adc01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:38:41.878674 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0765fc-7609-4ca2-942b-7f0d332adc01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:41.880041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0765fc-7609-4ca2-942b-7f0d332adc01 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:41.897923 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 10/20] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:38:41.899015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad5063-668d-4df9-99e8-6e3dbe6cd09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:41.900191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad5063-668d-4df9-99e8-6e3dbe6cd09d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:41.900475 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad5063-668d-4df9-99e8-6e3dbe6cd09d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:41.900751 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad5063-668d-4df9-99e8-6e3dbe6cd09d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:41.901608 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad5063-668d-4df9-99e8-6e3dbe6cd09d None admin] RBAC: Adding query filter params (role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.domain.id=default, user.id=210b2db5e18c45edbd9a1a18b78d6586) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:38:41.901919 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad5063-668d-4df9-99e8-6e3dbe6cd09d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:41.903408 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad5063-668d-4df9-99e8-6e3dbe6cd09d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:41.910949 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 11/21] 10.222.0.45 () {56 vars in 1322 bytes} [Thu May 26 13:38:41 2022] GET /identity/v3/role_assignments?user.id=210b2db5e18c45edbd9a1a18b78d6586&scope.domain.id=default&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:38:44.341427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914b9f6-2d04-4e29-9df3-bb86d6ba703c None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:44.341939 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914b9f6-2d04-4e29-9df3-bb86d6ba703c None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:44.342046 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914b9f6-2d04-4e29-9df3-bb86d6ba703c None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:44.343324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 11/22] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:38:44.348822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e45ea-82c9-4c8c-9e76-48722a0cba6c None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:44.349239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e45ea-82c9-4c8c-9e76-48722a0cba6c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:44.349425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e45ea-82c9-4c8c-9e76-48722a0cba6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:44.372024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-e55e45ea-82c9-4c8c-9e76-48722a0cba6c None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:38:44.373214 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e55e45ea-82c9-4c8c-9e76-48722a0cba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:38:44.467972 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 12/23] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:38:44.506835 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914b9f6-2d04-4e29-9df3-bb86d6ba703c None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:44.701485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d3e5e-a8c5-464f-bcad-58b16769d8f5 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:44.701815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d3e5e-a8c5-464f-bcad-58b16769d8f5 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:44.702056 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d3e5e-a8c5-464f-bcad-58b16769d8f5 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:44.703560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:38:44.708779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5027f-49d1-4759-94ac-b8ae40bc7c46 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:44.709060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5027f-49d1-4759-94ac-b8ae40bc7c46 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:44.709370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5027f-49d1-4759-94ac-b8ae40bc7c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:44.746549 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-67a5027f-49d1-4759-94ac-b8ae40bc7c46 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:38:44.747784 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-67a5027f-49d1-4759-94ac-b8ae40bc7c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:38:44.814717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914b9f6-2d04-4e29-9df3-bb86d6ba703c None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:44.841854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:44.859881 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 14/25] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:38:44.869676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b625b7-d2db-4b50-90be-d1304a1d3834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:44.870673 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b625b7-d2db-4b50-90be-d1304a1d3834 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:44.871144 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b625b7-d2db-4b50-90be-d1304a1d3834 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:44.871560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b625b7-d2db-4b50-90be-d1304a1d3834 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:44.884053 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b625b7-d2db-4b50-90be-d1304a1d3834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:38:44.893516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-f3b625b7-d2db-4b50-90be-d1304a1d3834 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:38:44.893516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:38:44.893516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:38:44.893516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:38:44.893516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:38:44.893516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:38:44.893516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:38:44.893516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:38:44.893516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:38:44.893516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:38:44.893516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:38:44.893516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:38:44.893516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:38:44.893516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:38:44.893516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:38:44.893516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:38:44.894590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:38:44.894590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:38:44.894590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:38:44.894590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:38:44.894590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:38:44.894590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:38:44.894590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:38:44.894590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:38:44.894590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:38:44.894590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:38:44.894590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:38:44.894590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:38:44.894590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:38:44.894590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:38:44.894590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:38:44.894590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:38:44.895560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:38:44.895560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:38:44.895560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:38:44.895560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:38:44.895560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:38:44.895560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:38:44.895560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:38:44.895560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:38:44.895560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:38:44.895560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:38:44.895560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:38:44.895560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:38:44.897732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 12/26] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:38:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:38:44.908469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5027f-49d1-4759-94ac-b8ae40bc7c46 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:44.909430 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b625b7-d2db-4b50-90be-d1304a1d3834 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:44.918623 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:45.054483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5027f-49d1-4759-94ac-b8ae40bc7c46 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:45.115068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b625b7-d2db-4b50-90be-d1304a1d3834 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:45.127387 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86c216-2248-4a1a-a416-118a8325a0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:45.128512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86c216-2248-4a1a-a416-118a8325a0de None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:45.128939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86c216-2248-4a1a-a416-118a8325a0de None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:45.131558 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86c216-2248-4a1a-a416-118a8325a0de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:45.153214 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86c216-2248-4a1a-a416-118a8325a0de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:45.156101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86c216-2248-4a1a-a416-118a8325a0de None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:45.182977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-2f86c216-2248-4a1a-a416-118a8325a0de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:38:45.182977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:38:45.182977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:38:45.182977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:38:45.182977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:38:45.182977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:38:45.182977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:38:45.182977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:38:45.182977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:38:45.182977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:38:45.182977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:38:45.182977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:38:45.182977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:38:45.182977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:38:45.182977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:38:45.184024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:38:45.184024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:38:45.184024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:38:45.184024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:38:45.184024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:38:45.184024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:38:45.184024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:38:45.184024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:38:45.184024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:38:45.184024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:38:45.184024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:38:45.184024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:38:45.184024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:38:45.184024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:38:45.184024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:38:45.184024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:38:45.184024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:38:45.185147 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:38:45.185147 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:38:45.185147 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:38:45.185147 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:38:45.186865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 15/27] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:38:45.188349 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819f746-ae5c-4f10-bd8b-c09e5c5b588e None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:45.188739 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819f746-ae5c-4f10-bd8b-c09e5c5b588e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:45.189243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819f746-ae5c-4f10-bd8b-c09e5c5b588e None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:45.189849 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce623af-a85e-479b-b9d9-9c190857bcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:45.190678 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce623af-a85e-479b-b9d9-9c190857bcbc None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:45.191106 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 16/28] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:38:45.191430 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce623af-a85e-479b-b9d9-9c190857bcbc None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:45.191885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce623af-a85e-479b-b9d9-9c190857bcbc None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:45.192383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9e1e1-a9c0-414c-8220-196679f80c5c None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:45.193016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce623af-a85e-479b-b9d9-9c190857bcbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:38:45.193522 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce623af-a85e-479b-b9d9-9c190857bcbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:45.195124 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce623af-a85e-479b-b9d9-9c190857bcbc None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:45.196755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9e1e1-a9c0-414c-8220-196679f80c5c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:45.197129 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9e1e1-a9c0-414c-8220-196679f80c5c None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:45.198570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 17/29] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:38:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:38:45.199374 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9e1e1-a9c0-414c-8220-196679f80c5c None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:45.210025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 13/30] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:38:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:38:45.211836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db3383-f463-46fd-b8a0-3a4bc223d733 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:45.212324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db3383-f463-46fd-b8a0-3a4bc223d733 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:45.212776 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db3383-f463-46fd-b8a0-3a4bc223d733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:45.237331 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-e6db3383-f463-46fd-b8a0-3a4bc223d733 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:38:45.238989 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e6db3383-f463-46fd-b8a0-3a4bc223d733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:38:45.277363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:45.282501 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:45.323952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 14/31] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:38:45.325781 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969071b-8421-47a3-8f35-6e6c975615b8 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:45.326274 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969071b-8421-47a3-8f35-6e6c975615b8 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:45.326775 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969071b-8421-47a3-8f35-6e6c975615b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:45.349052 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-6969071b-8421-47a3-8f35-6e6c975615b8 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:38:45.351507 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-6969071b-8421-47a3-8f35-6e6c975615b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:38:45.352861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9e1e1-a9c0-414c-8220-196679f80c5c None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:45.392628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918aad5-651c-443d-90bb-4c81dc22f71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:45.393693 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918aad5-651c-443d-90bb-4c81dc22f71c None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:45.394176 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918aad5-651c-443d-90bb-4c81dc22f71c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:45.394664 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918aad5-651c-443d-90bb-4c81dc22f71c None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:45.395580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918aad5-651c-443d-90bb-4c81dc22f71c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:38:45.396098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918aad5-651c-443d-90bb-4c81dc22f71c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:45.397890 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918aad5-651c-443d-90bb-4c81dc22f71c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:45.416986 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 18/32] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:45.418281 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918aad5-651c-443d-90bb-4c81dc22f71c None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:45.442565 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 15/33] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:38:45.443162 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969071b-8421-47a3-8f35-6e6c975615b8 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:45.523300 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918aad5-651c-443d-90bb-4c81dc22f71c None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:45.541304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:45.553313 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:45.558677 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969071b-8421-47a3-8f35-6e6c975615b8 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:45.561963 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fdedf-f442-4e4e-9099-57b1ef476fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:45.563182 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fdedf-f442-4e4e-9099-57b1ef476fcf None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:45.563665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fdedf-f442-4e4e-9099-57b1ef476fcf None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:45.564168 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fdedf-f442-4e4e-9099-57b1ef476fcf None admin] PATH_INFO: `/v3/users/210b2db5e18c45edbd9a1a18b78d6586` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:45.565615 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105fdedf-f442-4e4e-9099-57b1ef476fcf None admin] RBAC: Authorizing `identity:get_user(user_id=210b2db5e18c45edbd9a1a18b78d6586)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:45.567279 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105fdedf-f442-4e4e-9099-57b1ef476fcf None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:45.569116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 19/34] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:38:45 2022] GET /identity/v3/users/210b2db5e18c45edbd9a1a18b78d6586 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:45.570131 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fdedf-f442-4e4e-9099-57b1ef476fcf None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:45.597528 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc133c-de2f-4b1b-a722-b949bd93c73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:45.598152 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc133c-de2f-4b1b-a722-b949bd93c73f None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:45.598489 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc133c-de2f-4b1b-a722-b949bd93c73f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:45.598824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc133c-de2f-4b1b-a722-b949bd93c73f None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:45.599779 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc133c-de2f-4b1b-a722-b949bd93c73f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:45.601358 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc133c-de2f-4b1b-a722-b949bd93c73f None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:45.682568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fdedf-f442-4e4e-9099-57b1ef476fcf None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:45.720218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753e7f4-b4f1-48bf-ac4d-22ddb49a8015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:45.721229 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753e7f4-b4f1-48bf-ac4d-22ddb49a8015 None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:45.721767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753e7f4-b4f1-48bf-ac4d-22ddb49a8015 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:45.722238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753e7f4-b4f1-48bf-ac4d-22ddb49a8015 None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:45.723295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753e7f4-b4f1-48bf-ac4d-22ddb49a8015 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:45.724993 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753e7f4-b4f1-48bf-ac4d-22ddb49a8015 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:45.752007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 16/35] 10.222.0.45 () {60 vars in 1131 bytes} [Thu May 26 13:38:45 2022] POST /identity/v3/roles => generated 225 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:38:45.759051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc133c-de2f-4b1b-a722-b949bd93c73f None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:45.877556 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc133c-de2f-4b1b-a722-b949bd93c73f None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:45.900222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 20/36] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 13:38:45 2022] POST /identity/v3/projects => generated 301 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:38:45.901835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753e7f4-b4f1-48bf-ac4d-22ddb49a8015 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:45.920977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93151e37-9383-46af-90ef-4eb088a6fd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:45.921742 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93151e37-9383-46af-90ef-4eb088a6fd27 None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:45.922090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93151e37-9383-46af-90ef-4eb088a6fd27 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:45.922381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93151e37-9383-46af-90ef-4eb088a6fd27 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:45.923311 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93151e37-9383-46af-90ef-4eb088a6fd27 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:45.929342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93151e37-9383-46af-90ef-4eb088a6fd27 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:45.945764 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 17/37] 10.222.0.45 () {60 vars in 1131 bytes} [Thu May 26 13:38:45 2022] POST /identity/v3/roles => generated 219 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:38:45.948461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d233256-b35a-4cf5-9cb3-24975e99961a None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:45.948803 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d233256-b35a-4cf5-9cb3-24975e99961a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:45.949097 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d233256-b35a-4cf5-9cb3-24975e99961a None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:45.950972 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:45.951802 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 18/38] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:38:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:38:45.958508 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e676e-e369-41c3-a447-161e9feeabcb None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:45.958892 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e676e-e369-41c3-a447-161e9feeabcb None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:45.959282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e676e-e369-41c3-a447-161e9feeabcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:45.988317 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-cb9e676e-e369-41c3-a447-161e9feeabcb None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:38:45.990371 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-cb9e676e-e369-41c3-a447-161e9feeabcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:38:46.009208 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:46.038884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753e7f4-b4f1-48bf-ac4d-22ddb49a8015 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:46.083124 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe052bbc-d7d3-4392-89a2-36d9bf31360d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:46.083882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 19/39] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:38:46.084526 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe052bbc-d7d3-4392-89a2-36d9bf31360d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:46.084946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe052bbc-d7d3-4392-89a2-36d9bf31360d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:46.085446 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe052bbc-d7d3-4392-89a2-36d9bf31360d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:46.087602 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe052bbc-d7d3-4392-89a2-36d9bf31360d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:46.089412 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe052bbc-d7d3-4392-89a2-36d9bf31360d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:46.091598 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 21/40] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:38:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:46.096840 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e676e-e369-41c3-a447-161e9feeabcb None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:46.115338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe052bbc-d7d3-4392-89a2-36d9bf31360d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:46.272523 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e676e-e369-41c3-a447-161e9feeabcb None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:46.277375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe052bbc-d7d3-4392-89a2-36d9bf31360d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:46.280454 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:46.319299 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22109e75-9d8a-4b7b-a789-0467f9a00d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:46.319976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22109e75-9d8a-4b7b-a789-0467f9a00d6d None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:46.320262 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22109e75-9d8a-4b7b-a789-0467f9a00d6d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:46.320540 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22109e75-9d8a-4b7b-a789-0467f9a00d6d None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:46.321625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22109e75-9d8a-4b7b-a789-0467f9a00d6d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:46.322677 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ced6f8-7c3e-4212-9031-eb5a8c9d4f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:46.323031 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22109e75-9d8a-4b7b-a789-0467f9a00d6d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:46.323729 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ced6f8-7c3e-4212-9031-eb5a8c9d4f55 None admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:46.324096 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ced6f8-7c3e-4212-9031-eb5a8c9d4f55 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:46.324390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ced6f8-7c3e-4212-9031-eb5a8c9d4f55 None admin] PATH_INFO: `/v3/domains/default/users/210b2db5e18c45edbd9a1a18b78d6586/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:46.326942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ced6f8-7c3e-4212-9031-eb5a8c9d4f55 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=210b2db5e18c45edbd9a1a18b78d6586, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:46.328413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ced6f8-7c3e-4212-9031-eb5a8c9d4f55 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:46.349294 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 22/41] 10.222.0.45 () {60 vars in 1131 bytes} [Thu May 26 13:38:46 2022] POST /identity/v3/roles => generated 223 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:38:46.349508 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 20/42] 10.222.0.45 () {58 vars in 1361 bytes} [Thu May 26 13:38:46 2022] PUT /identity/v3/domains/default/users/210b2db5e18c45edbd9a1a18b78d6586/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:38:46.455849 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe178a-2f90-4a29-8621-b03b948d358e None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:46.456189 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe178a-2f90-4a29-8621-b03b948d358e None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:46.456429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe178a-2f90-4a29-8621-b03b948d358e None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:46.458232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 21/43] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:38:46.464223 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1578d-ddf2-4d7f-a814-7b16a7636d1e None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:46.464752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1578d-ddf2-4d7f-a814-7b16a7636d1e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:46.464999 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1578d-ddf2-4d7f-a814-7b16a7636d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:46.484168 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-dea1578d-ddf2-4d7f-a814-7b16a7636d1e None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:38:46.485831 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-dea1578d-ddf2-4d7f-a814-7b16a7636d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:38:46.576757 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 23/44] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:38:46.600194 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe178a-2f90-4a29-8621-b03b948d358e None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:46.612239 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:46.709514 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe178a-2f90-4a29-8621-b03b948d358e None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:46.744748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458bc78-5fb5-48b3-8957-64faf4aaec4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:46.745569 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458bc78-5fb5-48b3-8957-64faf4aaec4c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:46.745857 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458bc78-5fb5-48b3-8957-64faf4aaec4c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:46.746137 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458bc78-5fb5-48b3-8957-64faf4aaec4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:46.747310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458bc78-5fb5-48b3-8957-64faf4aaec4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:46.748741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458bc78-5fb5-48b3-8957-64faf4aaec4c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:46.750409 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 22/45] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:38:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:46.756039 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1578d-ddf2-4d7f-a814-7b16a7636d1e None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:46.846551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:46.854289 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1578d-ddf2-4d7f-a814-7b16a7636d1e None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:46.888321 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab98e77-4373-4898-bb0e-8a2e5bea4ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:46.888976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab98e77-4373-4898-bb0e-8a2e5bea4ded None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:46.889257 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab98e77-4373-4898-bb0e-8a2e5bea4ded None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:46.889557 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab98e77-4373-4898-bb0e-8a2e5bea4ded None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:46.890260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab98e77-4373-4898-bb0e-8a2e5bea4ded None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:46.891721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab98e77-4373-4898-bb0e-8a2e5bea4ded None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:46.915318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 13:38:46 2022] POST /identity/v3/projects => generated 312 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:38:48.563374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe93ac-7998-4096-8abb-da90e54fc96d None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:48.563891 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe93ac-7998-4096-8abb-da90e54fc96d None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:48.564059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe93ac-7998-4096-8abb-da90e54fc96d None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:48.565489 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 23/47] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:38:48.570827 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea1c63-2479-40c9-a909-fe1d38b6768c None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:48.571208 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea1c63-2479-40c9-a909-fe1d38b6768c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:48.571397 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea1c63-2479-40c9-a909-fe1d38b6768c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:48.588643 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-3cea1c63-2479-40c9-a909-fe1d38b6768c None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:38:48.589849 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-3cea1c63-2479-40c9-a909-fe1d38b6768c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:38:48.655075 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 25/48] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:38:48.680990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe93ac-7998-4096-8abb-da90e54fc96d None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:48.758433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:48.782342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe93ac-7998-4096-8abb-da90e54fc96d None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:48.815925 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d08f16-f4d5-4274-9461-8cc341f5ebcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:48.816644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d08f16-f4d5-4274-9461-8cc341f5ebcc None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:48.816926 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d08f16-f4d5-4274-9461-8cc341f5ebcc None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:48.817200 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d08f16-f4d5-4274-9461-8cc341f5ebcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:48.827079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d08f16-f4d5-4274-9461-8cc341f5ebcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:38:48.834732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-51d08f16-f4d5-4274-9461-8cc341f5ebcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:38:48.834732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:38:48.834732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:38:48.834732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:38:48.834732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:38:48.834732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:38:48.834732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:38:48.834732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:38:48.834732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:38:48.834732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:38:48.834732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:38:48.834732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:38:48.834732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:38:48.834732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:38:48.834732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:38:48.834732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:38:48.835564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:38:48.835564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:38:48.835564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:38:48.835564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:38:48.835564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:38:48.835564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:38:48.835564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:38:48.835564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:38:48.835564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:38:48.835564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:38:48.835564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:38:48.835564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:38:48.835564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:38:48.835564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:38:48.835564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:38:48.835564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:38:48.836384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:38:48.836384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:38:48.836384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:38:48.836384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:38:48.836384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:38:48.836384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:38:48.836384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:38:48.836384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:38:48.836384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:38:48.836384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:38:48.836384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:38:48.836384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:38:48.836384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 24/49] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:38:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:38:48.841702 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea1c63-2479-40c9-a909-fe1d38b6768c None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:48.917171 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:48.942563 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea1c63-2479-40c9-a909-fe1d38b6768c None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:48.976435 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127ec88-dd0f-44d9-a8ee-f4f9d57f7359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:48.977118 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127ec88-dd0f-44d9-a8ee-f4f9d57f7359 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:48.977431 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127ec88-dd0f-44d9-a8ee-f4f9d57f7359 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:48.977708 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127ec88-dd0f-44d9-a8ee-f4f9d57f7359 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:48.978444 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127ec88-dd0f-44d9-a8ee-f4f9d57f7359 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:38:48.978749 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127ec88-dd0f-44d9-a8ee-f4f9d57f7359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:48.980117 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127ec88-dd0f-44d9-a8ee-f4f9d57f7359 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:48.988029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 26/50] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:38:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:48.993645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d08f16-f4d5-4274-9461-8cc341f5ebcc None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:49.092408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d08f16-f4d5-4274-9461-8cc341f5ebcc None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:49.108420 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977fbbb-ed1c-4281-985e-45a4fd64da38 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:49.108715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977fbbb-ed1c-4281-985e-45a4fd64da38 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:49.108999 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977fbbb-ed1c-4281-985e-45a4fd64da38 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:49.110409 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 27/51] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:38:49.115281 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3f766-5023-4baa-a34c-86581b8d2521 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:49.115573 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3f766-5023-4baa-a34c-86581b8d2521 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:49.115853 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3f766-5023-4baa-a34c-86581b8d2521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:49.125738 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dfc5a-d5ab-4da4-9f4a-a10ede9f4a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:49.126614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dfc5a-d5ab-4da4-9f4a-a10ede9f4a17 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:49.126897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dfc5a-d5ab-4da4-9f4a-a10ede9f4a17 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:49.127176 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dfc5a-d5ab-4da4-9f4a-a10ede9f4a17 None admin] PATH_INFO: `/v3/users/210b2db5e18c45edbd9a1a18b78d6586` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:49.128342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dfc5a-d5ab-4da4-9f4a-a10ede9f4a17 None admin] RBAC: Authorizing `identity:get_user(user_id=210b2db5e18c45edbd9a1a18b78d6586)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:49.129818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dfc5a-d5ab-4da4-9f4a-a10ede9f4a17 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:49.131437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 25/52] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:38:48 2022] GET /identity/v3/users/210b2db5e18c45edbd9a1a18b78d6586 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:49.132541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-eac3f766-5023-4baa-a34c-86581b8d2521 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:38:49.133813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-eac3f766-5023-4baa-a34c-86581b8d2521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:38:49.136691 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dfc5a-d5ab-4da4-9f4a-a10ede9f4a17 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:49.140322 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:49.199931 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 28/53] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:38:49.222823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3f766-5023-4baa-a34c-86581b8d2521 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:49.234244 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dfc5a-d5ab-4da4-9f4a-a10ede9f4a17 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:49.266408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff41988-3d9c-41c1-af98-f30c0faca574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:49.267190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff41988-3d9c-41c1-af98-f30c0faca574 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:49.267479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff41988-3d9c-41c1-af98-f30c0faca574 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:49.267761 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff41988-3d9c-41c1-af98-f30c0faca574 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:49.268929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff41988-3d9c-41c1-af98-f30c0faca574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:49.270418 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff41988-3d9c-41c1-af98-f30c0faca574 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:49.272057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 26/54] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:38:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:38:49.278197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff41988-3d9c-41c1-af98-f30c0faca574 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:49.288718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:49.322650 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3f766-5023-4baa-a34c-86581b8d2521 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:49.347546 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:49.356823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cc8c1-993f-41a3-9a5a-35b2ec6c7f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:49.357639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cc8c1-993f-41a3-9a5a-35b2ec6c7f7d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:49.357923 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cc8c1-993f-41a3-9a5a-35b2ec6c7f7d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:49.358215 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cc8c1-993f-41a3-9a5a-35b2ec6c7f7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:49.359349 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cc8c1-993f-41a3-9a5a-35b2ec6c7f7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:49.360790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cc8c1-993f-41a3-9a5a-35b2ec6c7f7d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:49.362416 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 29/55] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:38:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:38:49.367778 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cc8c1-993f-41a3-9a5a-35b2ec6c7f7d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:49.377300 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff41988-3d9c-41c1-af98-f30c0faca574 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:49.410691 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571370f-6229-455f-a09e-5ebf27181850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:49.411539 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571370f-6229-455f-a09e-5ebf27181850 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:49.411934 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571370f-6229-455f-a09e-5ebf27181850 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:49.412193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571370f-6229-455f-a09e-5ebf27181850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:49.413102 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571370f-6229-455f-a09e-5ebf27181850 None admin] RBAC: Adding query filter params (role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.domain.id=default, user.id=210b2db5e18c45edbd9a1a18b78d6586) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:38:49.413528 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571370f-6229-455f-a09e-5ebf27181850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:49.415612 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571370f-6229-455f-a09e-5ebf27181850 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:49.424408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 27/56] 10.222.0.45 () {56 vars in 1322 bytes} [Thu May 26 13:38:49 2022] GET /identity/v3/role_assignments?user.id=210b2db5e18c45edbd9a1a18b78d6586&scope.domain.id=default&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:38:49.473366 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cc8c1-993f-41a3-9a5a-35b2ec6c7f7d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:49.510657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a024ff-327a-42dd-8747-ddfe4026143c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:49.511334 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a024ff-327a-42dd-8747-ddfe4026143c None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:49.511621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a024ff-327a-42dd-8747-ddfe4026143c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:49.511900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a024ff-327a-42dd-8747-ddfe4026143c None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:49.512884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a024ff-327a-42dd-8747-ddfe4026143c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:49.514388 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a024ff-327a-42dd-8747-ddfe4026143c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:49.519022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:49.542577 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 30/57] 10.222.0.45 () {60 vars in 1140 bytes} [Thu May 26 13:38:49 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:38:51.722721 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd180b-84c0-47eb-9dd5-3b1e70de9e2b None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:51.723174 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd180b-84c0-47eb-9dd5-3b1e70de9e2b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:51.723291 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd180b-84c0-47eb-9dd5-3b1e70de9e2b None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:51.724664 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 28/58] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:38:51.730379 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9977ccb-8338-44c9-8f31-c5fa10fca980 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:51.730792 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9977ccb-8338-44c9-8f31-c5fa10fca980 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:51.730959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9977ccb-8338-44c9-8f31-c5fa10fca980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:51.748223 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-e9977ccb-8338-44c9-8f31-c5fa10fca980 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:38:51.749464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e9977ccb-8338-44c9-8f31-c5fa10fca980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:38:51.813850 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 31/59] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:38:51.837371 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd180b-84c0-47eb-9dd5-3b1e70de9e2b None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:51.935677 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd180b-84c0-47eb-9dd5-3b1e70de9e2b None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:51.966843 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acdf4f-e9ba-48b1-890c-25f3c3548a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:51.967614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acdf4f-e9ba-48b1-890c-25f3c3548a21 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:51.967895 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acdf4f-e9ba-48b1-890c-25f3c3548a21 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:51.968171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acdf4f-e9ba-48b1-890c-25f3c3548a21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:51.969358 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acdf4f-e9ba-48b1-890c-25f3c3548a21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:51.970791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acdf4f-e9ba-48b1-890c-25f3c3548a21 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:51.972359 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 29/60] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:38:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:51.978180 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9977ccb-8338-44c9-8f31-c5fa10fca980 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:52.072613 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9977ccb-8338-44c9-8f31-c5fa10fca980 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:52.089698 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:52.106378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992ceb9-1974-48b6-9097-c655eeb14822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:52.107047 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992ceb9-1974-48b6-9097-c655eeb14822 None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:52.107349 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992ceb9-1974-48b6-9097-c655eeb14822 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:52.107629 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992ceb9-1974-48b6-9097-c655eeb14822 None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:52.108336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992ceb9-1974-48b6-9097-c655eeb14822 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:52.109827 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992ceb9-1974-48b6-9097-c655eeb14822 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:52.135140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 32/61] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 13:38:51 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:38:55.469960 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8c635-7268-46ea-86e6-419b85eb92e9 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:55.470990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8c635-7268-46ea-86e6-419b85eb92e9 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:55.471492 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8c635-7268-46ea-86e6-419b85eb92e9 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:55.473363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 30/62] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:38:55.479129 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e89e-b55e-44cd-83c6-eed36b768a5a None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:55.479958 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e89e-b55e-44cd-83c6-eed36b768a5a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:55.480441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e89e-b55e-44cd-83c6-eed36b768a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:55.506249 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-bab5e89e-b55e-44cd-83c6-eed36b768a5a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:38:55.507773 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-bab5e89e-b55e-44cd-83c6-eed36b768a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:38:55.595933 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 33/63] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:38:55.644312 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8c635-7268-46ea-86e6-419b85eb92e9 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:55.648796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:55.768852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db8298-b271-4afd-9ff4-b5f52268be7b None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:55.769063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db8298-b271-4afd-9ff4-b5f52268be7b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:55.769549 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db8298-b271-4afd-9ff4-b5f52268be7b None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:55.771088 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 34/64] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:38:55.777380 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dd55e-77a5-4014-a38b-8356e9481f1f None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:55.777847 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dd55e-77a5-4014-a38b-8356e9481f1f None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:55.778126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dd55e-77a5-4014-a38b-8356e9481f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:55.800873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8c635-7268-46ea-86e6-419b85eb92e9 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:55.803204 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-2c1dd55e-77a5-4014-a38b-8356e9481f1f None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:38:55.804376 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-2c1dd55e-77a5-4014-a38b-8356e9481f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:38:55.861705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4bc35-2cfc-4aa3-ac0f-5324e3e8775d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:55.862498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4bc35-2cfc-4aa3-ac0f-5324e3e8775d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:55.862782 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4bc35-2cfc-4aa3-ac0f-5324e3e8775d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:55.863055 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4bc35-2cfc-4aa3-ac0f-5324e3e8775d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:55.883542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4bc35-2cfc-4aa3-ac0f-5324e3e8775d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:38:55.891580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-c4a4bc35-2cfc-4aa3-ac0f-5324e3e8775d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 13:38:55.891580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:38:55.891580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:38:55.891580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:38:55.891580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:38:55.891580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:38:55.891580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:38:55.891580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:38:55.891580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:38:55.891580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:38:55.891580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:38:55.891580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:38:55.891580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:38:55.891580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:38:55.891580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:38:55.891580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:38:55.892451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:38:55.892451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:38:55.892451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:38:55.892451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:38:55.892451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:38:55.892451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:38:55.892451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:38:55.892451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:38:55.892451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:38:55.892451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:38:55.892451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:38:55.892451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:38:55.892451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:38:55.892451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:38:55.892451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:38:55.892451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:38:55.893232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:38:55.893232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:38:55.893232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:38:55.893232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:38:55.893232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:38:55.893232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:38:55.893232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:38:55.893232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:38:55.893232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:38:55.893232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:38:55.893232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 13:38:55.893232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:38:55.893232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 31/65] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:38:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:38:55.901672 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4bc35-2cfc-4aa3-ac0f-5324e3e8775d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:55.916482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 35/66] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:38:55.917827 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be662add-0bf6-448a-b774-bddf930b16a7 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:55.918119 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be662add-0bf6-448a-b774-bddf930b16a7 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:55.918395 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be662add-0bf6-448a-b774-bddf930b16a7 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:55.919645 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 36/67] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:38:55.920896 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf8f9d-0302-4324-9d8c-e5eeff534cff None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:55.921361 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf8f9d-0302-4324-9d8c-e5eeff534cff None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:55.921828 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf8f9d-0302-4324-9d8c-e5eeff534cff None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:55.923186 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 37/68] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:38:55.925411 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25c8aa-5e22-4c34-95df-f765330e7a41 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:55.925705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25c8aa-5e22-4c34-95df-f765330e7a41 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:55.925991 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25c8aa-5e22-4c34-95df-f765330e7a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:55.943742 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-6e25c8aa-5e22-4c34-95df-f765330e7a41 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:38:55.945313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6e25c8aa-5e22-4c34-95df-f765330e7a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:38:55.978995 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:55.987708 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:56.025684 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 38/69] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:38:56.027661 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4bc35-2cfc-4aa3-ac0f-5324e3e8775d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:56.031537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dff290-c8d7-4f0e-bde7-56b919c9b474 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:56.032068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dff290-c8d7-4f0e-bde7-56b919c9b474 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:56.032556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dff290-c8d7-4f0e-bde7-56b919c9b474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:56.054623 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a6dff290-c8d7-4f0e-bde7-56b919c9b474 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:38:56.056743 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a6dff290-c8d7-4f0e-bde7-56b919c9b474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:38:56.064173 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc1c39-ba11-4a64-abe5-572c681bc07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:56.064848 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc1c39-ba11-4a64-abe5-572c681bc07c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:56.065136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc1c39-ba11-4a64-abe5-572c681bc07c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:56.065565 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc1c39-ba11-4a64-abe5-572c681bc07c None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:56.066316 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc1c39-ba11-4a64-abe5-572c681bc07c None admin] RBAC: Adding query filter params (name=member) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:38:56.066629 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc1c39-ba11-4a64-abe5-572c681bc07c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:56.067995 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc1c39-ba11-4a64-abe5-572c681bc07c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:56.080887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 32/70] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:38:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:56.080887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc1c39-ba11-4a64-abe5-572c681bc07c None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:56.133599 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 39/71] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:38:56.133599 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dff290-c8d7-4f0e-bde7-56b919c9b474 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:56.191933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc1c39-ba11-4a64-abe5-572c681bc07c None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:56.216700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:56.225673 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c40886-dae8-4c97-b1eb-2329b2c04569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:56.226152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:56.226481 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c40886-dae8-4c97-b1eb-2329b2c04569 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:56.226767 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c40886-dae8-4c97-b1eb-2329b2c04569 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:56.227054 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c40886-dae8-4c97-b1eb-2329b2c04569 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:56.232863 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dff290-c8d7-4f0e-bde7-56b919c9b474 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:56.237654 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c40886-dae8-4c97-b1eb-2329b2c04569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:38:56.245683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-c8c40886-dae8-4c97-b1eb-2329b2c04569 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:38:56.245683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:38:56.245683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:38:56.245683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:38:56.245683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:38:56.245683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:38:56.245683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:38:56.245683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:38:56.245683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:38:56.245683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:38:56.245683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:38:56.245683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:38:56.245683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:38:56.245683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:38:56.245683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:38:56.245683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:38:56.246547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:38:56.246547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:38:56.246547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:38:56.246547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:38:56.246547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:38:56.246547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:38:56.246547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:38:56.246547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:38:56.246547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:38:56.246547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:38:56.246547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:38:56.246547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:38:56.246547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:38:56.246547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:38:56.246547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:38:56.246547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:38:56.247340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:38:56.247340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:38:56.247340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:38:56.247340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:38:56.247340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:38:56.247340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:38:56.247340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:38:56.247340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:38:56.247340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:38:56.247340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:38:56.247340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:38:56.247340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:38:56.247340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 33/72] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:38:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:38:56.247966 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c40886-dae8-4c97-b1eb-2329b2c04569 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:56.272140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3992a0-c238-418c-ad6e-a7d527c9d73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:56.272933 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3992a0-c238-418c-ad6e-a7d527c9d73a None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:56.273218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3992a0-c238-418c-ad6e-a7d527c9d73a None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:56.273534 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3992a0-c238-418c-ad6e-a7d527c9d73a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:56.284049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3992a0-c238-418c-ad6e-a7d527c9d73a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:38:56.291580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-bf3992a0-c238-418c-ad6e-a7d527c9d73a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:38:56.291580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:38:56.291580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:38:56.291580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:38:56.291580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:38:56.291580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:38:56.291580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:38:56.291580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:38:56.291580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:38:56.291580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:38:56.291580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:38:56.291580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:38:56.291580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:38:56.291580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:38:56.291580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:38:56.291580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:38:56.292451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:38:56.292451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:38:56.292451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:38:56.292451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:38:56.292451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:38:56.292451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:38:56.292451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:38:56.292451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:38:56.292451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:38:56.292451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:38:56.292451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:38:56.292451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:38:56.292451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:38:56.292451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:38:56.292451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:38:56.292451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:38:56.293248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:38:56.293248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:38:56.293248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:38:56.293248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:38:56.293248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:38:56.293248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:38:56.293248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:38:56.293248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:38:56.293248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:38:56.293248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:38:56.293248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:38:56.293248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:38:56.293248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 40/73] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:38:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:38:56.294351 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf47299-446f-4340-854b-c8806ca4498a None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:56.294351 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf47299-446f-4340-854b-c8806ca4498a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:56.294474 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf47299-446f-4340-854b-c8806ca4498a None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:56.295703 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 41/74] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:38:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:38:56.297850 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf47299-446f-4340-854b-c8806ca4498a None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:56.349813 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c40886-dae8-4c97-b1eb-2329b2c04569 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:56.381792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80444d9-793f-4533-8ca6-920608b7a8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:56.382658 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80444d9-793f-4533-8ca6-920608b7a8ee None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:56.382941 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80444d9-793f-4533-8ca6-920608b7a8ee None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:56.383219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80444d9-793f-4533-8ca6-920608b7a8ee None admin] PATH_INFO: `/v3/users/a7511ee85d654a25b46c136f366541e7` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:56.396905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf47299-446f-4340-854b-c8806ca4498a None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:56.398837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80444d9-793f-4533-8ca6-920608b7a8ee None admin] RBAC: Authorizing `identity:get_user(user_id=a7511ee85d654a25b46c136f366541e7)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:56.400854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80444d9-793f-4533-8ca6-920608b7a8ee None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:56.402550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 34/75] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:38:56 2022] GET /identity/v3/users/a7511ee85d654a25b46c136f366541e7 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:56.403318 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80444d9-793f-4533-8ca6-920608b7a8ee None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:56.430936 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a793466-a00d-4ee3-bbf0-9c5d5676aace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:56.431720 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a793466-a00d-4ee3-bbf0-9c5d5676aace None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:56.432002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a793466-a00d-4ee3-bbf0-9c5d5676aace None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:56.432281 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a793466-a00d-4ee3-bbf0-9c5d5676aace None admin] PATH_INFO: `/v3/roles/member` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:56.442458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a793466-a00d-4ee3-bbf0-9c5d5676aace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:38:56.450688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-4a793466-a00d-4ee3-bbf0-9c5d5676aace None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 13:38:56.450688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:38:56.450688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:38:56.450688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:38:56.450688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:38:56.450688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:38:56.450688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:38:56.450688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:38:56.450688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:38:56.450688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:38:56.450688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:38:56.450688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:38:56.450688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:38:56.450688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:38:56.450688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:38:56.450688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:38:56.451560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:38:56.451560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:38:56.451560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:38:56.451560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:38:56.451560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:38:56.451560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:38:56.451560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:38:56.451560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:38:56.451560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:38:56.451560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:38:56.451560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:38:56.451560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:38:56.451560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:38:56.451560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:38:56.451560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:38:56.451560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:38:56.452318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:38:56.452318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:38:56.452318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:38:56.452318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:38:56.452318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:38:56.452318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:38:56.452318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:38:56.452318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:38:56.452318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:38:56.452318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:38:56.452318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 13:38:56.452318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:38:56.453124 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:56.453206 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 42/76] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:38:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:38:56.455582 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a793466-a00d-4ee3-bbf0-9c5d5676aace None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:56.472591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:56.505114 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80444d9-793f-4533-8ca6-920608b7a8ee None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:56.539115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f7826-e85e-42f6-9186-1b03cfb3cbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:56.539712 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f7826-e85e-42f6-9186-1b03cfb3cbb6 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:56.539997 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f7826-e85e-42f6-9186-1b03cfb3cbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:56.540275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f7826-e85e-42f6-9186-1b03cfb3cbb6 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:56.541017 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f7826-e85e-42f6-9186-1b03cfb3cbb6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:38:56.541362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f7826-e85e-42f6-9186-1b03cfb3cbb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:56.542735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f7826-e85e-42f6-9186-1b03cfb3cbb6 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:56.550544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 35/77] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:38:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:56.551704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4973fd-6f7d-471a-8957-7d78e106afe9 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:56.551995 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4973fd-6f7d-471a-8957-7d78e106afe9 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:56.552276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4973fd-6f7d-471a-8957-7d78e106afe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:56.558436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a793466-a00d-4ee3-bbf0-9c5d5676aace None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:56.569103 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-fd4973fd-6f7d-471a-8957-7d78e106afe9 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:38:56.570348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-fd4973fd-6f7d-471a-8957-7d78e106afe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:38:56.591228 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446fce6-41a0-40d2-96b0-f213fcc68bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:56.591892 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446fce6-41a0-40d2-96b0-f213fcc68bc7 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:56.592178 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446fce6-41a0-40d2-96b0-f213fcc68bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:56.592461 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446fce6-41a0-40d2-96b0-f213fcc68bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:56.593207 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446fce6-41a0-40d2-96b0-f213fcc68bc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:38:56.593767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446fce6-41a0-40d2-96b0-f213fcc68bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:56.594931 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446fce6-41a0-40d2-96b0-f213fcc68bc7 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:56.603009 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 43/78] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:38:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:56.603009 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446fce6-41a0-40d2-96b0-f213fcc68bc7 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:56.638744 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 36/79] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:38:56.655674 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4973fd-6f7d-471a-8957-7d78e106afe9 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:56.690119 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:56.692329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:56.714606 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446fce6-41a0-40d2-96b0-f213fcc68bc7 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:56.747534 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af290b5f-2e9c-4434-88b5-62f36f7d7ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:56.748183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af290b5f-2e9c-4434-88b5-62f36f7d7ebe None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:56.748471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af290b5f-2e9c-4434-88b5-62f36f7d7ebe None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:56.748753 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af290b5f-2e9c-4434-88b5-62f36f7d7ebe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:56.755999 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4973fd-6f7d-471a-8957-7d78e106afe9 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:56.792797 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142bd51-6f9d-4d71-ad05-8914ef4e3797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:56.793920 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142bd51-6f9d-4d71-ad05-8914ef4e3797 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:56.794360 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142bd51-6f9d-4d71-ad05-8914ef4e3797 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:56.794649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142bd51-6f9d-4d71-ad05-8914ef4e3797 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:56.795408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142bd51-6f9d-4d71-ad05-8914ef4e3797 None admin] RBAC: Adding query filter params (name=member) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:38:56.795726 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142bd51-6f9d-4d71-ad05-8914ef4e3797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:56.797565 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142bd51-6f9d-4d71-ad05-8914ef4e3797 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:56.806785 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 37/80] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:38:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:56.810184 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142bd51-6f9d-4d71-ad05-8914ef4e3797 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:56.816422 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af290b5f-2e9c-4434-88b5-62f36f7d7ebe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:56.817943 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af290b5f-2e9c-4434-88b5-62f36f7d7ebe None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:56.890949 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:56.903891 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:56.908614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142bd51-6f9d-4d71-ad05-8914ef4e3797 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:56.914693 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 44/81] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:38:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:38:56.915513 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af290b5f-2e9c-4434-88b5-62f36f7d7ebe None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:56.943022 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145ac71-dac9-4dc1-a78d-9fbb3dad1a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:56.943894 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145ac71-dac9-4dc1-a78d-9fbb3dad1a0c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:56.944182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145ac71-dac9-4dc1-a78d-9fbb3dad1a0c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:56.944469 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145ac71-dac9-4dc1-a78d-9fbb3dad1a0c None admin] PATH_INFO: `/v3/users/a7511ee85d654a25b46c136f366541e7` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:56.945699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145ac71-dac9-4dc1-a78d-9fbb3dad1a0c None admin] RBAC: Authorizing `identity:get_user(user_id=a7511ee85d654a25b46c136f366541e7)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:56.947718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145ac71-dac9-4dc1-a78d-9fbb3dad1a0c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:56.949369 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 38/82] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:38:56 2022] GET /identity/v3/users/a7511ee85d654a25b46c136f366541e7 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:56.950139 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145ac71-dac9-4dc1-a78d-9fbb3dad1a0c None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:57.011377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af290b5f-2e9c-4434-88b5-62f36f7d7ebe None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:57.044855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc4cc2-b2e0-42fb-a816-9e4c15c28348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:57.045694 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc4cc2-b2e0-42fb-a816-9e4c15c28348 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:57.045981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc4cc2-b2e0-42fb-a816-9e4c15c28348 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:57.046259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc4cc2-b2e0-42fb-a816-9e4c15c28348 None admin] PATH_INFO: `/v3/users/210b2db5e18c45edbd9a1a18b78d6586` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:57.046774 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145ac71-dac9-4dc1-a78d-9fbb3dad1a0c None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:57.047447 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc4cc2-b2e0-42fb-a816-9e4c15c28348 None admin] RBAC: Authorizing `identity:get_user(user_id=210b2db5e18c45edbd9a1a18b78d6586)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:57.048907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc4cc2-b2e0-42fb-a816-9e4c15c28348 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:57.050736 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 45/83] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:38:56 2022] GET /identity/v3/users/210b2db5e18c45edbd9a1a18b78d6586 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:57.051408 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc4cc2-b2e0-42fb-a816-9e4c15c28348 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:57.080708 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7194a51-e552-4d3c-a60f-f8bb64bf47f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:57.081530 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7194a51-e552-4d3c-a60f-f8bb64bf47f3 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:57.081821 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7194a51-e552-4d3c-a60f-f8bb64bf47f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:57.082095 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7194a51-e552-4d3c-a60f-f8bb64bf47f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:57.083284 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7194a51-e552-4d3c-a60f-f8bb64bf47f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:57.084726 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7194a51-e552-4d3c-a60f-f8bb64bf47f3 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:57.086415 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 39/84] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:38:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:57.087185 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7194a51-e552-4d3c-a60f-f8bb64bf47f3 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:57.101689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:57.121809 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:57.157416 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc4cc2-b2e0-42fb-a816-9e4c15c28348 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:57.188102 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7194a51-e552-4d3c-a60f-f8bb64bf47f3 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:57.191625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7b9f6-34db-4116-b0ed-86b1f7926c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:57.192497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7b9f6-34db-4116-b0ed-86b1f7926c2f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:57.192787 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7b9f6-34db-4116-b0ed-86b1f7926c2f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:57.193067 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7b9f6-34db-4116-b0ed-86b1f7926c2f None admin] PATH_INFO: `/v3/users/a7511ee85d654a25b46c136f366541e7` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:57.194291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7b9f6-34db-4116-b0ed-86b1f7926c2f None admin] RBAC: Authorizing `identity:get_user(user_id=a7511ee85d654a25b46c136f366541e7)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:57.195769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7b9f6-34db-4116-b0ed-86b1f7926c2f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:57.197448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 46/85] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:38:57 2022] GET /identity/v3/users/a7511ee85d654a25b46c136f366541e7 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:57.198217 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7b9f6-34db-4116-b0ed-86b1f7926c2f None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:57.224815 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635bf95-7ea1-44e5-8a71-c1bd7791c5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:57.225692 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635bf95-7ea1-44e5-8a71-c1bd7791c5dc None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:57.226029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635bf95-7ea1-44e5-8a71-c1bd7791c5dc None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:57.226333 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635bf95-7ea1-44e5-8a71-c1bd7791c5dc None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:57.227516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635bf95-7ea1-44e5-8a71-c1bd7791c5dc None admin] RBAC: Authorizing `identity:get_project(project_id=df7e1b99ff17461db446a994311e1f0f)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:57.229501 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635bf95-7ea1-44e5-8a71-c1bd7791c5dc None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:57.231193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 40/86] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:38:57 2022] GET /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:57.231193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635bf95-7ea1-44e5-8a71-c1bd7791c5dc None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:57.296210 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7b9f6-34db-4116-b0ed-86b1f7926c2f None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:57.309956 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:57.330201 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635bf95-7ea1-44e5-8a71-c1bd7791c5dc None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:57.330338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae4d9f-af01-404a-ad99-b3d0005aaafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:57.330965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae4d9f-af01-404a-ad99-b3d0005aaafa None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:57.331251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae4d9f-af01-404a-ad99-b3d0005aaafa None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:57.331536 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae4d9f-af01-404a-ad99-b3d0005aaafa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:57.331679 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:57.365036 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d86fb9-02c9-45af-8d44-cf8b787a65f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:57.365710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d86fb9-02c9-45af-8d44-cf8b787a65f1 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:57.365993 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d86fb9-02c9-45af-8d44-cf8b787a65f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:57.366274 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d86fb9-02c9-45af-8d44-cf8b787a65f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:57.399084 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae4d9f-af01-404a-ad99-b3d0005aaafa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:57.401107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae4d9f-af01-404a-ad99-b3d0005aaafa None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:57.433059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d86fb9-02c9-45af-8d44-cf8b787a65f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:57.434565 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d86fb9-02c9-45af-8d44-cf8b787a65f1 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:57.499211 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 47/87] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:38:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:38:57.499844 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae4d9f-af01-404a-ad99-b3d0005aaafa None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:57.515107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:57.534335 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 41/88] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:38:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:38:57.535180 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d86fb9-02c9-45af-8d44-cf8b787a65f1 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:57.537348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:57.602291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae4d9f-af01-404a-ad99-b3d0005aaafa None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:57.630393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d86fb9-02c9-45af-8d44-cf8b787a65f1 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:57.634948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43616c00-c4fc-4781-891f-5823df26d35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:57.635608 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43616c00-c4fc-4781-891f-5823df26d35b None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:57.635890 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43616c00-c4fc-4781-891f-5823df26d35b None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:57.636164 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43616c00-c4fc-4781-891f-5823df26d35b None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:57.636856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43616c00-c4fc-4781-891f-5823df26d35b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:57.638611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43616c00-c4fc-4781-891f-5823df26d35b None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:57.657638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 48/89] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 13:38:57 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:38:57.657638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43616c00-c4fc-4781-891f-5823df26d35b None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:57.681298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d3a84-2b68-418b-930f-874e957d7060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:57.681298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d3a84-2b68-418b-930f-874e957d7060 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:57.681298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d3a84-2b68-418b-930f-874e957d7060 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:57.681298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d3a84-2b68-418b-930f-874e957d7060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:57.739192 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:57.756097 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d3a84-2b68-418b-930f-874e957d7060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:57.757685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d3a84-2b68-418b-930f-874e957d7060 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:57.760609 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:57.782447 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43616c00-c4fc-4781-891f-5823df26d35b None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:57.827163 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27025884-224d-47bd-854d-d869fa6326be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:57.828289 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025884-224d-47bd-854d-d869fa6326be None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:57.829250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025884-224d-47bd-854d-d869fa6326be None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:57.829713 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025884-224d-47bd-854d-d869fa6326be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:57.830998 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27025884-224d-47bd-854d-d869fa6326be None admin] RBAC: Adding query filter params (role.id=c7b1597b56ba4b88a4e6ac7689dc83fc, scope.project.id=df7e1b99ff17461db446a994311e1f0f, user.id=a7511ee85d654a25b46c136f366541e7) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:38:57.831604 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27025884-224d-47bd-854d-d869fa6326be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:57.834014 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27025884-224d-47bd-854d-d869fa6326be None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:57.840837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 49/90] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:38:57 2022] GET /identity/v3/role_assignments?user.id=a7511ee85d654a25b46c136f366541e7&scope.project.id=df7e1b99ff17461db446a994311e1f0f&role.id=c7b1597b56ba4b88a4e6ac7689dc83fc => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:57.841793 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27025884-224d-47bd-854d-d869fa6326be None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:57.871558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 42/91] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:38:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:38:57.872313 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d3a84-2b68-418b-930f-874e957d7060 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:57.989260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27025884-224d-47bd-854d-d869fa6326be None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:58.010038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d3a84-2b68-418b-930f-874e957d7060 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:58.012488 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:58.030177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:58.036249 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f7c27-ca11-4c03-8d0d-057fdebc3059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:58.037407 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f7c27-ca11-4c03-8d0d-057fdebc3059 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:58.037804 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f7c27-ca11-4c03-8d0d-057fdebc3059 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:58.038196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f7c27-ca11-4c03-8d0d-057fdebc3059 None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:58.039443 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f7c27-ca11-4c03-8d0d-057fdebc3059 None admin] RBAC: Authorizing `identity:get_project(project_id=df7e1b99ff17461db446a994311e1f0f)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:58.041545 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f7c27-ca11-4c03-8d0d-057fdebc3059 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:58.043615 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 50/92] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:38:57 2022] GET /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:58.044475 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f7c27-ca11-4c03-8d0d-057fdebc3059 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:58.062549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08855294-80a2-4a86-9a19-c02f2e5455ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:58.063424 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08855294-80a2-4a86-9a19-c02f2e5455ab None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:58.063706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08855294-80a2-4a86-9a19-c02f2e5455ab None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:58.063984 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08855294-80a2-4a86-9a19-c02f2e5455ab None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:58.065184 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08855294-80a2-4a86-9a19-c02f2e5455ab None admin] RBAC: Authorizing `identity:get_project(project_id=df7e1b99ff17461db446a994311e1f0f)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:58.067523 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08855294-80a2-4a86-9a19-c02f2e5455ab None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:58.069301 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 43/93] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:38:57 2022] GET /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:58.070059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08855294-80a2-4a86-9a19-c02f2e5455ab None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:58.186296 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f7c27-ca11-4c03-8d0d-057fdebc3059 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:58.190490 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08855294-80a2-4a86-9a19-c02f2e5455ab None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:58.228161 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f778880-84ec-4992-a76a-d9d21265e5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:58.229056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f778880-84ec-4992-a76a-d9d21265e5d5 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:58.229556 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f778880-84ec-4992-a76a-d9d21265e5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:58.229998 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f778880-84ec-4992-a76a-d9d21265e5d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:58.230568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d41cd-94c3-4e17-a9bf-a03c49ddd750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:58.231149 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f778880-84ec-4992-a76a-d9d21265e5d5 None admin] RBAC: Adding query filter params (role.id=e6b3c27ed485430a88f59247935bfa08, scope.project.id=df7e1b99ff17461db446a994311e1f0f, user.id=a7511ee85d654a25b46c136f366541e7) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:38:58.231431 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d41cd-94c3-4e17-a9bf-a03c49ddd750 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:58.231718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d41cd-94c3-4e17-a9bf-a03c49ddd750 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:58.231910 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f778880-84ec-4992-a76a-d9d21265e5d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:58.232013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d41cd-94c3-4e17-a9bf-a03c49ddd750 None admin] PATH_INFO: `/v3/projects/038ae84cf3914455bf8deb6a3d13b754` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:58.233158 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d41cd-94c3-4e17-a9bf-a03c49ddd750 None admin] RBAC: Authorizing `identity:get_project(project_id=038ae84cf3914455bf8deb6a3d13b754)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:58.233849 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f778880-84ec-4992-a76a-d9d21265e5d5 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:58.234621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d41cd-94c3-4e17-a9bf-a03c49ddd750 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:58.236979 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 51/94] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:38:58 2022] GET /identity/v3/projects/038ae84cf3914455bf8deb6a3d13b754 => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:58.241980 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d41cd-94c3-4e17-a9bf-a03c49ddd750 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:58.245609 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 44/95] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:38:58 2022] GET /identity/v3/role_assignments?user.id=a7511ee85d654a25b46c136f366541e7&scope.project.id=df7e1b99ff17461db446a994311e1f0f&role.id=e6b3c27ed485430a88f59247935bfa08 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:58.246713 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f778880-84ec-4992-a76a-d9d21265e5d5 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:38:58.305427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:58.332164 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:58.369636 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d41cd-94c3-4e17-a9bf-a03c49ddd750 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:58.430676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f778880-84ec-4992-a76a-d9d21265e5d5 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:38:58.439622 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840d123-cc4e-4b97-92b9-395708e97d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:58.440274 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840d123-cc4e-4b97-92b9-395708e97d9d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:58.440566 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840d123-cc4e-4b97-92b9-395708e97d9d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:58.440849 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840d123-cc4e-4b97-92b9-395708e97d9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:58.441733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840d123-cc4e-4b97-92b9-395708e97d9d None admin] RBAC: Adding query filter params (role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.project.id=df7e1b99ff17461db446a994311e1f0f, user.id=210b2db5e18c45edbd9a1a18b78d6586) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:38:58.442052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840d123-cc4e-4b97-92b9-395708e97d9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:58.443552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840d123-cc4e-4b97-92b9-395708e97d9d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:58.456746 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 52/96] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:38:58 2022] GET /identity/v3/role_assignments?user.id=210b2db5e18c45edbd9a1a18b78d6586&scope.project.id=df7e1b99ff17461db446a994311e1f0f&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:38:58.505106 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36ff46-e6d1-4398-8b99-8c9989b6cb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:38:58.505827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36ff46-e6d1-4398-8b99-8c9989b6cb25 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:38:58.506117 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36ff46-e6d1-4398-8b99-8c9989b6cb25 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:38:58.506406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36ff46-e6d1-4398-8b99-8c9989b6cb25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:38:58.507250 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36ff46-e6d1-4398-8b99-8c9989b6cb25 None admin] RBAC: Adding query filter params (role.id=c7b1597b56ba4b88a4e6ac7689dc83fc, scope.project.id=038ae84cf3914455bf8deb6a3d13b754, user.id=a7511ee85d654a25b46c136f366541e7) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:38:58.507567 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36ff46-e6d1-4398-8b99-8c9989b6cb25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:38:58.509053 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36ff46-e6d1-4398-8b99-8c9989b6cb25 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:38:58.515941 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 45/97] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:38:58 2022] GET /identity/v3/role_assignments?user.id=a7511ee85d654a25b46c136f366541e7&scope.project.id=038ae84cf3914455bf8deb6a3d13b754&role.id=c7b1597b56ba4b88a4e6ac7689dc83fc => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:00.585484 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da23698-129a-4068-9315-13b60fcc19ae None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:00.586505 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da23698-129a-4068-9315-13b60fcc19ae None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:00.586997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da23698-129a-4068-9315-13b60fcc19ae None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:00.588893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 53/98] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:00.594081 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efee777-e754-4452-898d-458fbab4a707 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:00.594897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efee777-e754-4452-898d-458fbab4a707 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:00.595383 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efee777-e754-4452-898d-458fbab4a707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:00.612993 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-7efee777-e754-4452-898d-458fbab4a707 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:00.614539 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7efee777-e754-4452-898d-458fbab4a707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:00.731434 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 46/99] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:39:00.771278 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da23698-129a-4068-9315-13b60fcc19ae None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:00.898054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da23698-129a-4068-9315-13b60fcc19ae None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:00.910024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07396ca-8827-4c72-aa81-b1c5e920bc2a None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:00.910653 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07396ca-8827-4c72-aa81-b1c5e920bc2a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:00.911155 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07396ca-8827-4c72-aa81-b1c5e920bc2a None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:00.912754 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 47/100] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:00.918477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108ca2b-75f8-4bb7-b7f5-d07c6854cd4e None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:00.919009 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108ca2b-75f8-4bb7-b7f5-d07c6854cd4e None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:00.919509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108ca2b-75f8-4bb7-b7f5-d07c6854cd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:00.939384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-b108ca2b-75f8-4bb7-b7f5-d07c6854cd4e None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:00.940916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-b108ca2b-75f8-4bb7-b7f5-d07c6854cd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:00.952908 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:00.959810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831bd5b1-fa8e-4507-8803-15be5a9057c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:00.960626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bd5b1-fa8e-4507-8803-15be5a9057c2 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:00.961049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bd5b1-fa8e-4507-8803-15be5a9057c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:00.961319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bd5b1-fa8e-4507-8803-15be5a9057c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:00.973660 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:00.988399 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831bd5b1-fa8e-4507-8803-15be5a9057c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:01.002559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-831bd5b1-fa8e-4507-8803-15be5a9057c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 13:39:01.002559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:01.002559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:01.002559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:01.002559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:01.002559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:01.002559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:01.002559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:01.002559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:01.002559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:01.002559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:01.002559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:01.002559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:01.002559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:01.002559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:01.002559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:01.003497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:01.003497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:01.003497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:01.003497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:01.003497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:01.003497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:01.003497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:01.003497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:01.003497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:01.003497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:01.003497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:01.003497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:01.003497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:01.003497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:01.003497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:01.003497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:01.004315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:01.004315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:01.004315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:01.004315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:01.004315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:01.004315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:01.004315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:01.004315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:01.004315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:01.004315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:01.004315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 13:39:01.004315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:01.011897 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 54/101] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:01.015133 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a67ed5-60e6-4163-ac0b-870de5b48d41 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:01.017196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a67ed5-60e6-4163-ac0b-870de5b48d41 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:01.017741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a67ed5-60e6-4163-ac0b-870de5b48d41 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:01.022580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 55/102] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:01.023544 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a67ed5-60e6-4163-ac0b-870de5b48d41 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:01.060461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 48/103] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:39:01.062423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60962389-afc1-4991-9b53-1743a5afb32f None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:01.062945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60962389-afc1-4991-9b53-1743a5afb32f None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:01.063633 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60962389-afc1-4991-9b53-1743a5afb32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:01.089640 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-60962389-afc1-4991-9b53-1743a5afb32f None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:01.091726 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-60962389-afc1-4991-9b53-1743a5afb32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:01.166437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 49/104] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:01.167611 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60962389-afc1-4991-9b53-1743a5afb32f None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:01.269687 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:01.283880 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a67ed5-60e6-4163-ac0b-870de5b48d41 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:01.287452 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60962389-afc1-4991-9b53-1743a5afb32f None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:01.320238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef398c62-418b-42a6-a2bd-461cfb875ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:01.321159 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef398c62-418b-42a6-a2bd-461cfb875ef5 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:01.321655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef398c62-418b-42a6-a2bd-461cfb875ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:01.322061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef398c62-418b-42a6-a2bd-461cfb875ef5 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:01.322960 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef398c62-418b-42a6-a2bd-461cfb875ef5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:01.323460 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef398c62-418b-42a6-a2bd-461cfb875ef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:01.325034 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef398c62-418b-42a6-a2bd-461cfb875ef5 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:01.334397 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 56/105] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:01.335404 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef398c62-418b-42a6-a2bd-461cfb875ef5 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:01.336862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078766a3-1110-4f04-857a-edb99228d169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:01.338574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078766a3-1110-4f04-857a-edb99228d169 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:01.339185 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078766a3-1110-4f04-857a-edb99228d169 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:01.339733 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078766a3-1110-4f04-857a-edb99228d169 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:01.341136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078766a3-1110-4f04-857a-edb99228d169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:01.342806 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078766a3-1110-4f04-857a-edb99228d169 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:01.344783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 50/106] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:01.345783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078766a3-1110-4f04-857a-edb99228d169 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:01.423506 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:01.484450 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef398c62-418b-42a6-a2bd-461cfb875ef5 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:01.492621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078766a3-1110-4f04-857a-edb99228d169 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:01.556051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fc921-147d-4fac-a78a-57b0026cba0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:01.558393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fc921-147d-4fac-a78a-57b0026cba0d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:01.558859 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fc921-147d-4fac-a78a-57b0026cba0d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:01.559856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fc921-147d-4fac-a78a-57b0026cba0d None admin] PATH_INFO: `/v3/users/205fcb900df643b0ae60488a80feb902` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:01.572149 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0314df-af62-4b55-bf5e-de6201fbfd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:01.573214 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0314df-af62-4b55-bf5e-de6201fbfd9b None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:01.573685 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0314df-af62-4b55-bf5e-de6201fbfd9b None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:01.574131 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0314df-af62-4b55-bf5e-de6201fbfd9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:01.588673 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fc921-147d-4fac-a78a-57b0026cba0d None admin] RBAC: Authorizing `identity:get_user(user_id=205fcb900df643b0ae60488a80feb902)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:01.590187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fc921-147d-4fac-a78a-57b0026cba0d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:01.592146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 51/107] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:01 2022] GET /identity/v3/users/205fcb900df643b0ae60488a80feb902 => generated 289 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:01.593762 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0314df-af62-4b55-bf5e-de6201fbfd9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:01.597521 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fc921-147d-4fac-a78a-57b0026cba0d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:01.603796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-5c0314df-af62-4b55-bf5e-de6201fbfd9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:01.603796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:01.603796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:01.603796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:01.603796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:01.603796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:01.603796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:01.603796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:01.603796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:01.603796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:01.603796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:01.603796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:01.603796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:01.603796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:01.603796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:01.603796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:01.604789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:01.604789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:01.604789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:01.604789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:01.604789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:01.604789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:01.604789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:01.604789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:01.604789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:01.604789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:01.604789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:01.604789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:01.604789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:01.604789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:01.604789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:01.604789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:01.605865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:01.605865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:01.605865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:01.605865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:01.605865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:01.605865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:01.605865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:01.605865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:01.605865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:01.605865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:01.605865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:01.605865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:01.608179 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 57/108] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:01.609714 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280aaaaf-af10-4a67-865b-748dfee08e5e None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:01.610182 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280aaaaf-af10-4a67-865b-748dfee08e5e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:01.610634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280aaaaf-af10-4a67-865b-748dfee08e5e None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:01.612086 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 58/109] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:01.616842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280aaaaf-af10-4a67-865b-748dfee08e5e None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:01.620729 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:01.714557 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fc921-147d-4fac-a78a-57b0026cba0d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:01.753666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440437e8-dab0-4adc-a8f7-a17280b1cc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:01.754796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440437e8-dab0-4adc-a8f7-a17280b1cc5b None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:01.755252 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440437e8-dab0-4adc-a8f7-a17280b1cc5b None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:01.755680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440437e8-dab0-4adc-a8f7-a17280b1cc5b None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:01.756947 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440437e8-dab0-4adc-a8f7-a17280b1cc5b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:01.759023 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440437e8-dab0-4adc-a8f7-a17280b1cc5b None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:01.763856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280aaaaf-af10-4a67-865b-748dfee08e5e None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:01.781127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:01.799293 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 52/110] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 13:39:01 2022] POST /identity/v3/projects => generated 302 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:39:01.805814 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0cdae-8c33-48c7-983c-95975b174623 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:01.805814 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0cdae-8c33-48c7-983c-95975b174623 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:01.805814 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0cdae-8c33-48c7-983c-95975b174623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:01.818898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a242d-78ba-4d0b-a7ec-0a4ba324b055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:01.819612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a242d-78ba-4d0b-a7ec-0a4ba324b055 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:01.819936 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a242d-78ba-4d0b-a7ec-0a4ba324b055 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:01.820226 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a242d-78ba-4d0b-a7ec-0a4ba324b055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:01.842943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-31e0cdae-8c33-48c7-983c-95975b174623 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:01.844161 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-31e0cdae-8c33-48c7-983c-95975b174623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:01.945598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:01.961009 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 53/111] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:01.961935 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0cdae-8c33-48c7-983c-95975b174623 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:02.000513 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a242d-78ba-4d0b-a7ec-0a4ba324b055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:02.002212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a242d-78ba-4d0b-a7ec-0a4ba324b055 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:02.119602 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0cdae-8c33-48c7-983c-95975b174623 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:02.144252 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 59/112] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:02.144252 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a242d-78ba-4d0b-a7ec-0a4ba324b055 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:02.158675 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:02.160199 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cf85b-932e-4852-9d58-89c718f58dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:02.160954 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cf85b-932e-4852-9d58-89c718f58dd8 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:02.161370 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cf85b-932e-4852-9d58-89c718f58dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:02.161710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cf85b-932e-4852-9d58-89c718f58dd8 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:02.162478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cf85b-932e-4852-9d58-89c718f58dd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:02.162802 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cf85b-932e-4852-9d58-89c718f58dd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:02.164139 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cf85b-932e-4852-9d58-89c718f58dd8 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:02.177341 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 54/113] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:02.177341 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d983dfc-6c8b-445d-930f-7dd0ab3a02d3 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:02.177341 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d983dfc-6c8b-445d-930f-7dd0ab3a02d3 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:02.177341 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d983dfc-6c8b-445d-930f-7dd0ab3a02d3 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:02.177341 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 55/114] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:02.177341 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86009194-37c8-4aa2-9765-e2a3553d06cb None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:02.177823 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86009194-37c8-4aa2-9765-e2a3553d06cb None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:02.177898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86009194-37c8-4aa2-9765-e2a3553d06cb None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:02.179443 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 56/115] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:02.182056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86009194-37c8-4aa2-9765-e2a3553d06cb None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:02.250856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:02.270445 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a242d-78ba-4d0b-a7ec-0a4ba324b055 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:02.296654 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86009194-37c8-4aa2-9765-e2a3553d06cb None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:02.310757 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dfef4-cd50-48f1-8c6c-fd66e9abd24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:02.311585 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dfef4-cd50-48f1-8c6c-fd66e9abd24c None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:02.311872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dfef4-cd50-48f1-8c6c-fd66e9abd24c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:02.312153 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dfef4-cd50-48f1-8c6c-fd66e9abd24c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:02.323649 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dfef4-cd50-48f1-8c6c-fd66e9abd24c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:02.330600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83821788-449e-4729-9a22-93c244b3b2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:02.331450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83821788-449e-4729-9a22-93c244b3b2fd None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:02.331729 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83821788-449e-4729-9a22-93c244b3b2fd None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:02.331970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-978dfef4-cd50-48f1-8c6c-fd66e9abd24c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:39:02.331970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:02.331970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:02.331970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:02.331970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:02.331970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:02.331970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:02.331970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:02.331970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:02.331970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:02.331970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:02.331970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:02.331970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:02.331970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:02.331970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:02.331970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:02.332830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:02.332830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:02.332830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:02.332830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:02.332830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:02.332830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:02.332830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:02.332830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:02.332830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:02.332830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:02.332830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:02.332830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:02.332830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:02.332830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:02.332830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:02.332830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:02.333667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:02.333667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:02.333667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:02.333667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:02.333667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:02.333667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:02.333667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:02.333667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:02.333667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:02.333667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:02.333667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:39:02.333667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:02.334268 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83821788-449e-4729-9a22-93c244b3b2fd None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:02.334268 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83821788-449e-4729-9a22-93c244b3b2fd None admin] RBAC: Authorizing `identity:get_project(project_id=df7e1b99ff17461db446a994311e1f0f)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:02.334392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 60/116] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:39:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:02.334392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dfef4-cd50-48f1-8c6c-fd66e9abd24c None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:02.335356 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83821788-449e-4729-9a22-93c244b3b2fd None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:02.344485 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 57/117] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:02 2022] GET /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:02.344485 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb649e2-a63f-46ca-a7c1-80bcd1291ab1 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:02.344485 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb649e2-a63f-46ca-a7c1-80bcd1291ab1 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:02.344485 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb649e2-a63f-46ca-a7c1-80bcd1291ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:02.359625 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-8fb649e2-a63f-46ca-a7c1-80bcd1291ab1 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:02.360821 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8fb649e2-a63f-46ca-a7c1-80bcd1291ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:02.417689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:02.434351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 58/118] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:02.435650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6f6fc-c882-4512-a132-4f79c68cb50d None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:02.435975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6f6fc-c882-4512-a132-4f79c68cb50d None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:02.436259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6f6fc-c882-4512-a132-4f79c68cb50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:02.456368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dfef4-cd50-48f1-8c6c-fd66e9abd24c None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:02.458210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-14c6f6fc-c882-4512-a132-4f79c68cb50d None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:02.459526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-14c6f6fc-c882-4512-a132-4f79c68cb50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:02.493667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66bd0d-b444-4393-ad13-ed5c59e90465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:02.494542 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66bd0d-b444-4393-ad13-ed5c59e90465 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:02.494831 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66bd0d-b444-4393-ad13-ed5c59e90465 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:02.495112 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66bd0d-b444-4393-ad13-ed5c59e90465 None admin] PATH_INFO: `/v3/users/a7511ee85d654a25b46c136f366541e7` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:02.496310 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66bd0d-b444-4393-ad13-ed5c59e90465 None admin] RBAC: Authorizing `identity:get_user(user_id=a7511ee85d654a25b46c136f366541e7)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:02.497813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66bd0d-b444-4393-ad13-ed5c59e90465 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:02.499605 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 61/119] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:02 2022] GET /identity/v3/users/a7511ee85d654a25b46c136f366541e7 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:02.500293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66bd0d-b444-4393-ad13-ed5c59e90465 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:02.516945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:02.534906 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 59/120] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:02.537413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6f6fc-c882-4512-a132-4f79c68cb50d None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:02.626630 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66bd0d-b444-4393-ad13-ed5c59e90465 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:02.644561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6f6fc-c882-4512-a132-4f79c68cb50d None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:02.667094 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075128a-f993-4d40-86d0-f7f0af38e57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:02.667772 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075128a-f993-4d40-86d0-f7f0af38e57c None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:02.668083 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075128a-f993-4d40-86d0-f7f0af38e57c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:02.668330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075128a-f993-4d40-86d0-f7f0af38e57c None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:02.669070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075128a-f993-4d40-86d0-f7f0af38e57c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:02.669407 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075128a-f993-4d40-86d0-f7f0af38e57c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:02.672591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075128a-f993-4d40-86d0-f7f0af38e57c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:02.679459 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 62/121] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:02.680175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075128a-f993-4d40-86d0-f7f0af38e57c None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:02.685537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:02.695817 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad17b15-1f55-4c71-aaf4-b41c12b78dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:02.697201 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad17b15-1f55-4c71-aaf4-b41c12b78dce None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:02.697515 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad17b15-1f55-4c71-aaf4-b41c12b78dce None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:02.697796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad17b15-1f55-4c71-aaf4-b41c12b78dce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:02.698629 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad17b15-1f55-4c71-aaf4-b41c12b78dce None admin] RBAC: Adding query filter params (role.id=37940959ca5f49c3af8aa8cc5097b00b, scope.project.id=df7e1b99ff17461db446a994311e1f0f, user.id=205fcb900df643b0ae60488a80feb902) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:02.698942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad17b15-1f55-4c71-aaf4-b41c12b78dce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:02.700385 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad17b15-1f55-4c71-aaf4-b41c12b78dce None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:02.706091 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 60/122] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:39:02 2022] GET /identity/v3/role_assignments?user.id=205fcb900df643b0ae60488a80feb902&scope.project.id=df7e1b99ff17461db446a994311e1f0f&role.id=37940959ca5f49c3af8aa8cc5097b00b => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:02.714738 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad17b15-1f55-4c71-aaf4-b41c12b78dce None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:02.793775 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:02.798244 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075128a-f993-4d40-86d0-f7f0af38e57c None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:02.838839 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56105b59-97b0-4ce0-8974-23f9fe8bfb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:02.839791 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56105b59-97b0-4ce0-8974-23f9fe8bfb3d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:02.840079 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56105b59-97b0-4ce0-8974-23f9fe8bfb3d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:02.840363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56105b59-97b0-4ce0-8974-23f9fe8bfb3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:02.853379 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56105b59-97b0-4ce0-8974-23f9fe8bfb3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:02.862441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-56105b59-97b0-4ce0-8974-23f9fe8bfb3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:02.862441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:02.862441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:02.862441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:02.862441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:02.862441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:02.862441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:02.862441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:02.862441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:02.862441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:02.862441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:02.862441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:02.862441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:02.862441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:02.862441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:02.862441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:02.863494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:02.863494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:02.863494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:02.863494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:02.863494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:02.863494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:02.863494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:02.863494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:02.863494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:02.863494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:02.863494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:02.863494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:02.863494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:02.863494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:02.863494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:02.863494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:02.864260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:02.864260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:02.864260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:02.864260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:02.864260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:02.864260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:02.864260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:02.864260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:02.864260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:02.864260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:02.864260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:02.864260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:02.864260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 63/123] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:39:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:02.864910 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56105b59-97b0-4ce0-8974-23f9fe8bfb3d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:02.866342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad17b15-1f55-4c71-aaf4-b41c12b78dce None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:02.907204 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a2b99-6785-485d-86b3-9608a9563522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:02.908297 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a2b99-6785-485d-86b3-9608a9563522 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:02.908595 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a2b99-6785-485d-86b3-9608a9563522 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:02.908878 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a2b99-6785-485d-86b3-9608a9563522 None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:02.910457 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a2b99-6785-485d-86b3-9608a9563522 None admin] RBAC: Authorizing `identity:get_project(project_id=df7e1b99ff17461db446a994311e1f0f)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:02.912933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a2b99-6785-485d-86b3-9608a9563522 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:02.914924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 61/124] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:02 2022] GET /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:02.917607 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a2b99-6785-485d-86b3-9608a9563522 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:02.961209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:03.011019 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56105b59-97b0-4ce0-8974-23f9fe8bfb3d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:03.055930 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea704b-4bc7-4825-888e-7349c6da27c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:03.058012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea704b-4bc7-4825-888e-7349c6da27c8 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:03.058781 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea704b-4bc7-4825-888e-7349c6da27c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:03.059269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea704b-4bc7-4825-888e-7349c6da27c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:03.064057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a2b99-6785-485d-86b3-9608a9563522 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:03.075974 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea704b-4bc7-4825-888e-7349c6da27c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:03.083901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:03.086175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-85ea704b-4bc7-4825-888e-7349c6da27c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:03.086175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:03.086175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:03.086175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:03.086175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:03.086175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:03.086175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:03.086175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:03.086175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:03.086175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:03.086175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:03.086175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:03.086175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:03.086175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:03.086175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:03.086175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:03.088285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:03.088285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:03.088285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:03.088285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:03.088285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:03.088285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:03.088285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:03.088285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:03.088285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:03.088285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:03.088285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:03.088285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:03.088285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:03.088285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:03.088285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:03.088285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:03.089073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:03.089073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:03.089073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:03.089073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:03.089073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:03.089073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:03.089073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:03.089073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:03.089073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:03.089073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:03.089073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:03.089073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:03.095696 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 64/125] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:03.095696 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea704b-4bc7-4825-888e-7349c6da27c8 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:03.110792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe72212-186c-4dc2-9d03-8faf6dd16a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:03.111963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72212-186c-4dc2-9d03-8faf6dd16a05 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:03.112439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72212-186c-4dc2-9d03-8faf6dd16a05 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:03.112904 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72212-186c-4dc2-9d03-8faf6dd16a05 None admin] PATH_INFO: `/v3/users/210b2db5e18c45edbd9a1a18b78d6586` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:03.114352 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe72212-186c-4dc2-9d03-8faf6dd16a05 None admin] RBAC: Authorizing `identity:get_user(user_id=210b2db5e18c45edbd9a1a18b78d6586)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:03.116104 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe72212-186c-4dc2-9d03-8faf6dd16a05 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:03.118076 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 62/126] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:02 2022] GET /identity/v3/users/210b2db5e18c45edbd9a1a18b78d6586 => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:03.119575 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe72212-186c-4dc2-9d03-8faf6dd16a05 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:03.210549 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea704b-4bc7-4825-888e-7349c6da27c8 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:03.220870 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe72212-186c-4dc2-9d03-8faf6dd16a05 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:03.242103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:03.256924 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3299b8-3148-4988-886c-38370242f0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:03.257997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3299b8-3148-4988-886c-38370242f0ff None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:03.258477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3299b8-3148-4988-886c-38370242f0ff None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:03.259625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3299b8-3148-4988-886c-38370242f0ff None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:03.260693 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3299b8-3148-4988-886c-38370242f0ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:03.261194 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3299b8-3148-4988-886c-38370242f0ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:03.263225 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3299b8-3148-4988-886c-38370242f0ff None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:03.265647 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c768a-b25c-4518-bfc2-6543ab3ab4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:03.266974 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c768a-b25c-4518-bfc2-6543ab3ab4af None admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:03.267267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c768a-b25c-4518-bfc2-6543ab3ab4af None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:03.267554 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c768a-b25c-4518-bfc2-6543ab3ab4af None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f/users/a7511ee85d654a25b46c136f366541e7/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:03.269648 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c768a-b25c-4518-bfc2-6543ab3ab4af None admin] RBAC: Authorizing `identity:create_grant(project_id=df7e1b99ff17461db446a994311e1f0f, user_id=a7511ee85d654a25b46c136f366541e7, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:03.271950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c768a-b25c-4518-bfc2-6543ab3ab4af None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:03.273735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 65/127] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:39:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:03.275493 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3299b8-3148-4988-886c-38370242f0ff None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:03.297330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 63/128] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:39:03 2022] PUT /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f/users/a7511ee85d654a25b46c136f366541e7/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:39:03.298255 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c768a-b25c-4518-bfc2-6543ab3ab4af None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:03.363955 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:03.412133 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3299b8-3148-4988-886c-38370242f0ff None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:03.428216 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c768a-b25c-4518-bfc2-6543ab3ab4af None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:03.461247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f7b84-984e-44e0-aead-5c7ea459ea9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:03.461247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f7b84-984e-44e0-aead-5c7ea459ea9a None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:03.461247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f7b84-984e-44e0-aead-5c7ea459ea9a None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:03.461247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f7b84-984e-44e0-aead-5c7ea459ea9a None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:03.461681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f7b84-984e-44e0-aead-5c7ea459ea9a None admin] RBAC: Adding query filter params (name=member) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:03.461681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f7b84-984e-44e0-aead-5c7ea459ea9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:03.462956 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f7b84-984e-44e0-aead-5c7ea459ea9a None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:03.473677 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 66/129] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:03.474598 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f7b84-984e-44e0-aead-5c7ea459ea9a None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:03.505641 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf2c51-b030-4760-8024-6b1b880e0fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:03.506980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf2c51-b030-4760-8024-6b1b880e0fd1 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:03.507502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf2c51-b030-4760-8024-6b1b880e0fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:03.508025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf2c51-b030-4760-8024-6b1b880e0fd1 None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:03.510326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf2c51-b030-4760-8024-6b1b880e0fd1 None admin] RBAC: Authorizing `identity:get_project(project_id=df7e1b99ff17461db446a994311e1f0f)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:03.512246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf2c51-b030-4760-8024-6b1b880e0fd1 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:03.514287 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 64/130] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:03 2022] GET /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:03.515305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf2c51-b030-4760-8024-6b1b880e0fd1 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:03.540130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:03.604655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f7b84-984e-44e0-aead-5c7ea459ea9a None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:03.646999 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d129fc-c97f-46fb-98a8-79f41b9f41d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:03.648542 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d129fc-c97f-46fb-98a8-79f41b9f41d3 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:03.648975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d129fc-c97f-46fb-98a8-79f41b9f41d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:03.649437 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d129fc-c97f-46fb-98a8-79f41b9f41d3 None admin] PATH_INFO: `/v3/users/a7511ee85d654a25b46c136f366541e7` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:03.651437 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d129fc-c97f-46fb-98a8-79f41b9f41d3 None admin] RBAC: Authorizing `identity:get_user(user_id=a7511ee85d654a25b46c136f366541e7)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:03.653222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d129fc-c97f-46fb-98a8-79f41b9f41d3 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:03.655190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 67/131] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:03 2022] GET /identity/v3/users/a7511ee85d654a25b46c136f366541e7 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:03.660919 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d129fc-c97f-46fb-98a8-79f41b9f41d3 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:03.715247 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf2c51-b030-4760-8024-6b1b880e0fd1 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:03.732920 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:03.757133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5a285-d808-4c40-b9db-f14963c38b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:03.758182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5a285-d808-4c40-b9db-f14963c38b8d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:03.758561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5a285-d808-4c40-b9db-f14963c38b8d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:03.758971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5a285-d808-4c40-b9db-f14963c38b8d None admin] PATH_INFO: `/v3/users/a7511ee85d654a25b46c136f366541e7` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:03.760266 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5a285-d808-4c40-b9db-f14963c38b8d None admin] RBAC: Authorizing `identity:get_user(user_id=a7511ee85d654a25b46c136f366541e7)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:03.762184 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5a285-d808-4c40-b9db-f14963c38b8d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:03.764167 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 65/132] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:03 2022] GET /identity/v3/users/a7511ee85d654a25b46c136f366541e7 => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:03.764854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5a285-d808-4c40-b9db-f14963c38b8d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:03.800617 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d129fc-c97f-46fb-98a8-79f41b9f41d3 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:03.823111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:03.843400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e46c9-3a56-429e-93a4-efb5954eafed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:03.844943 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e46c9-3a56-429e-93a4-efb5954eafed None admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:03.845534 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e46c9-3a56-429e-93a4-efb5954eafed None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:03.846085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e46c9-3a56-429e-93a4-efb5954eafed None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f/users/210b2db5e18c45edbd9a1a18b78d6586/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:03.848466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e46c9-3a56-429e-93a4-efb5954eafed None admin] RBAC: Authorizing `identity:create_grant(project_id=df7e1b99ff17461db446a994311e1f0f, user_id=210b2db5e18c45edbd9a1a18b78d6586, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:03.850615 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e46c9-3a56-429e-93a4-efb5954eafed None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:03.874579 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 68/133] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:39:03 2022] PUT /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f/users/210b2db5e18c45edbd9a1a18b78d6586/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:39:03.875877 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e46c9-3a56-429e-93a4-efb5954eafed None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:03.926291 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5a285-d808-4c40-b9db-f14963c38b8d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:03.963298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94b17b-4da5-4515-ba28-4d1a31699acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:03.964408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94b17b-4da5-4515-ba28-4d1a31699acd None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:03.964788 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94b17b-4da5-4515-ba28-4d1a31699acd None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:03.965168 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94b17b-4da5-4515-ba28-4d1a31699acd None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:03.966898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94b17b-4da5-4515-ba28-4d1a31699acd None admin] RBAC: Authorizing `identity:get_project(project_id=df7e1b99ff17461db446a994311e1f0f)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:03.968588 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94b17b-4da5-4515-ba28-4d1a31699acd None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:03.970725 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 66/134] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:03 2022] GET /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:03.976736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94b17b-4da5-4515-ba28-4d1a31699acd None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:03.997674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e46c9-3a56-429e-93a4-efb5954eafed None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:04.032660 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:04.046874 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ba6af-89f2-4463-b928-0d32234c7d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:04.048115 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ba6af-89f2-4463-b928-0d32234c7d9f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:04.048549 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ba6af-89f2-4463-b928-0d32234c7d9f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:04.048977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ba6af-89f2-4463-b928-0d32234c7d9f None admin] PATH_INFO: `/v3/projects/038ae84cf3914455bf8deb6a3d13b754` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:04.050486 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ba6af-89f2-4463-b928-0d32234c7d9f None admin] RBAC: Authorizing `identity:get_project(project_id=038ae84cf3914455bf8deb6a3d13b754)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:04.058260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ba6af-89f2-4463-b928-0d32234c7d9f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:04.060362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 69/135] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:03 2022] GET /identity/v3/projects/038ae84cf3914455bf8deb6a3d13b754 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:04.070235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ba6af-89f2-4463-b928-0d32234c7d9f None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:04.096804 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94b17b-4da5-4515-ba28-4d1a31699acd None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:04.143983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fd253-6cf6-4fb6-8ab5-c92cffe4f864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:04.145113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fd253-6cf6-4fb6-8ab5-c92cffe4f864 None admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:04.145516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fd253-6cf6-4fb6-8ab5-c92cffe4f864 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:04.145915 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fd253-6cf6-4fb6-8ab5-c92cffe4f864 None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f/users/a7511ee85d654a25b46c136f366541e7/roles/e6b3c27ed485430a88f59247935bfa08` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:04.152257 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fd253-6cf6-4fb6-8ab5-c92cffe4f864 None admin] RBAC: Authorizing `identity:create_grant(project_id=df7e1b99ff17461db446a994311e1f0f, user_id=a7511ee85d654a25b46c136f366541e7, role_id=e6b3c27ed485430a88f59247935bfa08)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:04.153913 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fd253-6cf6-4fb6-8ab5-c92cffe4f864 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:04.158632 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:04.187681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 67/136] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:39:03 2022] PUT /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f/users/a7511ee85d654a25b46c136f366541e7/roles/e6b3c27ed485430a88f59247935bfa08 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:39:04.214929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ba6af-89f2-4463-b928-0d32234c7d9f None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:04.254497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c035b-1269-47c5-b513-c0dda6b80b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:04.255417 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c035b-1269-47c5-b513-c0dda6b80b08 None admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:04.255706 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c035b-1269-47c5-b513-c0dda6b80b08 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:04.255989 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c035b-1269-47c5-b513-c0dda6b80b08 None admin] PATH_INFO: `/v3/projects/038ae84cf3914455bf8deb6a3d13b754/users/a7511ee85d654a25b46c136f366541e7/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:04.258156 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c035b-1269-47c5-b513-c0dda6b80b08 None admin] RBAC: Authorizing `identity:create_grant(project_id=038ae84cf3914455bf8deb6a3d13b754, user_id=a7511ee85d654a25b46c136f366541e7, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:04.259857 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c035b-1269-47c5-b513-c0dda6b80b08 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:04.284196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 70/137] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:39:04 2022] PUT /identity/v3/projects/038ae84cf3914455bf8deb6a3d13b754/users/a7511ee85d654a25b46c136f366541e7/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:39:04.387409 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69d06c-ca07-4128-a536-7922674d5a94 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:04.387736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69d06c-ca07-4128-a536-7922674d5a94 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:04.387977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69d06c-ca07-4128-a536-7922674d5a94 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:04.389420 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 68/138] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:04.395345 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a2de0-9394-416b-9c0b-52e985451f2f None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:04.395651 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a2de0-9394-416b-9c0b-52e985451f2f None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:04.395912 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a2de0-9394-416b-9c0b-52e985451f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:04.417609 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-aa7a2de0-9394-416b-9c0b-52e985451f2f None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:04.418989 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-aa7a2de0-9394-416b-9c0b-52e985451f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:04.517827 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 71/139] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:04.552443 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69d06c-ca07-4128-a536-7922674d5a94 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:04.670678 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69d06c-ca07-4128-a536-7922674d5a94 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:04.689647 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:04.716390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1891f8-2cbe-45ea-9b56-2ea112415431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:04.717328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1891f8-2cbe-45ea-9b56-2ea112415431 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:04.717654 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1891f8-2cbe-45ea-9b56-2ea112415431 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:04.717937 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1891f8-2cbe-45ea-9b56-2ea112415431 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:04.721609 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1891f8-2cbe-45ea-9b56-2ea112415431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:04.723105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1891f8-2cbe-45ea-9b56-2ea112415431 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:04.724745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 69/140] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:04.730989 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a2de0-9394-416b-9c0b-52e985451f2f None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:04.797678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:04.885336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a2de0-9394-416b-9c0b-52e985451f2f None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:04.934118 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d51abf-8c49-488c-827a-9df8d3d8ac1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:04.935152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d51abf-8c49-488c-827a-9df8d3d8ac1d None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:04.935653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d51abf-8c49-488c-827a-9df8d3d8ac1d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:04.936118 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d51abf-8c49-488c-827a-9df8d3d8ac1d None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:04.937010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d51abf-8c49-488c-827a-9df8d3d8ac1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:04.938695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d51abf-8c49-488c-827a-9df8d3d8ac1d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:04.989356 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 72/141] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 13:39:04 2022] POST /identity/v3/users => generated 283 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:39:05.696592 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71516f2-08ac-459b-8643-53eb86396339 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:05.696883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71516f2-08ac-459b-8643-53eb86396339 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:05.697159 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71516f2-08ac-459b-8643-53eb86396339 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:05.698690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 70/142] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:05.703708 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f304dc-7d24-46d9-b982-f788713af0fa None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:05.704003 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f304dc-7d24-46d9-b982-f788713af0fa None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:05.704282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f304dc-7d24-46d9-b982-f788713af0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:05.721668 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-54f304dc-7d24-46d9-b982-f788713af0fa None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:05.722839 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-54f304dc-7d24-46d9-b982-f788713af0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:05.795406 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 73/143] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:05.819895 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71516f2-08ac-459b-8643-53eb86396339 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:05.945191 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71516f2-08ac-459b-8643-53eb86396339 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:05.983779 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbf368-ee3a-479d-ac2d-ff13c59bb7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:05.984609 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbf368-ee3a-479d-ac2d-ff13c59bb7c8 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:05.984878 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbf368-ee3a-479d-ac2d-ff13c59bb7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:05.985153 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbf368-ee3a-479d-ac2d-ff13c59bb7c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:06.002164 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbf368-ee3a-479d-ac2d-ff13c59bb7c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:06.010526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-eadbf368-ee3a-479d-ac2d-ff13c59bb7c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 13:39:06.010526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:06.010526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:06.010526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:06.010526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:06.010526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:06.010526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:06.010526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:06.010526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:06.010526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:06.010526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:06.010526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:06.010526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:06.010526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:06.010526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:06.010526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:06.011390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:06.011390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:06.011390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:06.011390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:06.011390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:06.011390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:06.011390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:06.011390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:06.011390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:06.011390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:06.011390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:06.011390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:06.011390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:06.011390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:06.011390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:06.011390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:06.012410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:06.012410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:06.012410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:06.012410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:06.012410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:06.012410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:06.012410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:06.012410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:06.012410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:06.012410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:06.012410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 13:39:06.012410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:06.013020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 71/144] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:06.018176 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f304dc-7d24-46d9-b982-f788713af0fa None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:06.044046 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:06.129821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f304dc-7d24-46d9-b982-f788713af0fa None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:06.166157 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663bd01-3370-44bf-852f-ef27327dfd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:06.166826 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663bd01-3370-44bf-852f-ef27327dfd7a None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:06.167105 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663bd01-3370-44bf-852f-ef27327dfd7a None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:06.167378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663bd01-3370-44bf-852f-ef27327dfd7a None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:06.168121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663bd01-3370-44bf-852f-ef27327dfd7a None admin] RBAC: Adding query filter params (name=reader) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:06.168426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663bd01-3370-44bf-852f-ef27327dfd7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:06.169843 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663bd01-3370-44bf-852f-ef27327dfd7a None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:06.178605 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 74/145] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:06.184716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbf368-ee3a-479d-ac2d-ff13c59bb7c8 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:06.226528 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:06.298371 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbf368-ee3a-479d-ac2d-ff13c59bb7c8 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:06.338343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d63a20-9cd2-4f65-a9fd-6bf6978ff502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:06.339223 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d63a20-9cd2-4f65-a9fd-6bf6978ff502 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:06.339504 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d63a20-9cd2-4f65-a9fd-6bf6978ff502 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:06.339780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d63a20-9cd2-4f65-a9fd-6bf6978ff502 None admin] PATH_INFO: `/v3/users/205fcb900df643b0ae60488a80feb902` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:06.340986 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d63a20-9cd2-4f65-a9fd-6bf6978ff502 None admin] RBAC: Authorizing `identity:get_user(user_id=205fcb900df643b0ae60488a80feb902)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:06.342470 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d63a20-9cd2-4f65-a9fd-6bf6978ff502 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:06.344281 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 72/146] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:06 2022] GET /identity/v3/users/205fcb900df643b0ae60488a80feb902 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:06.349549 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663bd01-3370-44bf-852f-ef27327dfd7a None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:06.446270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:06.469253 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663bd01-3370-44bf-852f-ef27327dfd7a None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:06.512240 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6c097-17c7-4f1e-af84-613811cc3d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:06.513038 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6c097-17c7-4f1e-af84-613811cc3d0e None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:06.513333 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6c097-17c7-4f1e-af84-613811cc3d0e None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:06.513659 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6c097-17c7-4f1e-af84-613811cc3d0e None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:06.514920 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6c097-17c7-4f1e-af84-613811cc3d0e None admin] RBAC: Authorizing `identity:get_project(project_id=df7e1b99ff17461db446a994311e1f0f)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:06.516417 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6c097-17c7-4f1e-af84-613811cc3d0e None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:06.518363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 75/147] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:06 2022] GET /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:06.524232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d63a20-9cd2-4f65-a9fd-6bf6978ff502 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:06.630970 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d63a20-9cd2-4f65-a9fd-6bf6978ff502 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:06.640597 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:06.671630 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe15f0-58f5-42f0-9693-8be19d09ddd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:06.672789 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe15f0-58f5-42f0-9693-8be19d09ddd0 None admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:06.673071 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe15f0-58f5-42f0-9693-8be19d09ddd0 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:06.673375 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe15f0-58f5-42f0-9693-8be19d09ddd0 None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f/users/205fcb900df643b0ae60488a80feb902/roles/37940959ca5f49c3af8aa8cc5097b00b` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:06.675876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe15f0-58f5-42f0-9693-8be19d09ddd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=df7e1b99ff17461db446a994311e1f0f, user_id=205fcb900df643b0ae60488a80feb902, role_id=37940959ca5f49c3af8aa8cc5097b00b)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:06.677362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe15f0-58f5-42f0-9693-8be19d09ddd0 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:06.694832 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 73/148] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:39:06 2022] PUT /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f/users/205fcb900df643b0ae60488a80feb902/roles/37940959ca5f49c3af8aa8cc5097b00b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:39:06.707870 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874afe88-65d5-458c-8aca-a58cf2abaf74 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:06.708161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874afe88-65d5-458c-8aca-a58cf2abaf74 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:06.708575 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874afe88-65d5-458c-8aca-a58cf2abaf74 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:06.710070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 76/149] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:06.716344 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4565d4-f6da-4f97-9164-3640f4d6ad07 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:06.716644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4565d4-f6da-4f97-9164-3640f4d6ad07 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:06.716906 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4565d4-f6da-4f97-9164-3640f4d6ad07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:06.738413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-ff4565d4-f6da-4f97-9164-3640f4d6ad07 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:06.739623 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ff4565d4-f6da-4f97-9164-3640f4d6ad07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:06.830082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 74/150] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:06.883057 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874afe88-65d5-458c-8aca-a58cf2abaf74 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:06.996988 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874afe88-65d5-458c-8aca-a58cf2abaf74 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:07.037493 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8858b-7ad3-461c-a0df-d4c349adc70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:07.038298 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8858b-7ad3-461c-a0df-d4c349adc70d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:07.038625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8858b-7ad3-461c-a0df-d4c349adc70d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:07.038905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8858b-7ad3-461c-a0df-d4c349adc70d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:07.054074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8858b-7ad3-461c-a0df-d4c349adc70d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:07.062837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-e6d8858b-7ad3-461c-a0df-d4c349adc70d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:07.062837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:07.062837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:07.062837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:07.062837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:07.062837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:07.062837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:07.062837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:07.062837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:07.062837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:07.062837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:07.062837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:07.062837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:07.062837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:07.062837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:07.062837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:07.063770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:07.063770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:07.063770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:07.063770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:07.063770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:07.063770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:07.063770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:07.063770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:07.063770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:07.063770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:07.063770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:07.063770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:07.063770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:07.063770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:07.063770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:07.063770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:07.066060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:07.066060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:07.066060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:07.066060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:07.066060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:07.066060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:07.066060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:07.066060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:07.066060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:07.066060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:07.066060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:07.066060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:07.066060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 77/151] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:07.074652 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4565d4-f6da-4f97-9164-3640f4d6ad07 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:07.178561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:07.185125 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4565d4-f6da-4f97-9164-3640f4d6ad07 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:07.230861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbfff7-6274-42f1-a12e-7ccbdd2a3234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:07.231531 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbfff7-6274-42f1-a12e-7ccbdd2a3234 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:07.231812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbfff7-6274-42f1-a12e-7ccbdd2a3234 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:07.232090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbfff7-6274-42f1-a12e-7ccbdd2a3234 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:07.232840 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbfff7-6274-42f1-a12e-7ccbdd2a3234 None admin] RBAC: Adding query filter params (name=member) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:07.233203 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbfff7-6274-42f1-a12e-7ccbdd2a3234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:07.234663 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbfff7-6274-42f1-a12e-7ccbdd2a3234 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:07.243824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 75/152] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:07.249283 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8858b-7ad3-461c-a0df-d4c349adc70d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:07.263129 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:07.362978 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8858b-7ad3-461c-a0df-d4c349adc70d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:07.402759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba976651-8580-4f67-8b07-8ef3b36eac3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:07.403646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba976651-8580-4f67-8b07-8ef3b36eac3d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:07.403924 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba976651-8580-4f67-8b07-8ef3b36eac3d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:07.404195 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba976651-8580-4f67-8b07-8ef3b36eac3d None admin] PATH_INFO: `/v3/users/a7511ee85d654a25b46c136f366541e7` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:07.405408 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba976651-8580-4f67-8b07-8ef3b36eac3d None admin] RBAC: Authorizing `identity:get_user(user_id=a7511ee85d654a25b46c136f366541e7)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:07.406874 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba976651-8580-4f67-8b07-8ef3b36eac3d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:07.408722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 78/153] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:07 2022] GET /identity/v3/users/a7511ee85d654a25b46c136f366541e7 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:07.414548 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbfff7-6274-42f1-a12e-7ccbdd2a3234 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:07.541936 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbfff7-6274-42f1-a12e-7ccbdd2a3234 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:07.585826 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a9504-c4ac-47c9-9335-c1b610981b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:07.586581 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a9504-c4ac-47c9-9335-c1b610981b50 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:07.586939 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a9504-c4ac-47c9-9335-c1b610981b50 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:07.587729 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a9504-c4ac-47c9-9335-c1b610981b50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:07.615632 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:07.682260 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a9504-c4ac-47c9-9335-c1b610981b50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:07.682260 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a9504-c4ac-47c9-9335-c1b610981b50 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:07.806299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 76/154] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:07.811618 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba976651-8580-4f67-8b07-8ef3b36eac3d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:07.927935 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:07.951050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba976651-8580-4f67-8b07-8ef3b36eac3d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:07.996597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70926b31-9c27-4f10-a35b-d69892298f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:07.997482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70926b31-9c27-4f10-a35b-d69892298f12 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:07.997771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70926b31-9c27-4f10-a35b-d69892298f12 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:07.998039 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70926b31-9c27-4f10-a35b-d69892298f12 None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:08.002062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70926b31-9c27-4f10-a35b-d69892298f12 None admin] RBAC: Authorizing `identity:get_project(project_id=df7e1b99ff17461db446a994311e1f0f)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:08.003555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70926b31-9c27-4f10-a35b-d69892298f12 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:08.005694 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 79/155] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:07 2022] GET /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:08.012420 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a9504-c4ac-47c9-9335-c1b610981b50 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:08.126178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:08.212421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a9504-c4ac-47c9-9335-c1b610981b50 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:08.234921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75b33f-5827-4227-afeb-899b2fe5404e None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:08.235538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75b33f-5827-4227-afeb-899b2fe5404e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:08.236045 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75b33f-5827-4227-afeb-899b2fe5404e None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:08.237642 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 80/156] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:08.243732 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6514ff4-a761-44af-9f10-eeeea813fe7d None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:08.244274 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6514ff4-a761-44af-9f10-eeeea813fe7d None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:08.244779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6514ff4-a761-44af-9f10-eeeea813fe7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:08.258300 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d5ad1-e04d-4131-8871-08e4386a46f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:08.258998 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d5ad1-e04d-4131-8871-08e4386a46f0 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:08.259287 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d5ad1-e04d-4131-8871-08e4386a46f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:08.259567 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d5ad1-e04d-4131-8871-08e4386a46f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:08.265317 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d5ad1-e04d-4131-8871-08e4386a46f0 None admin] RBAC: Adding query filter params (role.id=c7b1597b56ba4b88a4e6ac7689dc83fc, scope.project.id=df7e1b99ff17461db446a994311e1f0f, user.id=a7511ee85d654a25b46c136f366541e7) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:08.265317 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d5ad1-e04d-4131-8871-08e4386a46f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:08.265317 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d5ad1-e04d-4131-8871-08e4386a46f0 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:08.277398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 77/157] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:39:08 2022] GET /identity/v3/role_assignments?user.id=a7511ee85d654a25b46c136f366541e7&scope.project.id=df7e1b99ff17461db446a994311e1f0f&role.id=c7b1597b56ba4b88a4e6ac7689dc83fc => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:08.278925 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-f6514ff4-a761-44af-9f10-eeeea813fe7d None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:08.280371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f6514ff4-a761-44af-9f10-eeeea813fe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:08.303400 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c950f8a-0647-45cc-a9f3-279f2c69a8b2 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:08.304022 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c950f8a-0647-45cc-a9f3-279f2c69a8b2 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:08.304528 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c950f8a-0647-45cc-a9f3-279f2c69a8b2 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:08.306980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 78/158] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:08.311932 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4690a75-1369-4715-90df-8f5e708aeebe None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:08.312479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4690a75-1369-4715-90df-8f5e708aeebe None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:08.313067 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4690a75-1369-4715-90df-8f5e708aeebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:08.346778 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-f4690a75-1369-4715-90df-8f5e708aeebe None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:08.348378 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-f4690a75-1369-4715-90df-8f5e708aeebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:08.394408 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 81/159] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:39:08.448028 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6514ff4-a761-44af-9f10-eeeea813fe7d None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:08.488196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 79/160] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:08.534033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4690a75-1369-4715-90df-8f5e708aeebe None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:08.570844 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:08.603929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6514ff4-a761-44af-9f10-eeeea813fe7d None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:08.647270 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:08.653436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dce011-a738-4dd9-943d-9cf5edf5ca97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:08.654497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dce011-a738-4dd9-943d-9cf5edf5ca97 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:08.654926 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dce011-a738-4dd9-943d-9cf5edf5ca97 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:08.655367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dce011-a738-4dd9-943d-9cf5edf5ca97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:08.673051 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dce011-a738-4dd9-943d-9cf5edf5ca97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:08.681740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-57dce011-a738-4dd9-943d-9cf5edf5ca97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:08.681740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:08.681740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:08.681740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:08.681740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:08.681740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:08.681740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:08.681740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:08.681740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:08.681740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:08.681740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:08.681740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:08.681740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:08.681740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:08.681740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:08.681740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:08.682759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:08.682759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:08.682759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:08.682759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:08.682759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:08.682759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:08.682759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:08.682759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:08.682759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:08.682759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:08.682759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:08.682759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:08.682759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:08.682759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:08.682759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:08.682759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:08.683538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:08.683538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:08.683538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:08.683538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:08.683538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:08.683538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:08.683538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:08.683538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:08.683538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:08.683538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:08.683538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:08.683538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:08.690737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 82/161] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:39:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:39:08.697134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dce011-a738-4dd9-943d-9cf5edf5ca97 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:08.757581 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4690a75-1369-4715-90df-8f5e708aeebe None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:08.804653 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98af6f-a085-4851-9261-f4edfe2c8eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:08.805756 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98af6f-a085-4851-9261-f4edfe2c8eee None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:08.806183 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98af6f-a085-4851-9261-f4edfe2c8eee None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:08.806602 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98af6f-a085-4851-9261-f4edfe2c8eee None admin] PATH_INFO: `/v3/roles/member` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:08.832186 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98af6f-a085-4851-9261-f4edfe2c8eee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:08.845299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-cb98af6f-a085-4851-9261-f4edfe2c8eee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:08.845299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:08.845299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:08.845299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:08.845299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:08.845299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:08.845299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:08.845299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:08.845299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:08.845299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:08.845299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:08.845299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:08.845299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:08.845299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:08.845299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:08.845299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:08.846258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:08.846258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:08.846258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:08.846258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:08.846258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:08.846258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:08.846258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:08.846258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:08.846258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:08.846258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:08.846258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:08.846258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:08.846258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:08.846258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:08.846258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:08.846258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:08.847085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:08.847085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:08.847085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:08.847085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:08.847085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:08.847085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:08.847085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:08.847085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:08.847085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:08.847085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:08.847085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:08.847085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:08.849830 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 80/162] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:08.857153 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98af6f-a085-4851-9261-f4edfe2c8eee None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:08.879447 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dce011-a738-4dd9-943d-9cf5edf5ca97 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:08.940575 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c2102-a7a7-4dad-9cfd-a45d8c0557ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:08.941160 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c2102-a7a7-4dad-9cfd-a45d8c0557ff None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:08.941510 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c2102-a7a7-4dad-9cfd-a45d8c0557ff None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:08.941869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c2102-a7a7-4dad-9cfd-a45d8c0557ff None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:08.942846 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c2102-a7a7-4dad-9cfd-a45d8c0557ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:08.943334 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c2102-a7a7-4dad-9cfd-a45d8c0557ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:08.944892 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c2102-a7a7-4dad-9cfd-a45d8c0557ff None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:08.954400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:08.965054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 83/163] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:39:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:08.970588 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c2102-a7a7-4dad-9cfd-a45d8c0557ff None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:08.995116 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98af6f-a085-4851-9261-f4edfe2c8eee None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:09.013658 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:09.049980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bb138-05fd-4d0b-8313-b2a24668a24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:09.050901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bb138-05fd-4d0b-8313-b2a24668a24d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:09.051348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bb138-05fd-4d0b-8313-b2a24668a24d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:09.051782 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bb138-05fd-4d0b-8313-b2a24668a24d None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:09.052674 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bb138-05fd-4d0b-8313-b2a24668a24d None admin] RBAC: Adding query filter params (name=member) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:09.053120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bb138-05fd-4d0b-8313-b2a24668a24d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:09.054644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bb138-05fd-4d0b-8313-b2a24668a24d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:09.063547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 81/164] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:09.073295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bb138-05fd-4d0b-8313-b2a24668a24d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:09.141702 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c2102-a7a7-4dad-9cfd-a45d8c0557ff None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:09.194218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab95809-ffd1-4121-bab5-e35749ccc0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:09.195005 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab95809-ffd1-4121-bab5-e35749ccc0df None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:09.195294 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab95809-ffd1-4121-bab5-e35749ccc0df None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:09.195572 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab95809-ffd1-4121-bab5-e35749ccc0df None admin] PATH_INFO: `/v3/users/a7511ee85d654a25b46c136f366541e7` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:09.197352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab95809-ffd1-4121-bab5-e35749ccc0df None admin] RBAC: Authorizing `identity:get_user(user_id=a7511ee85d654a25b46c136f366541e7)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:09.198823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab95809-ffd1-4121-bab5-e35749ccc0df None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:09.202455 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bb138-05fd-4d0b-8313-b2a24668a24d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:09.209290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 84/165] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:08 2022] GET /identity/v3/users/a7511ee85d654a25b46c136f366541e7 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:09.209290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09f95f-c745-457d-8bdf-bfbdd0d44d39 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:09.209290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09f95f-c745-457d-8bdf-bfbdd0d44d39 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:09.209290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09f95f-c745-457d-8bdf-bfbdd0d44d39 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:09.209290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 85/166] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:09.210088 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09f95f-c745-457d-8bdf-bfbdd0d44d39 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:09.285980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c94abb-7292-4b4f-823e-72a33e7ffc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:09.287119 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c94abb-7292-4b4f-823e-72a33e7ffc0a None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:09.287544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c94abb-7292-4b4f-823e-72a33e7ffc0a None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:09.287978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c94abb-7292-4b4f-823e-72a33e7ffc0a None admin] PATH_INFO: `/v3/users/a7511ee85d654a25b46c136f366541e7` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:09.294010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c94abb-7292-4b4f-823e-72a33e7ffc0a None admin] RBAC: Authorizing `identity:get_user(user_id=a7511ee85d654a25b46c136f366541e7)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:09.295721 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c94abb-7292-4b4f-823e-72a33e7ffc0a None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:09.297654 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 82/167] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:09 2022] GET /identity/v3/users/a7511ee85d654a25b46c136f366541e7 => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:09.298972 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33a39b-9b73-400d-a0f6-bf194e9bb8a9 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:09.299420 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33a39b-9b73-400d-a0f6-bf194e9bb8a9 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:09.299847 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33a39b-9b73-400d-a0f6-bf194e9bb8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:09.312432 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:09.334260 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-de33a39b-9b73-400d-a0f6-bf194e9bb8a9 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:09.335442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-de33a39b-9b73-400d-a0f6-bf194e9bb8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:09.370844 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09f95f-c745-457d-8bdf-bfbdd0d44d39 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:09.400285 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:09.437976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf828629-918c-4188-b2fe-c37c53129b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:09.438631 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf828629-918c-4188-b2fe-c37c53129b59 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:09.438918 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf828629-918c-4188-b2fe-c37c53129b59 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:09.439194 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf828629-918c-4188-b2fe-c37c53129b59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:09.481895 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 83/168] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:09.482572 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33a39b-9b73-400d-a0f6-bf194e9bb8a9 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:09.623449 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf828629-918c-4188-b2fe-c37c53129b59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:09.624937 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf828629-918c-4188-b2fe-c37c53129b59 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:09.717030 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33a39b-9b73-400d-a0f6-bf194e9bb8a9 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:09.747758 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:09.802278 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 86/169] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:09.803436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf828629-918c-4188-b2fe-c37c53129b59 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:09.806078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f1149-b84a-46ce-afd6-5325c5d09626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:09.806742 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f1149-b84a-46ce-afd6-5325c5d09626 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:09.807756 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f1149-b84a-46ce-afd6-5325c5d09626 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:09.807756 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f1149-b84a-46ce-afd6-5325c5d09626 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:09.952598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:09.971432 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf828629-918c-4188-b2fe-c37c53129b59 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:09.992836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f1149-b84a-46ce-afd6-5325c5d09626 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:09.994672 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f1149-b84a-46ce-afd6-5325c5d09626 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:10.052676 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d52c04-3a70-4742-b75b-f7460eb172c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:10.053515 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d52c04-3a70-4742-b75b-f7460eb172c7 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:10.053797 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d52c04-3a70-4742-b75b-f7460eb172c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:10.054074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d52c04-3a70-4742-b75b-f7460eb172c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:10.080367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d52c04-3a70-4742-b75b-f7460eb172c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:10.088868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-65d52c04-3a70-4742-b75b-f7460eb172c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:39:10.088868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:10.088868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:10.088868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:10.088868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:10.088868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:10.088868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:10.088868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:10.088868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:10.088868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:10.088868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:10.088868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:10.088868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:10.088868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:10.088868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:10.088868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:10.089770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:10.089770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:10.089770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:10.089770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:10.089770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:10.089770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:10.089770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:10.089770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:10.089770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:10.089770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:10.089770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:10.089770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:10.089770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:10.089770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:10.089770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:10.089770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:10.090574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:10.090574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:10.090574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:10.090574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:10.090574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:10.090574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:10.090574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:10.090574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:10.090574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:10.090574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:10.090574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:39:10.090574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:10.101768 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 87/170] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:39:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:10.104087 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d52c04-3a70-4742-b75b-f7460eb172c7 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:10.153769 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 84/171] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:10.155902 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d98b64-1a36-4c29-a5c4-e565c451bf15 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:10.158787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d98b64-1a36-4c29-a5c4-e565c451bf15 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:10.159274 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d98b64-1a36-4c29-a5c4-e565c451bf15 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:10.160131 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:10.163476 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 85/172] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:10.164611 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d98b64-1a36-4c29-a5c4-e565c451bf15 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:10.291858 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:10.315503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d52c04-3a70-4742-b75b-f7460eb172c7 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:10.324286 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d98b64-1a36-4c29-a5c4-e565c451bf15 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:10.365459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd57cb-e6c2-4ede-b804-205bb6215086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:10.366665 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd57cb-e6c2-4ede-b804-205bb6215086 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:10.366944 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd57cb-e6c2-4ede-b804-205bb6215086 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:10.367219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd57cb-e6c2-4ede-b804-205bb6215086 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:10.367996 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd57cb-e6c2-4ede-b804-205bb6215086 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:10.368304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd57cb-e6c2-4ede-b804-205bb6215086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:10.369689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd57cb-e6c2-4ede-b804-205bb6215086 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:10.379363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 86/173] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:10.380302 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd57cb-e6c2-4ede-b804-205bb6215086 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:10.409341 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694dd0fa-1163-4227-98d6-256e3a1fcbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:10.410582 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dd0fa-1163-4227-98d6-256e3a1fcbdc None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:10.414547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dd0fa-1163-4227-98d6-256e3a1fcbdc None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:10.414547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dd0fa-1163-4227-98d6-256e3a1fcbdc None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:10.414547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694dd0fa-1163-4227-98d6-256e3a1fcbdc None admin] RBAC: Authorizing `identity:get_project(project_id=df7e1b99ff17461db446a994311e1f0f)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:10.417760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694dd0fa-1163-4227-98d6-256e3a1fcbdc None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:10.419567 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 88/174] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:10 2022] GET /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:10.422063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8220453-e2a6-40af-8871-1004d9c7a93d None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:10.422344 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8220453-e2a6-40af-8871-1004d9c7a93d None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:10.422619 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8220453-e2a6-40af-8871-1004d9c7a93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:10.456283 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-b8220453-e2a6-40af-8871-1004d9c7a93d None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:10.457512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-b8220453-e2a6-40af-8871-1004d9c7a93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:10.515682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd57cb-e6c2-4ede-b804-205bb6215086 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:10.533309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 89/175] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:10.533309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8220453-e2a6-40af-8871-1004d9c7a93d None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:10.559820 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:10.565375 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623c015-c375-40f8-81b3-9570f64fa785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:10.566211 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623c015-c375-40f8-81b3-9570f64fa785 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:10.566446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623c015-c375-40f8-81b3-9570f64fa785 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:10.566716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623c015-c375-40f8-81b3-9570f64fa785 None admin] PATH_INFO: `/v3/projects/038ae84cf3914455bf8deb6a3d13b754` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:10.567958 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623c015-c375-40f8-81b3-9570f64fa785 None admin] RBAC: Authorizing `identity:get_project(project_id=038ae84cf3914455bf8deb6a3d13b754)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:10.569440 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623c015-c375-40f8-81b3-9570f64fa785 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:10.571833 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 87/176] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:10 2022] GET /identity/v3/projects/038ae84cf3914455bf8deb6a3d13b754 => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:10.576626 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623c015-c375-40f8-81b3-9570f64fa785 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:10.576626 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:10.643909 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8220453-e2a6-40af-8871-1004d9c7a93d None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:10.682697 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623c015-c375-40f8-81b3-9570f64fa785 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:10.686101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce635c-b5fd-425d-a3c7-bf84cfe3ca63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:10.687208 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce635c-b5fd-425d-a3c7-bf84cfe3ca63 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:10.687688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce635c-b5fd-425d-a3c7-bf84cfe3ca63 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:10.688156 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce635c-b5fd-425d-a3c7-bf84cfe3ca63 None admin] PATH_INFO: `/v3/users/210b2db5e18c45edbd9a1a18b78d6586` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:10.689682 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce635c-b5fd-425d-a3c7-bf84cfe3ca63 None admin] RBAC: Authorizing `identity:get_user(user_id=210b2db5e18c45edbd9a1a18b78d6586)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:10.691482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce635c-b5fd-425d-a3c7-bf84cfe3ca63 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:10.693357 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 90/177] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:10 2022] GET /identity/v3/users/210b2db5e18c45edbd9a1a18b78d6586 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:10.694690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1f699-b389-4187-a9e9-e71b498eed88 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:10.695045 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1f699-b389-4187-a9e9-e71b498eed88 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:10.695392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1f699-b389-4187-a9e9-e71b498eed88 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:10.697410 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 91/178] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:10.698536 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b25c44-a16f-45d6-ab3c-7250df4bee39 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:10.698823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b25c44-a16f-45d6-ab3c-7250df4bee39 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:10.699095 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b25c44-a16f-45d6-ab3c-7250df4bee39 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:10.700483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 92/179] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:10.702061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b25c44-a16f-45d6-ab3c-7250df4bee39 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:10.727622 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333351f6-d13e-40c4-a0ac-69715b1f4a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:10.728272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333351f6-d13e-40c4-a0ac-69715b1f4a27 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:10.728555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333351f6-d13e-40c4-a0ac-69715b1f4a27 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:10.728826 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333351f6-d13e-40c4-a0ac-69715b1f4a27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:10.729675 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333351f6-d13e-40c4-a0ac-69715b1f4a27 None admin] RBAC: Adding query filter params (role.id=e6b3c27ed485430a88f59247935bfa08, scope.project.id=df7e1b99ff17461db446a994311e1f0f, user.id=a7511ee85d654a25b46c136f366541e7) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:10.729986 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333351f6-d13e-40c4-a0ac-69715b1f4a27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:10.731413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333351f6-d13e-40c4-a0ac-69715b1f4a27 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:10.737123 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 88/180] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:39:10 2022] GET /identity/v3/role_assignments?user.id=a7511ee85d654a25b46c136f366541e7&scope.project.id=df7e1b99ff17461db446a994311e1f0f&role.id=e6b3c27ed485430a88f59247935bfa08 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:10.737920 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333351f6-d13e-40c4-a0ac-69715b1f4a27 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:10.809557 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:10.814067 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:10.823832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b25c44-a16f-45d6-ab3c-7250df4bee39 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:10.853553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333351f6-d13e-40c4-a0ac-69715b1f4a27 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:10.862042 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19559c0-8b8b-4a7a-9f88-937601731003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:10.862852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19559c0-8b8b-4a7a-9f88-937601731003 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:10.863133 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19559c0-8b8b-4a7a-9f88-937601731003 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:10.863408 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19559c0-8b8b-4a7a-9f88-937601731003 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:10.875774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19559c0-8b8b-4a7a-9f88-937601731003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:10.884098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-b19559c0-8b8b-4a7a-9f88-937601731003 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:39:10.884098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:10.884098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:10.884098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:10.884098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:10.884098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:10.884098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:10.884098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:10.884098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:10.884098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:10.884098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:10.884098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:10.884098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:10.884098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:10.884098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:10.884098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:10.885049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:10.885049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:10.885049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:10.885049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:10.885049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:10.885049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:10.885049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:10.885049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:10.885049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:10.885049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:10.885049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:10.885049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:10.885049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:10.885049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:10.885049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:10.885049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:10.886293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:10.886293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:10.886293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:10.886293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:10.886293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:10.886293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:10.886293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:10.886293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:10.886293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:10.886293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:10.886293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:39:10.886293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:10.886293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 93/181] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:39:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:10.886293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19559c0-8b8b-4a7a-9f88-937601731003 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:10.894049 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90724b23-8786-4490-a7a4-c2edbe8b5ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:10.894049 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90724b23-8786-4490-a7a4-c2edbe8b5ddb None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:10.894352 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90724b23-8786-4490-a7a4-c2edbe8b5ddb None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:10.894513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90724b23-8786-4490-a7a4-c2edbe8b5ddb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:10.895352 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90724b23-8786-4490-a7a4-c2edbe8b5ddb None admin] RBAC: Adding query filter params (role.id=c7b1597b56ba4b88a4e6ac7689dc83fc, scope.project.id=038ae84cf3914455bf8deb6a3d13b754, user.id=a7511ee85d654a25b46c136f366541e7) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:10.895663 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90724b23-8786-4490-a7a4-c2edbe8b5ddb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:10.897127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90724b23-8786-4490-a7a4-c2edbe8b5ddb None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:10.913306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 89/182] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:39:10 2022] GET /identity/v3/role_assignments?user.id=a7511ee85d654a25b46c136f366541e7&scope.project.id=038ae84cf3914455bf8deb6a3d13b754&role.id=c7b1597b56ba4b88a4e6ac7689dc83fc => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:10.913306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a32fd-406c-403d-b506-4db1287dd6e7 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:10.913306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a32fd-406c-403d-b506-4db1287dd6e7 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:10.913306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a32fd-406c-403d-b506-4db1287dd6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:10.933778 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-f41a32fd-406c-403d-b506-4db1287dd6e7 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:10.935158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-f41a32fd-406c-403d-b506-4db1287dd6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:11.020330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 90/183] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:11.024463 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19559c0-8b8b-4a7a-9f88-937601731003 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:11.029866 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7022e10-1c16-45ac-8736-b2d901de11c4 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:11.030306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7022e10-1c16-45ac-8736-b2d901de11c4 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:11.030715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7022e10-1c16-45ac-8736-b2d901de11c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:11.053699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-f7022e10-1c16-45ac-8736-b2d901de11c4 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:11.054919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-f7022e10-1c16-45ac-8736-b2d901de11c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:11.073600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb123d6-2417-4cc0-a9f6-f617fa00f731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:11.074323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb123d6-2417-4cc0-a9f6-f617fa00f731 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:11.074557 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb123d6-2417-4cc0-a9f6-f617fa00f731 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:11.074838 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb123d6-2417-4cc0-a9f6-f617fa00f731 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:11.098981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:11.116517 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:11.134243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 91/184] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:11.135698 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04135594-66b0-4d61-b9da-c4a6246f6283 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:11.135984 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04135594-66b0-4d61-b9da-c4a6246f6283 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:11.136261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04135594-66b0-4d61-b9da-c4a6246f6283 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:11.137800 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 92/185] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:11.138491 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04135594-66b0-4d61-b9da-c4a6246f6283 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:11.167956 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb123d6-2417-4cc0-a9f6-f617fa00f731 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:11.169511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb123d6-2417-4cc0-a9f6-f617fa00f731 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:11.248377 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04135594-66b0-4d61-b9da-c4a6246f6283 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:11.269413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 94/186] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:11.270257 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb123d6-2417-4cc0-a9f6-f617fa00f731 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:11.280616 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d679f-6162-48bb-8395-a6062d4b841c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:11.281288 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d679f-6162-48bb-8395-a6062d4b841c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:11.281578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d679f-6162-48bb-8395-a6062d4b841c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:11.281854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d679f-6162-48bb-8395-a6062d4b841c None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:11.282593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d679f-6162-48bb-8395-a6062d4b841c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:11.282898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d679f-6162-48bb-8395-a6062d4b841c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:11.284248 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d679f-6162-48bb-8395-a6062d4b841c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:11.293324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 93/187] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:11.294666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b5b68-3971-4a16-8806-f126258d4bbd None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:11.294964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b5b68-3971-4a16-8806-f126258d4bbd None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:11.295248 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b5b68-3971-4a16-8806-f126258d4bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:11.311371 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-4f3b5b68-3971-4a16-8806-f126258d4bbd None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:11.312537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-4f3b5b68-3971-4a16-8806-f126258d4bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:11.323895 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:11.357660 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:11.370327 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb123d6-2417-4cc0-a9f6-f617fa00f731 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:11.379023 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 94/188] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:11.384550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b5b68-3971-4a16-8806-f126258d4bbd None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:11.409873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b8cd7-1423-4eb4-96ea-9e1c70696daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:11.410666 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8cd7-1423-4eb4-96ea-9e1c70696daf None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:11.410948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8cd7-1423-4eb4-96ea-9e1c70696daf None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:11.411268 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8cd7-1423-4eb4-96ea-9e1c70696daf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:11.422052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b8cd7-1423-4eb4-96ea-9e1c70696daf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:11.430203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-b50b8cd7-1423-4eb4-96ea-9e1c70696daf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:11.430203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:11.430203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:11.430203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:11.430203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:11.430203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:11.430203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:11.430203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:11.430203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:11.430203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:11.430203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:11.430203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:11.430203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:11.430203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:11.430203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:11.430203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:11.431705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:11.431705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:11.431705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:11.431705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:11.431705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:11.431705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:11.431705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:11.431705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:11.431705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:11.431705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:11.431705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:11.431705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:11.431705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:11.431705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:11.431705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:11.431705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:11.432487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:11.432487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:11.432487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:11.432487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:11.432487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:11.432487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:11.432487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:11.432487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:11.432487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:11.432487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:11.432487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:11.432487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:11.432487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 95/189] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:39:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:11.433139 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b8cd7-1423-4eb4-96ea-9e1c70696daf None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:11.488009 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b5b68-3971-4a16-8806-f126258d4bbd None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:11.520514 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1276799-4984-442e-88e8-807fbe046bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:11.521324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1276799-4984-442e-88e8-807fbe046bbd None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:11.521604 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1276799-4984-442e-88e8-807fbe046bbd None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:11.521878 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1276799-4984-442e-88e8-807fbe046bbd None admin] PATH_INFO: `/v3/domains/default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:11.523019 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1276799-4984-442e-88e8-807fbe046bbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:11.524436 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1276799-4984-442e-88e8-807fbe046bbd None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:11.530733 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 95/190] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:11.530733 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1276799-4984-442e-88e8-807fbe046bbd None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:11.533766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b8cd7-1423-4eb4-96ea-9e1c70696daf None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:11.546687 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:11.567763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc3d3f-f363-48bf-8167-a313b2d6e813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:11.568689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc3d3f-f363-48bf-8167-a313b2d6e813 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:11.568972 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc3d3f-f363-48bf-8167-a313b2d6e813 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:11.569240 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc3d3f-f363-48bf-8167-a313b2d6e813 None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:11.570420 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc3d3f-f363-48bf-8167-a313b2d6e813 None admin] RBAC: Authorizing `identity:get_project(project_id=df7e1b99ff17461db446a994311e1f0f)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:11.571880 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc3d3f-f363-48bf-8167-a313b2d6e813 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:11.573578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 96/191] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:11 2022] GET /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:11.573578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc3d3f-f363-48bf-8167-a313b2d6e813 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:11.579429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:11.629394 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1276799-4984-442e-88e8-807fbe046bbd None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:11.662757 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4830e5e-659f-4631-89a6-f0d1036d19b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:11.663619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4830e5e-659f-4631-89a6-f0d1036d19b5 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:11.663903 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4830e5e-659f-4631-89a6-f0d1036d19b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:11.664173 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4830e5e-659f-4631-89a6-f0d1036d19b5 None admin] PATH_INFO: `/v3/users/c68ddf97f0744dfda3469738db82c6e9` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:11.675394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc3d3f-f363-48bf-8167-a313b2d6e813 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:11.677288 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4830e5e-659f-4631-89a6-f0d1036d19b5 None admin] RBAC: Authorizing `identity:get_user(user_id=c68ddf97f0744dfda3469738db82c6e9)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:11.678745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4830e5e-659f-4631-89a6-f0d1036d19b5 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:11.680965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 96/192] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:11 2022] GET /identity/v3/users/c68ddf97f0744dfda3469738db82c6e9 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:11.681758 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4830e5e-659f-4631-89a6-f0d1036d19b5 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:11.709867 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82279e58-a6d4-4334-97f6-f04ff69cab85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:11.710654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82279e58-a6d4-4334-97f6-f04ff69cab85 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:11.710942 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82279e58-a6d4-4334-97f6-f04ff69cab85 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:11.711217 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82279e58-a6d4-4334-97f6-f04ff69cab85 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:11.721142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82279e58-a6d4-4334-97f6-f04ff69cab85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:11.728916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-82279e58-a6d4-4334-97f6-f04ff69cab85 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 13:39:11.728916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:11.728916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:11.728916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:11.728916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:11.728916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:11.728916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:11.728916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:11.728916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:11.728916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:11.728916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:11.728916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:11.728916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:11.728916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:11.728916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:11.728916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:11.729994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:11.729994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:11.729994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:11.729994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:11.729994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:11.729994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:11.729994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:11.729994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:11.729994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:11.729994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:11.729994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:11.729994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:11.729994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:11.729994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:11.729994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:11.729994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:11.730855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:11.730855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:11.730855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:11.730855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:11.730855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:11.730855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:11.730855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:11.730855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:11.730855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:11.730855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:11.730855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 13:39:11.730855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:11.730855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 97/193] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:11.730855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82279e58-a6d4-4334-97f6-f04ff69cab85 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:11.772121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:11.782069 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4830e5e-659f-4631-89a6-f0d1036d19b5 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:11.791115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:11.815836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d1c8f-50ae-417c-a6ad-9b625b832dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:11.816493 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d1c8f-50ae-417c-a6ad-9b625b832dcd None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:11.816773 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d1c8f-50ae-417c-a6ad-9b625b832dcd None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:11.817046 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d1c8f-50ae-417c-a6ad-9b625b832dcd None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:11.817852 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d1c8f-50ae-417c-a6ad-9b625b832dcd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:11.818153 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d1c8f-50ae-417c-a6ad-9b625b832dcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:11.819510 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d1c8f-50ae-417c-a6ad-9b625b832dcd None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:11.827941 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 97/194] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:39:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:11.828745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d1c8f-50ae-417c-a6ad-9b625b832dcd None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:11.829497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82279e58-a6d4-4334-97f6-f04ff69cab85 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:11.862208 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6f971-57a2-4df7-81f0-5bb78112e4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:11.862871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6f971-57a2-4df7-81f0-5bb78112e4e1 None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:11.863155 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6f971-57a2-4df7-81f0-5bb78112e4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:11.863431 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6f971-57a2-4df7-81f0-5bb78112e4e1 None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:11.864134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6f971-57a2-4df7-81f0-5bb78112e4e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:11.865616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6f971-57a2-4df7-81f0-5bb78112e4e1 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:11.885140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 98/195] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 13:39:11 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:39:11.886539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6f971-57a2-4df7-81f0-5bb78112e4e1 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:11.933997 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d1c8f-50ae-417c-a6ad-9b625b832dcd None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:11.972537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ece33-e939-433b-8531-059cce78226a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:11.973209 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ece33-e939-433b-8531-059cce78226a None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:11.973527 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ece33-e939-433b-8531-059cce78226a None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:11.973811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ece33-e939-433b-8531-059cce78226a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:11.974663 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ece33-e939-433b-8531-059cce78226a None admin] RBAC: Adding query filter params (role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.project.id=df7e1b99ff17461db446a994311e1f0f, user.id=210b2db5e18c45edbd9a1a18b78d6586) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:11.974980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ece33-e939-433b-8531-059cce78226a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:11.976529 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ece33-e939-433b-8531-059cce78226a None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:11.997492 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 98/196] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:39:11 2022] GET /identity/v3/role_assignments?user.id=210b2db5e18c45edbd9a1a18b78d6586&scope.project.id=df7e1b99ff17461db446a994311e1f0f&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:11.997492 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ece33-e939-433b-8531-059cce78226a None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:12.013476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:12.020189 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6f971-57a2-4df7-81f0-5bb78112e4e1 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:12.062390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:12.070387 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87c12f-5955-4640-8cf9-500de0b71f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:12.071715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87c12f-5955-4640-8cf9-500de0b71f2b None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:12.072008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87c12f-5955-4640-8cf9-500de0b71f2b None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:12.072339 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87c12f-5955-4640-8cf9-500de0b71f2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:12.159164 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87c12f-5955-4640-8cf9-500de0b71f2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:12.160705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87c12f-5955-4640-8cf9-500de0b71f2b None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:12.167614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ece33-e939-433b-8531-059cce78226a None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:12.225684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccec82a-016f-4f62-9967-fd188c0d4b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:12.226354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccec82a-016f-4f62-9967-fd188c0d4b7c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:12.226638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccec82a-016f-4f62-9967-fd188c0d4b7c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:12.226916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccec82a-016f-4f62-9967-fd188c0d4b7c None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:12.228238 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccec82a-016f-4f62-9967-fd188c0d4b7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:12.228543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccec82a-016f-4f62-9967-fd188c0d4b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:12.229933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccec82a-016f-4f62-9967-fd188c0d4b7c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:12.239706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 99/197] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:12.240612 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccec82a-016f-4f62-9967-fd188c0d4b7c None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:12.290122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 99/198] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:12.290539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:12.296337 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87c12f-5955-4640-8cf9-500de0b71f2b None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:12.371175 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:12.378485 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccec82a-016f-4f62-9967-fd188c0d4b7c None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:12.423985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd0954-9b45-4bcb-99c2-25a22eb258b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:12.425291 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd0954-9b45-4bcb-99c2-25a22eb258b6 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:12.425730 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd0954-9b45-4bcb-99c2-25a22eb258b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:12.426154 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd0954-9b45-4bcb-99c2-25a22eb258b6 None admin] PATH_INFO: `/v3/users/c68ddf97f0744dfda3469738db82c6e9` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:12.427540 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd0954-9b45-4bcb-99c2-25a22eb258b6 None admin] RBAC: Authorizing `identity:get_user(user_id=c68ddf97f0744dfda3469738db82c6e9)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:12.429610 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd0954-9b45-4bcb-99c2-25a22eb258b6 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:12.432857 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 100/199] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:12 2022] GET /identity/v3/users/c68ddf97f0744dfda3469738db82c6e9 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:12.433663 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd0954-9b45-4bcb-99c2-25a22eb258b6 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:12.434457 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87c12f-5955-4640-8cf9-500de0b71f2b None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:12.478862 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082d5ab-d64b-48cc-8fd5-b8aeed79d4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:12.479742 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082d5ab-d64b-48cc-8fd5-b8aeed79d4f1 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:12.480019 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082d5ab-d64b-48cc-8fd5-b8aeed79d4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:12.480293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082d5ab-d64b-48cc-8fd5-b8aeed79d4f1 None admin] PATH_INFO: `/v3/users/205fcb900df643b0ae60488a80feb902` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:12.481764 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082d5ab-d64b-48cc-8fd5-b8aeed79d4f1 None admin] RBAC: Authorizing `identity:get_user(user_id=205fcb900df643b0ae60488a80feb902)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:12.483223 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082d5ab-d64b-48cc-8fd5-b8aeed79d4f1 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:12.485057 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 100/200] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:12 2022] GET /identity/v3/users/205fcb900df643b0ae60488a80feb902 => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:12.485787 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082d5ab-d64b-48cc-8fd5-b8aeed79d4f1 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:12.556965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd0954-9b45-4bcb-99c2-25a22eb258b6 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:12.569127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:12.599737 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cf64f-40fc-4686-9eb2-8ec50f831b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:12.601466 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cf64f-40fc-4686-9eb2-8ec50f831b76 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:12.601883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cf64f-40fc-4686-9eb2-8ec50f831b76 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:12.602347 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cf64f-40fc-4686-9eb2-8ec50f831b76 None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:12.603718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0cf64f-40fc-4686-9eb2-8ec50f831b76 None admin] RBAC: Authorizing `identity:get_project(project_id=954de20b90ec45ea91ae6997825c8772)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:12.605894 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0cf64f-40fc-4686-9eb2-8ec50f831b76 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:12.613022 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 101/201] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:12 2022] GET /identity/v3/projects/954de20b90ec45ea91ae6997825c8772 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:12.613022 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cf64f-40fc-4686-9eb2-8ec50f831b76 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:12.624338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082d5ab-d64b-48cc-8fd5-b8aeed79d4f1 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:12.651289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:12.672322 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238ed21-1c58-410f-89ad-d457914fcd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:12.672322 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238ed21-1c58-410f-89ad-d457914fcd1d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:12.672322 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238ed21-1c58-410f-89ad-d457914fcd1d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:12.672322 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238ed21-1c58-410f-89ad-d457914fcd1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:12.753231 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cf64f-40fc-4686-9eb2-8ec50f831b76 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:12.763641 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238ed21-1c58-410f-89ad-d457914fcd1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:12.765888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238ed21-1c58-410f-89ad-d457914fcd1d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:12.795717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6be7a-cc90-42e8-ab36-c7c8972827f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:12.796746 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6be7a-cc90-42e8-ab36-c7c8972827f8 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:12.797355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6be7a-cc90-42e8-ab36-c7c8972827f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:12.797912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6be7a-cc90-42e8-ab36-c7c8972827f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:12.832383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:12.874159 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 101/202] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:12.874875 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238ed21-1c58-410f-89ad-d457914fcd1d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:12.875633 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6be7a-cc90-42e8-ab36-c7c8972827f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:12.877406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6be7a-cc90-42e8-ab36-c7c8972827f8 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:12.910465 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:12.978645 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238ed21-1c58-410f-89ad-d457914fcd1d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:12.988198 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 102/203] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:12.989457 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6be7a-cc90-42e8-ab36-c7c8972827f8 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:13.015143 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68974ab5-122e-4c17-a34f-537298a3ab37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:13.016057 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68974ab5-122e-4c17-a34f-537298a3ab37 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:13.016187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68974ab5-122e-4c17-a34f-537298a3ab37 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:13.016443 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68974ab5-122e-4c17-a34f-537298a3ab37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:13.017298 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68974ab5-122e-4c17-a34f-537298a3ab37 None admin] RBAC: Adding query filter params (role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.project.id=954de20b90ec45ea91ae6997825c8772, user.id=c68ddf97f0744dfda3469738db82c6e9) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:13.017620 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68974ab5-122e-4c17-a34f-537298a3ab37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:13.019150 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68974ab5-122e-4c17-a34f-537298a3ab37 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:13.033299 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 102/204] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:39:12 2022] GET /identity/v3/role_assignments?user.id=c68ddf97f0744dfda3469738db82c6e9&scope.project.id=954de20b90ec45ea91ae6997825c8772&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:13.033299 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68974ab5-122e-4c17-a34f-537298a3ab37 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:13.058144 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:13.140598 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68974ab5-122e-4c17-a34f-537298a3ab37 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:13.158237 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6be7a-cc90-42e8-ab36-c7c8972827f8 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:13.203882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:13.207624 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6f74a-1f6b-437f-b16b-171d33fce241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:13.209556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6f74a-1f6b-437f-b16b-171d33fce241 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:13.210442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd756275-5f59-40d5-8c82-b42ca68076c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:13.212083 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd756275-5f59-40d5-8c82-b42ca68076c9 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:13.212669 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6f74a-1f6b-437f-b16b-171d33fce241 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:13.213120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6f74a-1f6b-437f-b16b-171d33fce241 None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:13.214428 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd756275-5f59-40d5-8c82-b42ca68076c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:13.215351 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6f74a-1f6b-437f-b16b-171d33fce241 None admin] RBAC: Authorizing `identity:get_project(project_id=df7e1b99ff17461db446a994311e1f0f)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:13.215848 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd756275-5f59-40d5-8c82-b42ca68076c9 None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:13.218344 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6f74a-1f6b-437f-b16b-171d33fce241 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:13.219406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd756275-5f59-40d5-8c82-b42ca68076c9 None admin] RBAC: Authorizing `identity:get_project(project_id=954de20b90ec45ea91ae6997825c8772)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:13.221098 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd756275-5f59-40d5-8c82-b42ca68076c9 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:13.223296 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 103/205] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:13 2022] GET /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:13.225664 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 103/206] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:12 2022] GET /identity/v3/projects/954de20b90ec45ea91ae6997825c8772 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:13.238524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd756275-5f59-40d5-8c82-b42ca68076c9 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:13.238691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6f74a-1f6b-437f-b16b-171d33fce241 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:13.353452 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd756275-5f59-40d5-8c82-b42ca68076c9 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:13.394834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ba0ff-fe8e-412e-bfb5-df60bea84be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:13.396211 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ba0ff-fe8e-412e-bfb5-df60bea84be8 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:13.396668 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ba0ff-fe8e-412e-bfb5-df60bea84be8 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:13.397113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ba0ff-fe8e-412e-bfb5-df60bea84be8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:13.398155 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ba0ff-fe8e-412e-bfb5-df60bea84be8 None admin] RBAC: Adding query filter params (role.id=e6b3c27ed485430a88f59247935bfa08, scope.project.id=954de20b90ec45ea91ae6997825c8772, user.id=c68ddf97f0744dfda3469738db82c6e9) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:13.398638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ba0ff-fe8e-412e-bfb5-df60bea84be8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:13.400915 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ba0ff-fe8e-412e-bfb5-df60bea84be8 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:13.407690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 104/207] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:39:13 2022] GET /identity/v3/role_assignments?user.id=c68ddf97f0744dfda3469738db82c6e9&scope.project.id=954de20b90ec45ea91ae6997825c8772&role.id=e6b3c27ed485430a88f59247935bfa08 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:13.482740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:13.488516 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6f74a-1f6b-437f-b16b-171d33fce241 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:13.538647 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f7fe5-5654-4f37-973a-79d9bb8014d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:13.540183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f7fe5-5654-4f37-973a-79d9bb8014d9 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:13.540648 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f7fe5-5654-4f37-973a-79d9bb8014d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:13.541147 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f7fe5-5654-4f37-973a-79d9bb8014d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:13.542243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f7fe5-5654-4f37-973a-79d9bb8014d9 None admin] RBAC: Adding query filter params (role.id=37940959ca5f49c3af8aa8cc5097b00b, scope.project.id=df7e1b99ff17461db446a994311e1f0f, user.id=205fcb900df643b0ae60488a80feb902) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:13.542745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f7fe5-5654-4f37-973a-79d9bb8014d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:13.544412 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f7fe5-5654-4f37-973a-79d9bb8014d9 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:13.551644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 104/208] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:39:13 2022] GET /identity/v3/role_assignments?user.id=205fcb900df643b0ae60488a80feb902&scope.project.id=df7e1b99ff17461db446a994311e1f0f&role.id=37940959ca5f49c3af8aa8cc5097b00b => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:14.380420 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de1bc2-ca41-4470-8135-585ed5e583ef None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:14.381003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de1bc2-ca41-4470-8135-585ed5e583ef None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:14.381487 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de1bc2-ca41-4470-8135-585ed5e583ef None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:14.383025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 105/209] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:14.388666 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d303713-0073-48a8-814f-febbfb7884f2 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:14.389567 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d303713-0073-48a8-814f-febbfb7884f2 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:14.390050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d303713-0073-48a8-814f-febbfb7884f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:14.407320 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-5d303713-0073-48a8-814f-febbfb7884f2 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:14.408810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-5d303713-0073-48a8-814f-febbfb7884f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:14.470501 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db5461-717a-4cc7-8167-7b952a615c06 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:14.471611 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db5461-717a-4cc7-8167-7b952a615c06 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:14.472101 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db5461-717a-4cc7-8167-7b952a615c06 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:14.474429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 106/210] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:39:14.480783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f66d13-7844-4ec1-8eb5-f4aaaa209ee2 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:14.481322 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f66d13-7844-4ec1-8eb5-f4aaaa209ee2 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:14.481812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f66d13-7844-4ec1-8eb5-f4aaaa209ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:14.483518 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 105/211] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:14.501025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-91f66d13-7844-4ec1-8eb5-f4aaaa209ee2 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:14.502610 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-91f66d13-7844-4ec1-8eb5-f4aaaa209ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:14.507697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d303713-0073-48a8-814f-febbfb7884f2 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:14.576265 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:14.589346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 107/212] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:39:14.606411 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:14.610866 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f66d13-7844-4ec1-8eb5-f4aaaa209ee2 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:14.616842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d303713-0073-48a8-814f-febbfb7884f2 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:14.654909 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d6498-4c25-47cf-af6a-f3794906fbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:14.655674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d6498-4c25-47cf-af6a-f3794906fbe4 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:14.655956 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d6498-4c25-47cf-af6a-f3794906fbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:14.656279 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d6498-4c25-47cf-af6a-f3794906fbe4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:14.657572 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d6498-4c25-47cf-af6a-f3794906fbe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:14.659131 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d6498-4c25-47cf-af6a-f3794906fbe4 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:14.660732 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 106/213] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:14.666895 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d6498-4c25-47cf-af6a-f3794906fbe4 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:14.722612 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f66d13-7844-4ec1-8eb5-f4aaaa209ee2 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:14.762696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9ef29-cefd-47dd-aafb-770368a4fa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:14.763855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9ef29-cefd-47dd-aafb-770368a4fa06 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:14.764330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9ef29-cefd-47dd-aafb-770368a4fa06 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:14.764797 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9ef29-cefd-47dd-aafb-770368a4fa06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:14.776160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9ef29-cefd-47dd-aafb-770368a4fa06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:14.784228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-c5c9ef29-cefd-47dd-aafb-770368a4fa06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:14.784228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:14.784228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:14.784228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:14.784228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:14.784228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:14.784228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:14.784228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:14.784228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:14.784228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:14.784228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:14.784228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:14.784228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:14.784228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:14.784228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:14.784228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:14.785120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:14.785120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:14.785120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:14.785120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:14.785120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:14.785120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:14.785120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:14.785120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:14.785120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:14.785120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:14.785120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:14.785120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:14.785120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:14.785120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:14.785120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:14.785120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:14.785943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:14.785943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:14.785943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:14.785943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:14.785943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:14.785943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:14.785943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:14.785943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:14.785943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:14.785943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:14.785943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:14.785943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:14.786536 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d6498-4c25-47cf-af6a-f3794906fbe4 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:14.793898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 108/214] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:14.795000 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9ef29-cefd-47dd-aafb-770368a4fa06 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:14.822831 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42537c-c436-48dd-9d87-0a45d637290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:14.823643 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42537c-c436-48dd-9d87-0a45d637290f None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:14.823928 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42537c-c436-48dd-9d87-0a45d637290f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:14.824203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42537c-c436-48dd-9d87-0a45d637290f None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:14.825062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42537c-c436-48dd-9d87-0a45d637290f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:14.826628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42537c-c436-48dd-9d87-0a45d637290f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:14.858024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:14.858220 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 107/215] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 13:39:14 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:39:14.909216 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9ef29-cefd-47dd-aafb-770368a4fa06 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:14.948873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44698dd4-6e57-4526-a5f9-7e49b3188c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:14.949979 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44698dd4-6e57-4526-a5f9-7e49b3188c91 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:14.950461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44698dd4-6e57-4526-a5f9-7e49b3188c91 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:14.951011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44698dd4-6e57-4526-a5f9-7e49b3188c91 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:14.952087 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44698dd4-6e57-4526-a5f9-7e49b3188c91 None admin] RBAC: Adding query filter params (name=member) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:14.952598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44698dd4-6e57-4526-a5f9-7e49b3188c91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:14.954350 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44698dd4-6e57-4526-a5f9-7e49b3188c91 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:14.969591 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 109/216] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:14.971473 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42537c-c436-48dd-9d87-0a45d637290f None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:14.989149 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:15.081690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42537c-c436-48dd-9d87-0a45d637290f None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:15.117018 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1904a1d-58fc-476a-85b1-263d91e8cf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:15.118510 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1904a1d-58fc-476a-85b1-263d91e8cf6a None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:15.118791 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1904a1d-58fc-476a-85b1-263d91e8cf6a None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:15.119064 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1904a1d-58fc-476a-85b1-263d91e8cf6a None admin] PATH_INFO: `/v3/users/c404a4c5d433425aa415a695663a0b4c` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:15.134000 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1904a1d-58fc-476a-85b1-263d91e8cf6a None admin] RBAC: Authorizing `identity:get_user(user_id=c404a4c5d433425aa415a695663a0b4c)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:15.135759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1904a1d-58fc-476a-85b1-263d91e8cf6a None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:15.137988 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 108/217] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:14 2022] GET /identity/v3/users/c404a4c5d433425aa415a695663a0b4c => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:15.143597 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44698dd4-6e57-4526-a5f9-7e49b3188c91 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:15.258236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44698dd4-6e57-4526-a5f9-7e49b3188c91 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:15.276303 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:15.297153 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482c99e-61a9-4d01-8ec8-51fc7249dbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:15.297849 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482c99e-61a9-4d01-8ec8-51fc7249dbd9 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:15.298134 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482c99e-61a9-4d01-8ec8-51fc7249dbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:15.298412 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482c99e-61a9-4d01-8ec8-51fc7249dbd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:15.377335 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482c99e-61a9-4d01-8ec8-51fc7249dbd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:15.379116 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482c99e-61a9-4d01-8ec8-51fc7249dbd9 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:15.484227 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 110/218] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:15.491163 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1904a1d-58fc-476a-85b1-263d91e8cf6a None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:15.523744 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19492c-9b82-4a2f-8a23-0586e848cd3b None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:15.524866 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19492c-9b82-4a2f-8a23-0586e848cd3b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:15.525526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19492c-9b82-4a2f-8a23-0586e848cd3b None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:15.527372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 111/219] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:15.533756 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66de105-e127-43ed-8198-8edaebfaea9f None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:15.534473 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66de105-e127-43ed-8198-8edaebfaea9f None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:15.535054 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66de105-e127-43ed-8198-8edaebfaea9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:15.554162 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-e66de105-e127-43ed-8198-8edaebfaea9f None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:15.555712 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e66de105-e127-43ed-8198-8edaebfaea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:15.568908 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:15.655688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:15.684304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1904a1d-58fc-476a-85b1-263d91e8cf6a None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:15.714961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 112/220] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:15.725605 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7ae79-50d3-4f21-859c-010431290960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:15.726867 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7ae79-50d3-4f21-859c-010431290960 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:15.727909 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7ae79-50d3-4f21-859c-010431290960 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:15.728376 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7ae79-50d3-4f21-859c-010431290960 None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:15.729891 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7ae79-50d3-4f21-859c-010431290960 None admin] RBAC: Authorizing `identity:get_project(project_id=954de20b90ec45ea91ae6997825c8772)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:15.731639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7ae79-50d3-4f21-859c-010431290960 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:15.733953 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 109/221] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:15 2022] GET /identity/v3/projects/954de20b90ec45ea91ae6997825c8772 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:15.740010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66de105-e127-43ed-8198-8edaebfaea9f None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:15.749603 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7ae79-50d3-4f21-859c-010431290960 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:15.919205 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66de105-e127-43ed-8198-8edaebfaea9f None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:15.927650 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7ae79-50d3-4f21-859c-010431290960 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:15.955620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18904c84-0dc7-4355-8958-bbe5d8f18316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:15.956517 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18904c84-0dc7-4355-8958-bbe5d8f18316 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:15.956628 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18904c84-0dc7-4355-8958-bbe5d8f18316 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:15.956820 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18904c84-0dc7-4355-8958-bbe5d8f18316 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:15.957696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18904c84-0dc7-4355-8958-bbe5d8f18316 None admin] RBAC: Adding query filter params (role.id=c7b1597b56ba4b88a4e6ac7689dc83fc, scope.project.id=954de20b90ec45ea91ae6997825c8772, user.id=c404a4c5d433425aa415a695663a0b4c) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:15.958007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18904c84-0dc7-4355-8958-bbe5d8f18316 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:15.959440 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18904c84-0dc7-4355-8958-bbe5d8f18316 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:15.965638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 113/222] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:39:15 2022] GET /identity/v3/role_assignments?user.id=c404a4c5d433425aa415a695663a0b4c&scope.project.id=954de20b90ec45ea91ae6997825c8772&role.id=c7b1597b56ba4b88a4e6ac7689dc83fc => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:15.967004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1266a-7cba-45d1-b40e-c036e6becdf3 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:15.967289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1266a-7cba-45d1-b40e-c036e6becdf3 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:15.967564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1266a-7cba-45d1-b40e-c036e6becdf3 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:15.973386 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 114/223] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:15.974722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0afba3-ffd3-499c-8a61-0a71f18da99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:15.975168 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1f36d-4a6a-45a7-a9ef-49f0353c998f None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:15.975561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1f36d-4a6a-45a7-a9ef-49f0353c998f None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:15.975941 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1f36d-4a6a-45a7-a9ef-49f0353c998f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:15.976183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0afba3-ffd3-499c-8a61-0a71f18da99b None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:15.976606 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0afba3-ffd3-499c-8a61-0a71f18da99b None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:15.977591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0afba3-ffd3-499c-8a61-0a71f18da99b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:15.988579 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:15.994006 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0afba3-ffd3-499c-8a61-0a71f18da99b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:15.999268 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-6cd1f36d-4a6a-45a7-a9ef-49f0353c998f None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:16.000787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-6cd1f36d-4a6a-45a7-a9ef-49f0353c998f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:16.003209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-7c0afba3-ffd3-499c-8a61-0a71f18da99b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:39:16.003209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:16.003209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:16.003209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:16.003209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:16.003209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:16.003209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:16.003209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:16.003209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:16.003209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:16.003209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:16.003209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:16.003209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:16.003209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:16.003209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:16.003209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:16.004290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:16.004290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:16.004290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:16.004290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:16.004290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:16.004290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:16.004290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:16.004290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:16.004290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:16.004290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:16.004290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:16.004290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:16.004290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:16.004290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:16.004290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:16.004290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:16.005309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:16.005309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:16.005309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:16.005309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:16.005309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:16.005309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:16.005309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:16.005309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:16.005309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:16.005309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:16.005309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:39:16.005309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:16.008769 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:16.010666 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 110/224] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:39:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:39:16.019281 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0afba3-ffd3-499c-8a61-0a71f18da99b None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:16.158894 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 115/225] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:16.192117 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1f36d-4a6a-45a7-a9ef-49f0353c998f None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:16.206923 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0afba3-ffd3-499c-8a61-0a71f18da99b None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:16.249107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4713f-0b19-4157-ab62-3ad68dd4b5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:16.250355 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4713f-0b19-4157-ab62-3ad68dd4b5ee None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:16.250851 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4713f-0b19-4157-ab62-3ad68dd4b5ee None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:16.251511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4713f-0b19-4157-ab62-3ad68dd4b5ee None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:16.252643 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4713f-0b19-4157-ab62-3ad68dd4b5ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:16.253172 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4713f-0b19-4157-ab62-3ad68dd4b5ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:16.254928 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4713f-0b19-4157-ab62-3ad68dd4b5ee None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:16.270826 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 111/226] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:16.277122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4713f-0b19-4157-ab62-3ad68dd4b5ee None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:16.295014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1f36d-4a6a-45a7-a9ef-49f0353c998f None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:16.329496 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00a83e-be7e-458a-b4d3-73335b3e5da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:16.330856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00a83e-be7e-458a-b4d3-73335b3e5da7 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:16.330979 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00a83e-be7e-458a-b4d3-73335b3e5da7 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:16.331371 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00a83e-be7e-458a-b4d3-73335b3e5da7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:16.341185 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:16.346490 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00a83e-be7e-458a-b4d3-73335b3e5da7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:16.364008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-7d00a83e-be7e-458a-b4d3-73335b3e5da7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:16.364008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:16.364008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:16.364008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:16.364008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:16.364008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:16.364008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:16.364008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:16.364008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:16.364008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:16.364008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:16.364008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:16.364008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:16.364008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:16.364008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:16.364008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:16.364983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:16.364983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:16.364983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:16.364983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:16.364983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:16.364983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:16.364983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:16.364983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:16.364983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:16.364983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:16.364983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:16.364983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:16.364983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:16.364983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:16.364983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:16.364983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:16.365862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:16.365862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:16.365862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:16.365862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:16.365862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:16.365862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:16.365862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:16.365862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:16.365862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:16.365862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:16.365862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:16.365862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:16.367202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 116/227] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:39:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:39:16.374516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00a83e-be7e-458a-b4d3-73335b3e5da7 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:16.385476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:16.434549 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4713f-0b19-4157-ab62-3ad68dd4b5ee None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:16.471340 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a29724-a2c9-4f6a-b546-f810b1156bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:16.472575 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a29724-a2c9-4f6a-b546-f810b1156bf2 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:16.473062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a29724-a2c9-4f6a-b546-f810b1156bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:16.474418 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a29724-a2c9-4f6a-b546-f810b1156bf2 None admin] PATH_INFO: `/v3/users/c68ddf97f0744dfda3469738db82c6e9` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:16.480097 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a29724-a2c9-4f6a-b546-f810b1156bf2 None admin] RBAC: Authorizing `identity:get_user(user_id=c68ddf97f0744dfda3469738db82c6e9)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:16.483580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a29724-a2c9-4f6a-b546-f810b1156bf2 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:16.486654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 112/228] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:16 2022] GET /identity/v3/users/c68ddf97f0744dfda3469738db82c6e9 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:16.494551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a29724-a2c9-4f6a-b546-f810b1156bf2 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:16.593761 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00a83e-be7e-458a-b4d3-73335b3e5da7 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:16.638289 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a29724-a2c9-4f6a-b546-f810b1156bf2 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:16.672863 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:16.682597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be8f09-d073-40fc-9b76-d53938649db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:16.683472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be8f09-d073-40fc-9b76-d53938649db9 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:16.683758 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be8f09-d073-40fc-9b76-d53938649db9 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:16.684036 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be8f09-d073-40fc-9b76-d53938649db9 None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:16.686218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be8f09-d073-40fc-9b76-d53938649db9 None admin] RBAC: Authorizing `identity:get_project(project_id=954de20b90ec45ea91ae6997825c8772)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:16.687693 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be8f09-d073-40fc-9b76-d53938649db9 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:16.688294 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff0d6a-f09f-4d80-89cf-8284d3036fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:16.688970 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff0d6a-f09f-4d80-89cf-8284d3036fb4 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:16.689255 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff0d6a-f09f-4d80-89cf-8284d3036fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:16.689458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 113/229] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:16 2022] GET /identity/v3/projects/954de20b90ec45ea91ae6997825c8772 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:16.690731 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff0d6a-f09f-4d80-89cf-8284d3036fb4 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:16.690731 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff0d6a-f09f-4d80-89cf-8284d3036fb4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:16.690899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff0d6a-f09f-4d80-89cf-8284d3036fb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:16.692261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff0d6a-f09f-4d80-89cf-8284d3036fb4 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:16.696617 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be8f09-d073-40fc-9b76-d53938649db9 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:16.716976 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 117/230] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:39:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:16.722653 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff0d6a-f09f-4d80-89cf-8284d3036fb4 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:16.842128 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:16.882429 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be8f09-d073-40fc-9b76-d53938649db9 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:16.883921 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff0d6a-f09f-4d80-89cf-8284d3036fb4 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:16.925305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd093c-3a27-4081-a1de-05944db03453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:16.925305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd093c-3a27-4081-a1de-05944db03453 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:16.925305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd093c-3a27-4081-a1de-05944db03453 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:16.925305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd093c-3a27-4081-a1de-05944db03453 None admin] PATH_INFO: `/v3/users/c68ddf97f0744dfda3469738db82c6e9` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:16.925702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd093c-3a27-4081-a1de-05944db03453 None admin] RBAC: Authorizing `identity:get_user(user_id=c68ddf97f0744dfda3469738db82c6e9)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:16.925702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd093c-3a27-4081-a1de-05944db03453 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:16.925702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 118/231] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:16 2022] GET /identity/v3/users/c68ddf97f0744dfda3469738db82c6e9 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:16.931793 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd093c-3a27-4081-a1de-05944db03453 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:16.958464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0df8f9-192e-4ab7-9dc4-da6eda0850e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:16.959365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0df8f9-192e-4ab7-9dc4-da6eda0850e2 None admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:16.959644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0df8f9-192e-4ab7-9dc4-da6eda0850e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:16.959918 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0df8f9-192e-4ab7-9dc4-da6eda0850e2 None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772/users/c68ddf97f0744dfda3469738db82c6e9/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:16.963612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0df8f9-192e-4ab7-9dc4-da6eda0850e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=954de20b90ec45ea91ae6997825c8772, user_id=c68ddf97f0744dfda3469738db82c6e9, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:16.967494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0df8f9-192e-4ab7-9dc4-da6eda0850e2 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:17.000627 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 114/232] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:39:16 2022] PUT /identity/v3/projects/954de20b90ec45ea91ae6997825c8772/users/c68ddf97f0744dfda3469738db82c6e9/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:39:17.084242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd093c-3a27-4081-a1de-05944db03453 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:17.131637 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:17.145166 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06324ba6-932c-428f-9266-3438c66b46a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:17.146697 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06324ba6-932c-428f-9266-3438c66b46a3 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:17.146983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06324ba6-932c-428f-9266-3438c66b46a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:17.147260 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06324ba6-932c-428f-9266-3438c66b46a3 None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:17.148612 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06324ba6-932c-428f-9266-3438c66b46a3 None admin] RBAC: Authorizing `identity:get_project(project_id=954de20b90ec45ea91ae6997825c8772)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:17.150143 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06324ba6-932c-428f-9266-3438c66b46a3 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:17.152249 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 119/233] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:16 2022] GET /identity/v3/projects/954de20b90ec45ea91ae6997825c8772 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:17.158393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0df8f9-192e-4ab7-9dc4-da6eda0850e2 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:17.247973 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:17.296313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0df8f9-192e-4ab7-9dc4-da6eda0850e2 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:17.331856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3427cf3-eda1-4d2e-8515-b4805c14a8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:17.332746 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3427cf3-eda1-4d2e-8515-b4805c14a8fa None admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:17.333029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3427cf3-eda1-4d2e-8515-b4805c14a8fa None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:17.333335 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3427cf3-eda1-4d2e-8515-b4805c14a8fa None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772/users/c68ddf97f0744dfda3469738db82c6e9/roles/e6b3c27ed485430a88f59247935bfa08` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:17.335586 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3427cf3-eda1-4d2e-8515-b4805c14a8fa None admin] RBAC: Authorizing `identity:create_grant(project_id=954de20b90ec45ea91ae6997825c8772, user_id=c68ddf97f0744dfda3469738db82c6e9, role_id=e6b3c27ed485430a88f59247935bfa08)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:17.337071 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3427cf3-eda1-4d2e-8515-b4805c14a8fa None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:17.354343 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 115/234] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:39:17 2022] PUT /identity/v3/projects/954de20b90ec45ea91ae6997825c8772/users/c68ddf97f0744dfda3469738db82c6e9/roles/e6b3c27ed485430a88f59247935bfa08 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:39:17.763104 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c02423-f8a4-422e-bd69-289a28261aee None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:17.763603 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c02423-f8a4-422e-bd69-289a28261aee None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:17.763677 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c02423-f8a4-422e-bd69-289a28261aee None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:17.765171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 120/235] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:17.770328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d09e5-3312-4f46-bd38-0f18a8c388a0 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:17.770753 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d09e5-3312-4f46-bd38-0f18a8c388a0 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:17.770926 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d09e5-3312-4f46-bd38-0f18a8c388a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:17.789449 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-581d09e5-3312-4f46-bd38-0f18a8c388a0 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:17.790650 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-581d09e5-3312-4f46-bd38-0f18a8c388a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:17.822137 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244c9bf-4c6e-4564-9d7a-52af41038e24 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:17.822437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244c9bf-4c6e-4564-9d7a-52af41038e24 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:17.822693 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244c9bf-4c6e-4564-9d7a-52af41038e24 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:17.824051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 121/236] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:39:17.830804 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204a946-c226-4521-9480-80bf285e6a5a None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:17.831085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204a946-c226-4521-9480-80bf285e6a5a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:17.831363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204a946-c226-4521-9480-80bf285e6a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:17.866262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-0204a946-c226-4521-9480-80bf285e6a5a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:17.867979 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0204a946-c226-4521-9480-80bf285e6a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:17.870118 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 116/237] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:17.912029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d09e5-3312-4f46-bd38-0f18a8c388a0 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:17.976526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 122/238] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:18.004224 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204a946-c226-4521-9480-80bf285e6a5a None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:18.013616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:18.096754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d09e5-3312-4f46-bd38-0f18a8c388a0 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:18.133909 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3ce37-d24a-4085-b7c0-0cdfb4196a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:18.134700 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3ce37-d24a-4085-b7c0-0cdfb4196a91 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:18.134976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3ce37-d24a-4085-b7c0-0cdfb4196a91 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:18.135246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3ce37-d24a-4085-b7c0-0cdfb4196a91 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:18.158125 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3ce37-d24a-4085-b7c0-0cdfb4196a91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:18.167255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-bed3ce37-d24a-4085-b7c0-0cdfb4196a91 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 13:39:18.167255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:18.167255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:18.167255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:18.167255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:18.167255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:18.167255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:18.167255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:18.167255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:18.167255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:18.167255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:18.167255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:18.167255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:18.167255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:18.167255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:18.167255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:18.168152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:18.168152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:18.168152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:18.168152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:18.168152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:18.168152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:18.168152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:18.168152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:18.168152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:18.168152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:18.168152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:18.168152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:18.168152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:18.168152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:18.168152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:18.168152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:18.169433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:18.169433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:18.169433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:18.169433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:18.169433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:18.169433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:18.169433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:18.169433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:18.169433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:18.169433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:18.169433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 13:39:18.169433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:18.169433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 117/239] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:18.182025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3ce37-d24a-4085-b7c0-0cdfb4196a91 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:18.203407 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204a946-c226-4521-9480-80bf285e6a5a None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:18.282271 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:18.285556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3ce37-d24a-4085-b7c0-0cdfb4196a91 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:18.302891 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d908869-1fea-46d6-b284-206c63b5192b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:18.303484 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:18.303717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d908869-1fea-46d6-b284-206c63b5192b None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:18.304003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d908869-1fea-46d6-b284-206c63b5192b None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:18.304277 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d908869-1fea-46d6-b284-206c63b5192b None admin] PATH_INFO: `/v3/domains/default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:18.306079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d908869-1fea-46d6-b284-206c63b5192b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:18.307578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d908869-1fea-46d6-b284-206c63b5192b None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:18.317391 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 123/240] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:18.318262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d908869-1fea-46d6-b284-206c63b5192b None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:18.325893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125fd69-966e-4e4b-8edb-1a74d89881f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:18.337261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125fd69-966e-4e4b-8edb-1a74d89881f0 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:18.337578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125fd69-966e-4e4b-8edb-1a74d89881f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:18.337855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125fd69-966e-4e4b-8edb-1a74d89881f0 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:18.338624 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125fd69-966e-4e4b-8edb-1a74d89881f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:18.338931 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125fd69-966e-4e4b-8edb-1a74d89881f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:18.340447 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125fd69-966e-4e4b-8edb-1a74d89881f0 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:18.350212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 118/241] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:18.355965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125fd69-966e-4e4b-8edb-1a74d89881f0 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:18.507426 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d908869-1fea-46d6-b284-206c63b5192b None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:18.577650 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125fd69-966e-4e4b-8edb-1a74d89881f0 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:18.580942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf63caf-eadf-41ce-a951-73983da3c564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:18.581661 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf63caf-eadf-41ce-a951-73983da3c564 None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:18.581944 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf63caf-eadf-41ce-a951-73983da3c564 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:18.582226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf63caf-eadf-41ce-a951-73983da3c564 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:18.582948 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf63caf-eadf-41ce-a951-73983da3c564 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:18.584410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf63caf-eadf-41ce-a951-73983da3c564 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:18.615035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f9daa-0ecb-409d-8efd-df66bb4da7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:18.616006 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f9daa-0ecb-409d-8efd-df66bb4da7ed None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:18.616328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f9daa-0ecb-409d-8efd-df66bb4da7ed None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:18.616606 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f9daa-0ecb-409d-8efd-df66bb4da7ed None admin] PATH_INFO: `/v3/users/5f7c5cea952d43f38ff0c14bc4237be5` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:18.621329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 124/242] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 13:39:18 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:39:18.623156 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424edea9-88cc-40c0-a2a5-82ea3d18ea39 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:18.623639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424edea9-88cc-40c0-a2a5-82ea3d18ea39 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:18.624128 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424edea9-88cc-40c0-a2a5-82ea3d18ea39 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:18.629445 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 125/243] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:18.632107 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabddd77-97d8-4ef5-8a78-522dd8ee36de None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:18.632401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabddd77-97d8-4ef5-8a78-522dd8ee36de None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:18.632687 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabddd77-97d8-4ef5-8a78-522dd8ee36de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:18.646246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f9daa-0ecb-409d-8efd-df66bb4da7ed None admin] RBAC: Authorizing `identity:get_user(user_id=5f7c5cea952d43f38ff0c14bc4237be5)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:18.648035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f9daa-0ecb-409d-8efd-df66bb4da7ed None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:18.650403 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 119/244] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:18 2022] GET /identity/v3/users/5f7c5cea952d43f38ff0c14bc4237be5 => generated 297 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:18.657001 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f9daa-0ecb-409d-8efd-df66bb4da7ed None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:18.658627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-fabddd77-97d8-4ef5-8a78-522dd8ee36de None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:18.659869 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-fabddd77-97d8-4ef5-8a78-522dd8ee36de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:18.714162 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:18.717298 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:18.739039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 126/245] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:18.763578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabddd77-97d8-4ef5-8a78-522dd8ee36de None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:18.841250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f9daa-0ecb-409d-8efd-df66bb4da7ed None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:18.878533 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc1fcd-9e02-480f-87f1-9bb3077d0f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:18.879178 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc1fcd-9e02-480f-87f1-9bb3077d0f0d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:18.879328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabddd77-97d8-4ef5-8a78-522dd8ee36de None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:18.879738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc1fcd-9e02-480f-87f1-9bb3077d0f0d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:18.880157 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc1fcd-9e02-480f-87f1-9bb3077d0f0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:18.917642 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a514e-1e62-4510-88aa-8b4882f3c626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:18.918468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a514e-1e62-4510-88aa-8b4882f3c626 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:18.918748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a514e-1e62-4510-88aa-8b4882f3c626 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:18.919023 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a514e-1e62-4510-88aa-8b4882f3c626 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:18.932199 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a514e-1e62-4510-88aa-8b4882f3c626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:18.940837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-9c4a514e-1e62-4510-88aa-8b4882f3c626 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:18.940837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:18.940837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:18.940837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:18.940837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:18.940837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:18.940837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:18.940837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:18.940837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:18.940837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:18.940837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:18.940837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:18.940837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:18.940837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:18.940837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:18.940837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:18.941985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:18.941985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:18.941985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:18.941985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:18.941985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:18.941985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:18.941985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:18.941985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:18.941985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:18.941985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:18.941985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:18.941985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:18.941985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:18.941985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:18.941985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:18.941985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:18.943172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:18.943172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:18.943172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:18.943172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:18.943172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:18.943172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:18.943172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:18.943172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:18.943172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:18.943172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:18.943172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:18.943172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:18.945830 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 127/246] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:39:18.951837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a514e-1e62-4510-88aa-8b4882f3c626 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:18.954821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc1fcd-9e02-480f-87f1-9bb3077d0f0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:18.956571 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc1fcd-9e02-480f-87f1-9bb3077d0f0d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:18.985825 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:19.003703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:19.064137 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 120/247] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 13:39:19.070908 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc1fcd-9e02-480f-87f1-9bb3077d0f0d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:19.076308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a514e-1e62-4510-88aa-8b4882f3c626 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:19.121137 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410ed09-cd96-40f1-9180-44c15d8755b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:19.122074 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410ed09-cd96-40f1-9180-44c15d8755b7 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:19.122523 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410ed09-cd96-40f1-9180-44c15d8755b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:19.122942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410ed09-cd96-40f1-9180-44c15d8755b7 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:19.123830 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410ed09-cd96-40f1-9180-44c15d8755b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:19.124288 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410ed09-cd96-40f1-9180-44c15d8755b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:19.127074 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410ed09-cd96-40f1-9180-44c15d8755b7 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:19.139475 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 128/248] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:19.145738 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410ed09-cd96-40f1-9180-44c15d8755b7 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:19.205368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc1fcd-9e02-480f-87f1-9bb3077d0f0d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:19.235305 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:19.244241 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b169242-8a53-4f39-bdc7-0e73b20b0220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:19.245476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b169242-8a53-4f39-bdc7-0e73b20b0220 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:19.245934 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b169242-8a53-4f39-bdc7-0e73b20b0220 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:19.246382 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b169242-8a53-4f39-bdc7-0e73b20b0220 None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:19.247871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b169242-8a53-4f39-bdc7-0e73b20b0220 None admin] RBAC: Authorizing `identity:get_project(project_id=954de20b90ec45ea91ae6997825c8772)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:19.249689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b169242-8a53-4f39-bdc7-0e73b20b0220 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:19.251251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410ed09-cd96-40f1-9180-44c15d8755b7 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:19.252113 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 121/249] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:19 2022] GET /identity/v3/projects/954de20b90ec45ea91ae6997825c8772 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:19.258073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:19.260195 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b169242-8a53-4f39-bdc7-0e73b20b0220 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:19.294250 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b026106-52f6-42a4-83cc-a1f63445afe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:19.295128 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b026106-52f6-42a4-83cc-a1f63445afe7 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:19.295408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b026106-52f6-42a4-83cc-a1f63445afe7 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:19.295684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b026106-52f6-42a4-83cc-a1f63445afe7 None admin] PATH_INFO: `/v3/users/c404a4c5d433425aa415a695663a0b4c` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:19.296864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b026106-52f6-42a4-83cc-a1f63445afe7 None admin] RBAC: Authorizing `identity:get_user(user_id=c404a4c5d433425aa415a695663a0b4c)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:19.298333 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b026106-52f6-42a4-83cc-a1f63445afe7 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:19.300133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 129/250] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:19 2022] GET /identity/v3/users/c404a4c5d433425aa415a695663a0b4c => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:19.305483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b026106-52f6-42a4-83cc-a1f63445afe7 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:19.373778 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b169242-8a53-4f39-bdc7-0e73b20b0220 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:19.411269 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b026106-52f6-42a4-83cc-a1f63445afe7 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:19.412050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d48dd-009a-4edf-ad30-37a22c7897f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:19.413045 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d48dd-009a-4edf-ad30-37a22c7897f9 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:19.413713 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d48dd-009a-4edf-ad30-37a22c7897f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:19.414170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d48dd-009a-4edf-ad30-37a22c7897f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:19.416021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d48dd-009a-4edf-ad30-37a22c7897f9 None admin] RBAC: Adding query filter params (role.id=37940959ca5f49c3af8aa8cc5097b00b, scope.project.id=954de20b90ec45ea91ae6997825c8772, user.id=5f7c5cea952d43f38ff0c14bc4237be5) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:19.416610 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d48dd-009a-4edf-ad30-37a22c7897f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:19.418371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d48dd-009a-4edf-ad30-37a22c7897f9 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:19.424953 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 122/251] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:39:19 2022] GET /identity/v3/role_assignments?user.id=5f7c5cea952d43f38ff0c14bc4237be5&scope.project.id=954de20b90ec45ea91ae6997825c8772&role.id=37940959ca5f49c3af8aa8cc5097b00b => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:19.458748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a0773-ecaf-4350-9c10-4a3b707b67fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:19.459648 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a0773-ecaf-4350-9c10-4a3b707b67fb None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:19.459929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a0773-ecaf-4350-9c10-4a3b707b67fb None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:19.460204 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a0773-ecaf-4350-9c10-4a3b707b67fb None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:19.462952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a0773-ecaf-4350-9c10-4a3b707b67fb None admin] RBAC: Authorizing `identity:get_project(project_id=954de20b90ec45ea91ae6997825c8772)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:19.464479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a0773-ecaf-4350-9c10-4a3b707b67fb None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:19.466634 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 130/252] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:19 2022] GET /identity/v3/projects/954de20b90ec45ea91ae6997825c8772 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:19.472649 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d48dd-009a-4edf-ad30-37a22c7897f9 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:19.554725 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:19.601642 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d48dd-009a-4edf-ad30-37a22c7897f9 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:19.643876 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb3b52-9a15-4bf6-9653-08de02966bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:19.644702 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb3b52-9a15-4bf6-9653-08de02966bd6 None admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:19.644982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb3b52-9a15-4bf6-9653-08de02966bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:19.645254 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb3b52-9a15-4bf6-9653-08de02966bd6 None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772/users/c404a4c5d433425aa415a695663a0b4c/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:19.647294 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb3b52-9a15-4bf6-9653-08de02966bd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=954de20b90ec45ea91ae6997825c8772, user_id=c404a4c5d433425aa415a695663a0b4c, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:19.649362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb3b52-9a15-4bf6-9653-08de02966bd6 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:19.683762 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 123/253] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:39:19 2022] PUT /identity/v3/projects/954de20b90ec45ea91ae6997825c8772/users/c404a4c5d433425aa415a695663a0b4c/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:39:19.706112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cb42e-e169-445c-b3db-d7f63ac6a4e2 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:19.706406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cb42e-e169-445c-b3db-d7f63ac6a4e2 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:19.706669 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cb42e-e169-445c-b3db-d7f63ac6a4e2 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:19.708228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 131/254] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:19.714570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf83d7e-d343-43a6-9aac-5297ffd1b6c2 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:19.715075 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf83d7e-d343-43a6-9aac-5297ffd1b6c2 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:19.715508 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf83d7e-d343-43a6-9aac-5297ffd1b6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:19.736811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-6cf83d7e-d343-43a6-9aac-5297ffd1b6c2 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:19.738059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6cf83d7e-d343-43a6-9aac-5297ffd1b6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:19.830537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 124/255] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:19.871613 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cb42e-e169-445c-b3db-d7f63ac6a4e2 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:19.927383 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:20.002232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cb42e-e169-445c-b3db-d7f63ac6a4e2 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:20.041981 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f3ec2-47aa-4f50-b97c-316a32a17975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:20.042826 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f3ec2-47aa-4f50-b97c-316a32a17975 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:20.043105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f3ec2-47aa-4f50-b97c-316a32a17975 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:20.043379 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f3ec2-47aa-4f50-b97c-316a32a17975 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:20.056898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f3ec2-47aa-4f50-b97c-316a32a17975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:20.064759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-1b2f3ec2-47aa-4f50-b97c-316a32a17975 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:39:20.064759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:20.064759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:20.064759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:20.064759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:20.064759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:20.064759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:20.064759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:20.064759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:20.064759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:20.064759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:20.064759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:20.064759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:20.064759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:20.064759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:20.064759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:20.065700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:20.065700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:20.065700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:20.065700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:20.065700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:20.065700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:20.065700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:20.065700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:20.065700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:20.065700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:20.065700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:20.065700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:20.065700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:20.065700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:20.065700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:20.065700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:20.066918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:20.066918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:20.066918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:20.066918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:20.066918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:20.066918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:20.066918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:20.066918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:20.066918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:20.066918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:20.066918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:39:20.066918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:20.066918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 132/256] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:39:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:20.074107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf83d7e-d343-43a6-9aac-5297ffd1b6c2 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:20.124771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:20.176471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ab771-2cc2-4665-b355-a9f8529a35d9 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:20.176779 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ab771-2cc2-4665-b355-a9f8529a35d9 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:20.177026 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ab771-2cc2-4665-b355-a9f8529a35d9 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:20.178693 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 133/257] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:39:20.184406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfc1ac-6e6d-47cf-af7a-c90af940e88d None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:20.184941 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfc1ac-6e6d-47cf-af7a-c90af940e88d None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:20.185474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfc1ac-6e6d-47cf-af7a-c90af940e88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:20.203148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf83d7e-d343-43a6-9aac-5297ffd1b6c2 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:20.203682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-40dfc1ac-6e6d-47cf-af7a-c90af940e88d None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:20.205395 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-40dfc1ac-6e6d-47cf-af7a-c90af940e88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:20.274544 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293562aa-69ef-44ed-8d25-5ed961f80c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:20.275253 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293562aa-69ef-44ed-8d25-5ed961f80c1d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:20.275536 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293562aa-69ef-44ed-8d25-5ed961f80c1d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:20.275810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293562aa-69ef-44ed-8d25-5ed961f80c1d None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:20.276563 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293562aa-69ef-44ed-8d25-5ed961f80c1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:20.276870 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293562aa-69ef-44ed-8d25-5ed961f80c1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:20.278275 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293562aa-69ef-44ed-8d25-5ed961f80c1d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:20.292276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 134/258] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:39:20.293898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 125/259] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:20.299478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfc1ac-6e6d-47cf-af7a-c90af940e88d None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:20.331819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293562aa-69ef-44ed-8d25-5ed961f80c1d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:20.332551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:20.433403 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfc1ac-6e6d-47cf-af7a-c90af940e88d None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:20.474362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3465f-7050-44df-b42a-01691d46e0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:20.476547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3465f-7050-44df-b42a-01691d46e0a3 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:20.477227 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3465f-7050-44df-b42a-01691d46e0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:20.478953 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3465f-7050-44df-b42a-01691d46e0a3 None admin] PATH_INFO: `/v3/users/c68ddf97f0744dfda3469738db82c6e9` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:20.481156 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3465f-7050-44df-b42a-01691d46e0a3 None admin] RBAC: Authorizing `identity:get_user(user_id=c68ddf97f0744dfda3469738db82c6e9)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:20.482858 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3465f-7050-44df-b42a-01691d46e0a3 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:20.489547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 135/260] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:20 2022] GET /identity/v3/users/c68ddf97f0744dfda3469738db82c6e9 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:20.499645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3465f-7050-44df-b42a-01691d46e0a3 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:20.545191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293562aa-69ef-44ed-8d25-5ed961f80c1d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:20.573632 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:20.606193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13874c4-ff8f-494c-b19d-5d502ca40f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:20.607007 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13874c4-ff8f-494c-b19d-5d502ca40f00 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:20.607288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13874c4-ff8f-494c-b19d-5d502ca40f00 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:20.607562 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13874c4-ff8f-494c-b19d-5d502ca40f00 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:20.632550 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13874c4-ff8f-494c-b19d-5d502ca40f00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:20.641741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-e13874c4-ff8f-494c-b19d-5d502ca40f00 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:20.641741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:20.641741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:20.641741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:20.641741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:20.641741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:20.641741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:20.641741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:20.641741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:20.641741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:20.641741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:20.641741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:20.641741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:20.641741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:20.641741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:20.641741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:20.642728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:20.642728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:20.642728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:20.642728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:20.642728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:20.642728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:20.642728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:20.642728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:20.642728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:20.642728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:20.642728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:20.642728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:20.642728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:20.642728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:20.642728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:20.642728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:20.643541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:20.643541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:20.643541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:20.643541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:20.643541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:20.643541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:20.643541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:20.643541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:20.643541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:20.643541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:20.643541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:20.643541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:20.643541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 126/261] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:39:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:39:20.651813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13874c4-ff8f-494c-b19d-5d502ca40f00 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:20.691354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:20.696340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3465f-7050-44df-b42a-01691d46e0a3 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:20.778423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a375638-6594-45fe-925b-9555571b8603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:20.781161 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a375638-6594-45fe-925b-9555571b8603 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:20.784329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a375638-6594-45fe-925b-9555571b8603 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:20.784847 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a375638-6594-45fe-925b-9555571b8603 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:20.904039 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13874c4-ff8f-494c-b19d-5d502ca40f00 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:20.933616 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a375638-6594-45fe-925b-9555571b8603 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:20.935093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a375638-6594-45fe-925b-9555571b8603 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:20.985639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445b5d6-952f-4f3e-90fb-c0876ae4b155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:20.986868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445b5d6-952f-4f3e-90fb-c0876ae4b155 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:20.987365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445b5d6-952f-4f3e-90fb-c0876ae4b155 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:20.987850 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445b5d6-952f-4f3e-90fb-c0876ae4b155 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:20.988874 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445b5d6-952f-4f3e-90fb-c0876ae4b155 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:20.989432 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445b5d6-952f-4f3e-90fb-c0876ae4b155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:20.991094 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445b5d6-952f-4f3e-90fb-c0876ae4b155 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:21.009815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 127/262] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:39:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:21.015597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445b5d6-952f-4f3e-90fb-c0876ae4b155 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:21.060311 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:21.066716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 136/263] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 13:39:21.078111 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a375638-6594-45fe-925b-9555571b8603 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:21.089431 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:21.195380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a375638-6594-45fe-925b-9555571b8603 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:21.230871 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88727ffe-8fcd-42a8-9c9d-b3e59431aa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:21.231963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88727ffe-8fcd-42a8-9c9d-b3e59431aa4f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:21.232393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88727ffe-8fcd-42a8-9c9d-b3e59431aa4f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:21.232844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88727ffe-8fcd-42a8-9c9d-b3e59431aa4f None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:21.234182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88727ffe-8fcd-42a8-9c9d-b3e59431aa4f None admin] RBAC: Authorizing `identity:get_project(project_id=954de20b90ec45ea91ae6997825c8772)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:21.235921 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88727ffe-8fcd-42a8-9c9d-b3e59431aa4f None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:21.237815 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 137/264] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:21 2022] GET /identity/v3/projects/954de20b90ec45ea91ae6997825c8772 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:21.239759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445b5d6-952f-4f3e-90fb-c0876ae4b155 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:21.244886 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88727ffe-8fcd-42a8-9c9d-b3e59431aa4f None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:21.302937 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3b7ff-1d2d-4aca-a251-f8b627a27539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:21.303813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3b7ff-1d2d-4aca-a251-f8b627a27539 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:21.304096 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3b7ff-1d2d-4aca-a251-f8b627a27539 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:21.304373 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3b7ff-1d2d-4aca-a251-f8b627a27539 None admin] PATH_INFO: `/v3/users/c68ddf97f0744dfda3469738db82c6e9` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:21.311059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3b7ff-1d2d-4aca-a251-f8b627a27539 None admin] RBAC: Authorizing `identity:get_user(user_id=c68ddf97f0744dfda3469738db82c6e9)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:21.312589 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3b7ff-1d2d-4aca-a251-f8b627a27539 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:21.314259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 128/265] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:21 2022] GET /identity/v3/users/c68ddf97f0744dfda3469738db82c6e9 => generated 283 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:21.320004 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3b7ff-1d2d-4aca-a251-f8b627a27539 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:21.339024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:21.416891 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88727ffe-8fcd-42a8-9c9d-b3e59431aa4f None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:21.518084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fff03-5d89-4acc-baae-d4b587f046d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:21.518675 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fff03-5d89-4acc-baae-d4b587f046d4 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:21.518964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fff03-5d89-4acc-baae-d4b587f046d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:21.519242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fff03-5d89-4acc-baae-d4b587f046d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:21.520088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fff03-5d89-4acc-baae-d4b587f046d4 None admin] RBAC: Adding query filter params (role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.project.id=954de20b90ec45ea91ae6997825c8772, user.id=c68ddf97f0744dfda3469738db82c6e9) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:21.520397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fff03-5d89-4acc-baae-d4b587f046d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:21.521866 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fff03-5d89-4acc-baae-d4b587f046d4 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:21.524810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3b7ff-1d2d-4aca-a251-f8b627a27539 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:21.527188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:21.531847 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 138/266] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:39:21 2022] GET /identity/v3/role_assignments?user.id=c68ddf97f0744dfda3469738db82c6e9&scope.project.id=954de20b90ec45ea91ae6997825c8772&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:21.595295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d5f58-d6e0-4da9-bdec-6db9bbdb2c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:21.595973 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d5f58-d6e0-4da9-bdec-6db9bbdb2c86 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:21.596257 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d5f58-d6e0-4da9-bdec-6db9bbdb2c86 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:21.596594 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d5f58-d6e0-4da9-bdec-6db9bbdb2c86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:21.719596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d5f58-d6e0-4da9-bdec-6db9bbdb2c86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:21.721094 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d5f58-d6e0-4da9-bdec-6db9bbdb2c86 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:21.859482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 129/267] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:21.865104 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fff03-5d89-4acc-baae-d4b587f046d4 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:22.008923 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fff03-5d89-4acc-baae-d4b587f046d4 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:22.042361 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:22.051250 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488ad81-c0e2-4327-aa2a-538bafe6a598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:22.052127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488ad81-c0e2-4327-aa2a-538bafe6a598 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:22.052409 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488ad81-c0e2-4327-aa2a-538bafe6a598 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:22.052687 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488ad81-c0e2-4327-aa2a-538bafe6a598 None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:22.053911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488ad81-c0e2-4327-aa2a-538bafe6a598 None admin] RBAC: Authorizing `identity:get_project(project_id=954de20b90ec45ea91ae6997825c8772)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:22.055985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488ad81-c0e2-4327-aa2a-538bafe6a598 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:22.059821 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 139/268] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:21 2022] GET /identity/v3/projects/954de20b90ec45ea91ae6997825c8772 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:22.067241 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d5f58-d6e0-4da9-bdec-6db9bbdb2c86 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:22.067502 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:22.228799 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d5f58-d6e0-4da9-bdec-6db9bbdb2c86 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:22.279845 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9083e2-6db1-4498-928f-206a3c14b789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:22.280865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9083e2-6db1-4498-928f-206a3c14b789 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:22.281383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9083e2-6db1-4498-928f-206a3c14b789 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:22.281884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9083e2-6db1-4498-928f-206a3c14b789 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:22.282924 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9083e2-6db1-4498-928f-206a3c14b789 None admin] RBAC: Adding query filter params (role.id=e6b3c27ed485430a88f59247935bfa08, scope.project.id=954de20b90ec45ea91ae6997825c8772, user.id=c68ddf97f0744dfda3469738db82c6e9) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:22.283436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9083e2-6db1-4498-928f-206a3c14b789 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:22.285084 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9083e2-6db1-4498-928f-206a3c14b789 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:22.292502 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 130/269] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:39:22 2022] GET /identity/v3/role_assignments?user.id=c68ddf97f0744dfda3469738db82c6e9&scope.project.id=954de20b90ec45ea91ae6997825c8772&role.id=e6b3c27ed485430a88f59247935bfa08 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:22.479751 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d534846-d81f-465f-b418-7815d4b95463 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:22.479940 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d534846-d81f-465f-b418-7815d4b95463 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:22.480225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d534846-d81f-465f-b418-7815d4b95463 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:22.481688 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 140/270] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:22.487552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43147f4c-ad82-4921-b7f1-7ca3cea91020 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:22.488168 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43147f4c-ad82-4921-b7f1-7ca3cea91020 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:22.488644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43147f4c-ad82-4921-b7f1-7ca3cea91020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:22.514506 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-43147f4c-ad82-4921-b7f1-7ca3cea91020 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:22.516055 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-43147f4c-ad82-4921-b7f1-7ca3cea91020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:22.579724 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:22.593640 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 131/271] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:22.611447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d534846-d81f-465f-b418-7815d4b95463 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:22.725023 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d534846-d81f-465f-b418-7815d4b95463 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:22.740831 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f217f-f9e4-4177-9593-ee4bf58c2eaa None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:22.741119 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f217f-f9e4-4177-9593-ee4bf58c2eaa None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:22.741358 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f217f-f9e4-4177-9593-ee4bf58c2eaa None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:22.746595 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 132/272] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:39:22.748360 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940bd34-9364-42a8-b1b7-4a05d8f88113 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:22.748655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940bd34-9364-42a8-b1b7-4a05d8f88113 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:22.748939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940bd34-9364-42a8-b1b7-4a05d8f88113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:22.776604 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-3940bd34-9364-42a8-b1b7-4a05d8f88113 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:22.778558 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-3940bd34-9364-42a8-b1b7-4a05d8f88113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:22.779112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef69f7d-d595-4a3d-b978-459313917edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:22.780033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef69f7d-d595-4a3d-b978-459313917edf None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:22.780416 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef69f7d-d595-4a3d-b978-459313917edf None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:22.780788 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef69f7d-d595-4a3d-b978-459313917edf None admin] PATH_INFO: `/v3/roles/member` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:22.793099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef69f7d-d595-4a3d-b978-459313917edf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:22.801533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-4ef69f7d-d595-4a3d-b978-459313917edf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:22.801533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:22.801533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:22.801533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:22.801533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:22.801533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:22.801533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:22.801533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:22.801533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:22.801533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:22.801533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:22.801533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:22.801533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:22.801533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:22.801533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:22.801533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:22.802477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:22.802477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:22.802477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:22.802477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:22.802477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:22.802477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:22.802477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:22.802477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:22.802477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:22.802477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:22.802477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:22.802477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:22.802477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:22.802477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:22.802477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:22.802477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:22.803299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:22.803299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:22.803299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:22.803299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:22.803299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:22.803299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:22.803299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:22.803299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:22.803299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:22.803299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:22.803299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:22.803299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:22.808035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 141/273] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:22.811880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef69f7d-d595-4a3d-b978-459313917edf None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:22.885937 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:22.897359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 133/274] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:39:22.920683 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940bd34-9364-42a8-b1b7-4a05d8f88113 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:22.947190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef69f7d-d595-4a3d-b978-459313917edf None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:22.985618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50253f-4400-4164-9e7a-ec40850620a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:22.986278 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50253f-4400-4164-9e7a-ec40850620a3 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:22.986560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50253f-4400-4164-9e7a-ec40850620a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:22.986830 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50253f-4400-4164-9e7a-ec40850620a3 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:22.987718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50253f-4400-4164-9e7a-ec40850620a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:22.988028 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50253f-4400-4164-9e7a-ec40850620a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:22.989391 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50253f-4400-4164-9e7a-ec40850620a3 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:22.998687 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 142/275] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:22.999547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6d65c-210e-46aa-8cbd-86f57fe093f1 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:22.999838 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6d65c-210e-46aa-8cbd-86f57fe093f1 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:23.000112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6d65c-210e-46aa-8cbd-86f57fe093f1 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:23.001351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 143/276] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:23.002397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016493e-cdbf-4c5f-917f-dd40d74f0361 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:23.002681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016493e-cdbf-4c5f-917f-dd40d74f0361 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:23.003009 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016493e-cdbf-4c5f-917f-dd40d74f0361 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:23.004151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 144/277] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:23.005029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016493e-cdbf-4c5f-917f-dd40d74f0361 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:23.034622 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940bd34-9364-42a8-b1b7-4a05d8f88113 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:23.060124 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:23.069081 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dfeea-90f9-4665-92cc-1a16744d7624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:23.069997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dfeea-90f9-4665-92cc-1a16744d7624 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:23.070341 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dfeea-90f9-4665-92cc-1a16744d7624 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:23.071135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dfeea-90f9-4665-92cc-1a16744d7624 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:23.081018 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10dfeea-90f9-4665-92cc-1a16744d7624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:23.088735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-d10dfeea-90f9-4665-92cc-1a16744d7624 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 13:39:23.088735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:23.088735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:23.088735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:23.088735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:23.088735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:23.088735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:23.088735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:23.088735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:23.088735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:23.088735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:23.088735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:23.088735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:23.088735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:23.088735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:23.088735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:23.089830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:23.089830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:23.089830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:23.089830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:23.089830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:23.089830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:23.089830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:23.089830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:23.089830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:23.089830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:23.089830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:23.089830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:23.089830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:23.089830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:23.089830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:23.089830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:23.090654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:23.090654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:23.090654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:23.090654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:23.090654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:23.090654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:23.090654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:23.090654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:23.090654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:23.090654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:23.090654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 13:39:23.090654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:23.090654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 134/278] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:23.091714 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc55434-49fc-4136-859b-96ccf5113bbb None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:23.091814 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc55434-49fc-4136-859b-96ccf5113bbb None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:23.092013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc55434-49fc-4136-859b-96ccf5113bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:23.106335 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016493e-cdbf-4c5f-917f-dd40d74f0361 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:23.107960 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-3bc55434-49fc-4136-859b-96ccf5113bbb None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:23.109125 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-3bc55434-49fc-4136-859b-96ccf5113bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:23.126041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:23.141093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ee2bf-7173-4f42-9292-f9202d85cac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:23.141995 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ee2bf-7173-4f42-9292-f9202d85cac3 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:23.142273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ee2bf-7173-4f42-9292-f9202d85cac3 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:23.142543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ee2bf-7173-4f42-9292-f9202d85cac3 None admin] PATH_INFO: `/v3/users/22f0fb67db85492c8580801a1a5638e2` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:23.156172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ee2bf-7173-4f42-9292-f9202d85cac3 None admin] RBAC: Authorizing `identity:get_user(user_id=22f0fb67db85492c8580801a1a5638e2)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:23.157801 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ee2bf-7173-4f42-9292-f9202d85cac3 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:23.159457 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 145/279] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:23 2022] GET /identity/v3/users/22f0fb67db85492c8580801a1a5638e2 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:23.160605 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e88ee-80c4-4c70-910e-ceae608cc149 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:23.160883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e88ee-80c4-4c70-910e-ceae608cc149 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:23.161157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e88ee-80c4-4c70-910e-ceae608cc149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:23.174825 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 135/280] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:23.175660 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc55434-49fc-4136-859b-96ccf5113bbb None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:23.176128 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-6e4e88ee-80c4-4c70-910e-ceae608cc149 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:23.177315 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-6e4e88ee-80c4-4c70-910e-ceae608cc149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:23.243859 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 146/281] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:23.250217 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e88ee-80c4-4c70-910e-ceae608cc149 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:23.282074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc55434-49fc-4136-859b-96ccf5113bbb None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:23.298256 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:23.316350 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10941317-a777-453d-befa-8a2985be2436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:23.317006 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10941317-a777-453d-befa-8a2985be2436 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:23.317307 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10941317-a777-453d-befa-8a2985be2436 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:23.317584 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10941317-a777-453d-befa-8a2985be2436 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:23.318314 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10941317-a777-453d-befa-8a2985be2436 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:23.318623 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10941317-a777-453d-befa-8a2985be2436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:23.320010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10941317-a777-453d-befa-8a2985be2436 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:23.327936 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 136/282] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:23.328708 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10941317-a777-453d-befa-8a2985be2436 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:23.347524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e88ee-80c4-4c70-910e-ceae608cc149 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:23.356673 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:23.381088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6873f3-746c-43ca-8c43-e0329bdbc2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:23.381761 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6873f3-746c-43ca-8c43-e0329bdbc2a3 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:23.382039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6873f3-746c-43ca-8c43-e0329bdbc2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:23.382319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6873f3-746c-43ca-8c43-e0329bdbc2a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:23.383150 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6873f3-746c-43ca-8c43-e0329bdbc2a3 None admin] RBAC: Adding query filter params (role.id=c7b1597b56ba4b88a4e6ac7689dc83fc, user.id=22f0fb67db85492c8580801a1a5638e2, scope.system=all) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:23.383458 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6873f3-746c-43ca-8c43-e0329bdbc2a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:23.384860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6873f3-746c-43ca-8c43-e0329bdbc2a3 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:23.389928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 147/283] 10.222.0.45 () {56 vars in 1308 bytes} [Thu May 26 13:39:23 2022] GET /identity/v3/role_assignments?user.id=22f0fb67db85492c8580801a1a5638e2&scope.system=all&role.id=c7b1597b56ba4b88a4e6ac7689dc83fc => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:23.390688 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6873f3-746c-43ca-8c43-e0329bdbc2a3 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:23.435791 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10941317-a777-453d-befa-8a2985be2436 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:23.472923 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f775f91-4fd1-4644-837a-6ad037a9dd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:23.473878 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f775f91-4fd1-4644-837a-6ad037a9dd82 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:23.474160 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f775f91-4fd1-4644-837a-6ad037a9dd82 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:23.474436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f775f91-4fd1-4644-837a-6ad037a9dd82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:23.475653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f775f91-4fd1-4644-837a-6ad037a9dd82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:23.477718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f775f91-4fd1-4644-837a-6ad037a9dd82 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:23.479391 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 137/284] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:23.484002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f775f91-4fd1-4644-837a-6ad037a9dd82 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:23.521253 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6873f3-746c-43ca-8c43-e0329bdbc2a3 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:23.533089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:23.559011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22be2a2-9397-4e03-819a-fa5e3b9a2bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:23.559824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22be2a2-9397-4e03-819a-fa5e3b9a2bbc None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:23.560106 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22be2a2-9397-4e03-819a-fa5e3b9a2bbc None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:23.560381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22be2a2-9397-4e03-819a-fa5e3b9a2bbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:23.573174 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22be2a2-9397-4e03-819a-fa5e3b9a2bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:23.581559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-c22be2a2-9397-4e03-819a-fa5e3b9a2bbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:23.581559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:23.581559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:23.581559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:23.581559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:23.581559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:23.581559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:23.581559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:23.581559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:23.581559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:23.581559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:23.581559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:23.581559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:23.581559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:23.581559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:23.581559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:23.582478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:23.582478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:23.582478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:23.582478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:23.582478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:23.582478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:23.582478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:23.582478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:23.582478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:23.582478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:23.582478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:23.582478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:23.582478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:23.582478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:23.582478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:23.582478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:23.583276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:23.583276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:23.583276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:23.583276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:23.583276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:23.583276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:23.583276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:23.583276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:23.583276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:23.583276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:23.583276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:23.583276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:23.583276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 148/285] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:23.583947 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22be2a2-9397-4e03-819a-fa5e3b9a2bbc None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:23.602498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f775f91-4fd1-4644-837a-6ad037a9dd82 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:23.619081 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:23.637665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e5980-4663-471a-93bb-d5c4170b5d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:23.638640 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e5980-4663-471a-93bb-d5c4170b5d4f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:23.638922 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e5980-4663-471a-93bb-d5c4170b5d4f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:23.639197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e5980-4663-471a-93bb-d5c4170b5d4f None admin] PATH_INFO: `/v3/users/5f7c5cea952d43f38ff0c14bc4237be5` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:23.640374 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e5980-4663-471a-93bb-d5c4170b5d4f None admin] RBAC: Authorizing `identity:get_user(user_id=5f7c5cea952d43f38ff0c14bc4237be5)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:23.641865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e5980-4663-471a-93bb-d5c4170b5d4f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:23.643495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 138/286] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:23 2022] GET /identity/v3/users/5f7c5cea952d43f38ff0c14bc4237be5 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:23.649516 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e5980-4663-471a-93bb-d5c4170b5d4f None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:23.700637 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22be2a2-9397-4e03-819a-fa5e3b9a2bbc None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:23.736731 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b93f2a-ddf4-4ab8-a31b-0eafb2e0c084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:23.737445 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b93f2a-ddf4-4ab8-a31b-0eafb2e0c084 None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:23.738022 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b93f2a-ddf4-4ab8-a31b-0eafb2e0c084 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:23.738325 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b93f2a-ddf4-4ab8-a31b-0eafb2e0c084 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:23.739039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b93f2a-ddf4-4ab8-a31b-0eafb2e0c084 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:23.740473 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b93f2a-ddf4-4ab8-a31b-0eafb2e0c084 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:23.762588 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e5980-4663-471a-93bb-d5c4170b5d4f None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:23.769509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 149/287] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 13:39:23 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:39:23.769509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b93f2a-ddf4-4ab8-a31b-0eafb2e0c084 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:23.790181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:23.814172 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11292de-9b48-404b-b474-a21d56b2a946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:23.815011 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11292de-9b48-404b-b474-a21d56b2a946 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:23.815508 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11292de-9b48-404b-b474-a21d56b2a946 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:23.815892 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11292de-9b48-404b-b474-a21d56b2a946 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:23.816872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11292de-9b48-404b-b474-a21d56b2a946 None admin] RBAC: Adding query filter params (name=member) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:23.817248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11292de-9b48-404b-b474-a21d56b2a946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:23.818787 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11292de-9b48-404b-b474-a21d56b2a946 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:23.833132 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 139/288] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:23.835532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11292de-9b48-404b-b474-a21d56b2a946 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:23.902257 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:23.922554 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b93f2a-ddf4-4ab8-a31b-0eafb2e0c084 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:23.956674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11292de-9b48-404b-b474-a21d56b2a946 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:23.969389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35201d5b-a521-42ad-82a0-5ba5699d318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:23.970465 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35201d5b-a521-42ad-82a0-5ba5699d318d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:23.970871 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35201d5b-a521-42ad-82a0-5ba5699d318d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:23.971351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35201d5b-a521-42ad-82a0-5ba5699d318d None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:23.972620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35201d5b-a521-42ad-82a0-5ba5699d318d None admin] RBAC: Authorizing `identity:get_project(project_id=954de20b90ec45ea91ae6997825c8772)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:23.974233 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35201d5b-a521-42ad-82a0-5ba5699d318d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:23.981695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 150/289] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:23 2022] GET /identity/v3/projects/954de20b90ec45ea91ae6997825c8772 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:23.982807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35201d5b-a521-42ad-82a0-5ba5699d318d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:24.003001 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d580e80-a622-4b2b-9780-d0d63277dd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:24.003877 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d580e80-a622-4b2b-9780-d0d63277dd52 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:24.004157 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d580e80-a622-4b2b-9780-d0d63277dd52 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:24.004431 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d580e80-a622-4b2b-9780-d0d63277dd52 None admin] PATH_INFO: `/v3/users/c404a4c5d433425aa415a695663a0b4c` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:24.005704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d580e80-a622-4b2b-9780-d0d63277dd52 None admin] RBAC: Authorizing `identity:get_user(user_id=c404a4c5d433425aa415a695663a0b4c)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:24.007373 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d580e80-a622-4b2b-9780-d0d63277dd52 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:24.009971 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 140/290] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:23 2022] GET /identity/v3/users/c404a4c5d433425aa415a695663a0b4c => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:24.015846 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d580e80-a622-4b2b-9780-d0d63277dd52 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:24.071235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:24.115769 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35201d5b-a521-42ad-82a0-5ba5699d318d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:24.144482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d580e80-a622-4b2b-9780-d0d63277dd52 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:24.160162 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de364873-ae24-471a-903f-6d07208d5c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:24.161137 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de364873-ae24-471a-903f-6d07208d5c5f None admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:24.161522 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de364873-ae24-471a-903f-6d07208d5c5f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:24.161816 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de364873-ae24-471a-903f-6d07208d5c5f None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772/users/5f7c5cea952d43f38ff0c14bc4237be5/roles/37940959ca5f49c3af8aa8cc5097b00b` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:24.163780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de364873-ae24-471a-903f-6d07208d5c5f None admin] RBAC: Authorizing `identity:create_grant(project_id=954de20b90ec45ea91ae6997825c8772, user_id=5f7c5cea952d43f38ff0c14bc4237be5, role_id=37940959ca5f49c3af8aa8cc5097b00b)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:24.166304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de364873-ae24-471a-903f-6d07208d5c5f None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:24.184409 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 151/291] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:39:23 2022] PUT /identity/v3/projects/954de20b90ec45ea91ae6997825c8772/users/5f7c5cea952d43f38ff0c14bc4237be5/roles/37940959ca5f49c3af8aa8cc5097b00b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:39:24.189380 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f23350-0f74-48d5-bee6-9c69c213872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:24.190331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f23350-0f74-48d5-bee6-9c69c213872e None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:24.190798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f23350-0f74-48d5-bee6-9c69c213872e None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:24.191080 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f23350-0f74-48d5-bee6-9c69c213872e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:24.272842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f23350-0f74-48d5-bee6-9c69c213872e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:24.274996 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f23350-0f74-48d5-bee6-9c69c213872e None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:24.327906 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:24.395646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 141/292] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 13:39:24.402203 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de364873-ae24-471a-903f-6d07208d5c5f None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:24.428488 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:24.529101 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de364873-ae24-471a-903f-6d07208d5c5f None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:24.574089 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b939944-ca3c-4b70-bb18-3d9ff2e9cd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:24.575021 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b939944-ca3c-4b70-bb18-3d9ff2e9cd33 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:24.575312 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b939944-ca3c-4b70-bb18-3d9ff2e9cd33 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:24.575595 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b939944-ca3c-4b70-bb18-3d9ff2e9cd33 None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:24.578173 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b939944-ca3c-4b70-bb18-3d9ff2e9cd33 None admin] RBAC: Authorizing `identity:get_project(project_id=954de20b90ec45ea91ae6997825c8772)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:24.579890 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b939944-ca3c-4b70-bb18-3d9ff2e9cd33 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:24.582048 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 152/293] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:24 2022] GET /identity/v3/projects/954de20b90ec45ea91ae6997825c8772 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:24.588771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f23350-0f74-48d5-bee6-9c69c213872e None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:24.739460 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f23350-0f74-48d5-bee6-9c69c213872e None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:24.790485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300588d5-2a23-476f-82bf-e964feb90f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:24.791140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300588d5-2a23-476f-82bf-e964feb90f4e None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:24.791418 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300588d5-2a23-476f-82bf-e964feb90f4e None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:24.791690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300588d5-2a23-476f-82bf-e964feb90f4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:24.792506 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300588d5-2a23-476f-82bf-e964feb90f4e None admin] RBAC: Adding query filter params (role.id=c7b1597b56ba4b88a4e6ac7689dc83fc, scope.project.id=954de20b90ec45ea91ae6997825c8772, user.id=c404a4c5d433425aa415a695663a0b4c) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:24.792817 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300588d5-2a23-476f-82bf-e964feb90f4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:24.794261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300588d5-2a23-476f-82bf-e964feb90f4e None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:24.800398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 142/294] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:39:24 2022] GET /identity/v3/role_assignments?user.id=c404a4c5d433425aa415a695663a0b4c&scope.project.id=954de20b90ec45ea91ae6997825c8772&role.id=c7b1597b56ba4b88a4e6ac7689dc83fc => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:25.668716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a124d-54ea-4b33-848a-43603a1933f8 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:25.674684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a124d-54ea-4b33-848a-43603a1933f8 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:25.675424 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a124d-54ea-4b33-848a-43603a1933f8 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:25.683398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 153/295] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:25 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:25.689312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddeb6e-8589-4278-a0bf-85fede70cc30 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:25.689720 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddeb6e-8589-4278-a0bf-85fede70cc30 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:25.689893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddeb6e-8589-4278-a0bf-85fede70cc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:25.706542 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-18ddeb6e-8589-4278-a0bf-85fede70cc30 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:25.707713 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-18ddeb6e-8589-4278-a0bf-85fede70cc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:25.709698 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:25.782555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 143/296] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:39:25.804098 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a124d-54ea-4b33-848a-43603a1933f8 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:25.894824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:25.913243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a124d-54ea-4b33-848a-43603a1933f8 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:25.948480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42e7ba-a1e0-423d-9d66-06e626a48a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:25.949540 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42e7ba-a1e0-423d-9d66-06e626a48a20 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:25.949969 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42e7ba-a1e0-423d-9d66-06e626a48a20 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:25.950392 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42e7ba-a1e0-423d-9d66-06e626a48a20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:25.961575 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42e7ba-a1e0-423d-9d66-06e626a48a20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:25.969621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-dc42e7ba-a1e0-423d-9d66-06e626a48a20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:25.969621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:25.969621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:25.969621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:25.969621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:25.969621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:25.969621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:25.969621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:25.969621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:25.969621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:25.969621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:25.969621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:25.969621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:25.969621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:25.969621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:25.969621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:25.970690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:25.970690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:25.970690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:25.970690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:25.970690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:25.970690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:25.970690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:25.970690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:25.970690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:25.970690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:25.970690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:25.970690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:25.970690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:25.970690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:25.970690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:25.970690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:25.971717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:25.971717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:25.971717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:25.971717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:25.971717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:25.971717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:25.971717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:25.971717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:25.971717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:25.971717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:25.971717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:25.971717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:25.974111 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 154/297] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:25.985299 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddeb6e-8589-4278-a0bf-85fede70cc30 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:26.081530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddeb6e-8589-4278-a0bf-85fede70cc30 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:26.116941 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce67a71-103a-4abd-8b53-160ef20ec003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:26.117639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce67a71-103a-4abd-8b53-160ef20ec003 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:26.117916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce67a71-103a-4abd-8b53-160ef20ec003 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:26.118187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce67a71-103a-4abd-8b53-160ef20ec003 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:26.118923 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce67a71-103a-4abd-8b53-160ef20ec003 None admin] RBAC: Adding query filter params (name=member) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:26.119224 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce67a71-103a-4abd-8b53-160ef20ec003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:26.120587 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce67a71-103a-4abd-8b53-160ef20ec003 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:26.125804 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:26.130317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 144/298] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:26.136043 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42e7ba-a1e0-423d-9d66-06e626a48a20 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:26.241124 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42e7ba-a1e0-423d-9d66-06e626a48a20 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:26.280407 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd852700-5b02-4eae-8d29-55e0ac418319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:26.281613 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd852700-5b02-4eae-8d29-55e0ac418319 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:26.282035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd852700-5b02-4eae-8d29-55e0ac418319 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:26.282449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd852700-5b02-4eae-8d29-55e0ac418319 None admin] PATH_INFO: `/v3/users/22f0fb67db85492c8580801a1a5638e2` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:26.283875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd852700-5b02-4eae-8d29-55e0ac418319 None admin] RBAC: Authorizing `identity:get_user(user_id=22f0fb67db85492c8580801a1a5638e2)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:26.285586 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd852700-5b02-4eae-8d29-55e0ac418319 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:26.287497 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 155/299] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:26 2022] GET /identity/v3/users/22f0fb67db85492c8580801a1a5638e2 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:26.293089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce67a71-103a-4abd-8b53-160ef20ec003 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:26.401261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce67a71-103a-4abd-8b53-160ef20ec003 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:26.440531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf8c16-da7a-4e76-bd5c-268f37e5521e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:26.441449 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf8c16-da7a-4e76-bd5c-268f37e5521e None admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:26.441730 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf8c16-da7a-4e76-bd5c-268f37e5521e None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:26.442007 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf8c16-da7a-4e76-bd5c-268f37e5521e None admin] PATH_INFO: `/v3/system/users/22f0fb67db85492c8580801a1a5638e2/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:26.443597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf8c16-da7a-4e76-bd5c-268f37e5521e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=22f0fb67db85492c8580801a1a5638e2, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:26.445574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf8c16-da7a-4e76-bd5c-268f37e5521e None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:26.450822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609870c-f97d-4938-bf43-8226362963bb None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:26.451010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609870c-f97d-4938-bf43-8226362963bb None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:26.451228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609870c-f97d-4938-bf43-8226362963bb None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:26.452953 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 156/300] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:26.456837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 145/301] 10.222.0.45 () {58 vars in 1334 bytes} [Thu May 26 13:39:26 2022] PUT /identity/v3/system/users/22f0fb67db85492c8580801a1a5638e2/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:39:26.460733 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2617635-cb25-4c9a-9b42-896ddb8332d7 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:26.460733 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2617635-cb25-4c9a-9b42-896ddb8332d7 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:26.460733 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2617635-cb25-4c9a-9b42-896ddb8332d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:26.477776 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-d2617635-cb25-4c9a-9b42-896ddb8332d7 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:26.479010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d2617635-cb25-4c9a-9b42-896ddb8332d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:26.488009 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:26.556240 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 157/302] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:26.580536 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf8c16-da7a-4e76-bd5c-268f37e5521e None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:26.649301 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ea45c-b067-4ed9-bf84-521ba2a4257c None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:26.649301 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ea45c-b067-4ed9-bf84-521ba2a4257c None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:26.649301 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ea45c-b067-4ed9-bf84-521ba2a4257c None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:26.649301 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 158/303] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:26.653898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b5d74-f1d3-494d-841f-224140a73cd3 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:26.654179 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b5d74-f1d3-494d-841f-224140a73cd3 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:26.654465 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b5d74-f1d3-494d-841f-224140a73cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:26.660976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:26.680996 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-783b5d74-f1d3-494d-841f-224140a73cd3 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:26.682927 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-783b5d74-f1d3-494d-841f-224140a73cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:26.721709 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf8c16-da7a-4e76-bd5c-268f37e5521e None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:26.765313 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 159/304] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:39:26.773993 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec13831-c97f-4e78-a7be-ba16b7376dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:26.775067 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec13831-c97f-4e78-a7be-ba16b7376dac None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:26.775497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec13831-c97f-4e78-a7be-ba16b7376dac None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:26.775919 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec13831-c97f-4e78-a7be-ba16b7376dac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:26.786831 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b5d74-f1d3-494d-841f-224140a73cd3 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:26.794113 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec13831-c97f-4e78-a7be-ba16b7376dac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:26.805832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-8ec13831-c97f-4e78-a7be-ba16b7376dac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 13:39:26.805832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:26.805832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:26.805832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:26.805832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:26.805832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:26.805832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:26.805832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:26.805832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:26.805832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:26.805832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:26.805832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:26.805832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:26.805832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:26.805832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:26.805832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:26.806766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:26.806766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:26.806766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:26.806766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:26.806766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:26.806766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:26.806766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:26.806766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:26.806766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:26.806766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:26.806766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:26.806766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:26.806766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:26.806766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:26.806766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:26.806766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:26.807657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:26.807657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:26.807657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:26.807657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:26.807657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:26.807657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:26.807657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:26.807657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:26.807657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:26.807657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:26.807657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 13:39:26.807657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:26.810330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 146/305] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:26.821316 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec13831-c97f-4e78-a7be-ba16b7376dac None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:26.881793 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:26.924431 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b5d74-f1d3-494d-841f-224140a73cd3 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:26.925162 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec13831-c97f-4e78-a7be-ba16b7376dac None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:26.950449 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:26.961205 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e60fa-c63c-460d-b499-a8d763e4508d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:26.962025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e60fa-c63c-460d-b499-a8d763e4508d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:26.962306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e60fa-c63c-460d-b499-a8d763e4508d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:26.962417 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009ad8b-96c9-4c5c-b94a-d770cf2d195d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:26.962615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e60fa-c63c-460d-b499-a8d763e4508d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:26.963159 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009ad8b-96c9-4c5c-b94a-d770cf2d195d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:26.963457 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009ad8b-96c9-4c5c-b94a-d770cf2d195d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:26.963736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e60fa-c63c-460d-b499-a8d763e4508d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:26.963841 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009ad8b-96c9-4c5c-b94a-d770cf2d195d None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:26.964483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009ad8b-96c9-4c5c-b94a-d770cf2d195d None admin] RBAC: Adding query filter params (name=reader) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:26.964792 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009ad8b-96c9-4c5c-b94a-d770cf2d195d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:26.965174 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e60fa-c63c-460d-b499-a8d763e4508d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:26.966175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009ad8b-96c9-4c5c-b94a-d770cf2d195d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:26.967017 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 160/306] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:26.968019 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58143b2f-fd59-4c8f-a276-3e16fcd4e432 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:26.968304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58143b2f-fd59-4c8f-a276-3e16fcd4e432 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:26.968583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58143b2f-fd59-4c8f-a276-3e16fcd4e432 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:26.971811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 161/307] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:26.972559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58143b2f-fd59-4c8f-a276-3e16fcd4e432 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:26.977100 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 147/308] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:26.978406 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba124535-3221-4baf-bd0b-374b43e567e8 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:26.978693 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba124535-3221-4baf-bd0b-374b43e567e8 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:26.978965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba124535-3221-4baf-bd0b-374b43e567e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:26.997710 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-ba124535-3221-4baf-bd0b-374b43e567e8 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:26.998890 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ba124535-3221-4baf-bd0b-374b43e567e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:27.073601 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 148/309] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:27.073601 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba124535-3221-4baf-bd0b-374b43e567e8 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:27.103094 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58143b2f-fd59-4c8f-a276-3e16fcd4e432 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:27.148942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cac1d8-86fc-4c0a-aee6-56facb8d5d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:27.150098 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cac1d8-86fc-4c0a-aee6-56facb8d5d34 None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:27.150512 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cac1d8-86fc-4c0a-aee6-56facb8d5d34 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:27.150912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cac1d8-86fc-4c0a-aee6-56facb8d5d34 None admin] PATH_INFO: `/v3/groups` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:27.151958 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cac1d8-86fc-4c0a-aee6-56facb8d5d34 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:27.154188 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cac1d8-86fc-4c0a-aee6-56facb8d5d34 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:27.172608 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:27.186007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 162/310] 10.222.0.45 () {60 vars in 1134 bytes} [Thu May 26 13:39:26 2022] POST /identity/v3/groups => generated 229 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:39:27.187542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cac1d8-86fc-4c0a-aee6-56facb8d5d34 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:27.220107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba124535-3221-4baf-bd0b-374b43e567e8 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:27.249728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:27.303690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac75201-33be-46f8-924b-fc712093e0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:27.305258 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac75201-33be-46f8-924b-fc712093e0b5 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:27.305554 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac75201-33be-46f8-924b-fc712093e0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:27.305830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac75201-33be-46f8-924b-fc712093e0b5 None admin] PATH_INFO: `/v3/users/5bcc6b766f5c4e4cb66260ccbe6f5970` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:27.336404 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac75201-33be-46f8-924b-fc712093e0b5 None admin] RBAC: Authorizing `identity:get_user(user_id=5bcc6b766f5c4e4cb66260ccbe6f5970)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:27.338076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac75201-33be-46f8-924b-fc712093e0b5 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:27.344942 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 149/311] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:27 2022] GET /identity/v3/users/5bcc6b766f5c4e4cb66260ccbe6f5970 => generated 293 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:27.346372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac75201-33be-46f8-924b-fc712093e0b5 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:27.424085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cac1d8-86fc-4c0a-aee6-56facb8d5d34 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:27.466574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0553b-86c3-40ea-8d88-85fb600f970d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:27.471177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0553b-86c3-40ea-8d88-85fb600f970d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:27.471177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0553b-86c3-40ea-8d88-85fb600f970d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:27.471177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0553b-86c3-40ea-8d88-85fb600f970d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:27.487584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0553b-86c3-40ea-8d88-85fb600f970d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:27.498922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-cbc0553b-86c3-40ea-8d88-85fb600f970d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 13:39:27.498922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:27.498922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:27.498922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:27.498922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:27.498922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:27.498922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:27.498922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:27.498922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:27.498922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:27.498922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:27.498922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:27.498922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:27.498922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:27.498922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:27.498922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:27.499844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:27.499844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:27.499844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:27.499844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:27.499844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:27.499844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:27.499844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:27.499844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:27.499844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:27.499844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:27.499844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:27.499844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:27.499844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:27.499844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:27.499844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:27.499844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:27.500651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:27.500651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:27.500651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:27.500651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:27.500651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:27.500651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:27.500651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:27.500651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:27.500651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:27.500651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:27.500651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 13:39:27.500651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:27.500651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 163/312] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:27.507782 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0553b-86c3-40ea-8d88-85fb600f970d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:27.509654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac75201-33be-46f8-924b-fc712093e0b5 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:27.554430 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5277624-eb8f-4f54-9d83-2df15fb66612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:27.555554 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5277624-eb8f-4f54-9d83-2df15fb66612 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:27.556381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5277624-eb8f-4f54-9d83-2df15fb66612 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:27.556835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5277624-eb8f-4f54-9d83-2df15fb66612 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:27.558331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5277624-eb8f-4f54-9d83-2df15fb66612 None admin] RBAC: Adding query filter params (role.id=37940959ca5f49c3af8aa8cc5097b00b, user.id=5bcc6b766f5c4e4cb66260ccbe6f5970, scope.system=all) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:27.558921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5277624-eb8f-4f54-9d83-2df15fb66612 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:27.560700 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5277624-eb8f-4f54-9d83-2df15fb66612 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:27.567706 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 150/313] 10.222.0.45 () {56 vars in 1308 bytes} [Thu May 26 13:39:27 2022] GET /identity/v3/role_assignments?user.id=5bcc6b766f5c4e4cb66260ccbe6f5970&scope.system=all&role.id=37940959ca5f49c3af8aa8cc5097b00b => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:27.577422 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:27.625664 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0553b-86c3-40ea-8d88-85fb600f970d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:27.665676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095f06e-7537-41aa-81e2-9d5ad84ff001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:27.666351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095f06e-7537-41aa-81e2-9d5ad84ff001 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:27.666630 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095f06e-7537-41aa-81e2-9d5ad84ff001 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:27.666944 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095f06e-7537-41aa-81e2-9d5ad84ff001 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:27.667701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095f06e-7537-41aa-81e2-9d5ad84ff001 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:27.668006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095f06e-7537-41aa-81e2-9d5ad84ff001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:27.672331 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095f06e-7537-41aa-81e2-9d5ad84ff001 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:27.680210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 164/314] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:27.686274 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5277624-eb8f-4f54-9d83-2df15fb66612 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:27.736060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:27.803225 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5277624-eb8f-4f54-9d83-2df15fb66612 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:27.843764 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a539728-a670-47c8-941b-aca01e2ae634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:27.844627 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a539728-a670-47c8-941b-aca01e2ae634 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:27.844905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a539728-a670-47c8-941b-aca01e2ae634 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:27.845176 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a539728-a670-47c8-941b-aca01e2ae634 None admin] PATH_INFO: `/v3/users/5f7c5cea952d43f38ff0c14bc4237be5` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:27.846445 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a539728-a670-47c8-941b-aca01e2ae634 None admin] RBAC: Authorizing `identity:get_user(user_id=5f7c5cea952d43f38ff0c14bc4237be5)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:27.847919 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a539728-a670-47c8-941b-aca01e2ae634 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:27.849556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 151/315] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:27 2022] GET /identity/v3/users/5f7c5cea952d43f38ff0c14bc4237be5 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:27.855676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095f06e-7537-41aa-81e2-9d5ad84ff001 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:27.957538 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095f06e-7537-41aa-81e2-9d5ad84ff001 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:27.980209 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:27.993043 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66fc58-ab19-4797-a38f-c2d615f932ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:27.993731 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66fc58-ab19-4797-a38f-c2d615f932ea None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:27.994082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66fc58-ab19-4797-a38f-c2d615f932ea None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:27.994586 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66fc58-ab19-4797-a38f-c2d615f932ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:28.063362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66fc58-ab19-4797-a38f-c2d615f932ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:28.065168 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66fc58-ab19-4797-a38f-c2d615f932ea None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:28.176490 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 165/316] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:28.181974 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a539728-a670-47c8-941b-aca01e2ae634 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:28.289969 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a539728-a670-47c8-941b-aca01e2ae634 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:28.297525 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:28.326894 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197d799-d1bb-4391-89f9-7fbf76e76daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:28.327755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197d799-d1bb-4391-89f9-7fbf76e76daf None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:28.328040 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197d799-d1bb-4391-89f9-7fbf76e76daf None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:28.328317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197d799-d1bb-4391-89f9-7fbf76e76daf None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:28.329534 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197d799-d1bb-4391-89f9-7fbf76e76daf None admin] RBAC: Authorizing `identity:get_project(project_id=954de20b90ec45ea91ae6997825c8772)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:28.330990 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197d799-d1bb-4391-89f9-7fbf76e76daf None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:28.333000 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 152/317] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:28 2022] GET /identity/v3/projects/954de20b90ec45ea91ae6997825c8772 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:28.339230 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66fc58-ab19-4797-a38f-c2d615f932ea None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:28.368064 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:28.447755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66fc58-ab19-4797-a38f-c2d615f932ea None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:28.486115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc542a57-de7e-4ff6-b4f8-77cc99df8cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:28.486773 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc542a57-de7e-4ff6-b4f8-77cc99df8cbe None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:28.487059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc542a57-de7e-4ff6-b4f8-77cc99df8cbe None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:28.487338 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc542a57-de7e-4ff6-b4f8-77cc99df8cbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:28.488170 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc542a57-de7e-4ff6-b4f8-77cc99df8cbe None admin] RBAC: Adding query filter params (role.id=37940959ca5f49c3af8aa8cc5097b00b, scope.project.id=954de20b90ec45ea91ae6997825c8772, user.id=5f7c5cea952d43f38ff0c14bc4237be5) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:28.488484 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc542a57-de7e-4ff6-b4f8-77cc99df8cbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:28.489945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc542a57-de7e-4ff6-b4f8-77cc99df8cbe None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:28.496547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 166/318] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:39:28 2022] GET /identity/v3/role_assignments?user.id=5f7c5cea952d43f38ff0c14bc4237be5&scope.project.id=954de20b90ec45ea91ae6997825c8772&role.id=37940959ca5f49c3af8aa8cc5097b00b => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:28.746268 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f63c05-8a34-40b8-80de-4afbc26e3567 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:28.746773 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f63c05-8a34-40b8-80de-4afbc26e3567 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:28.746879 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f63c05-8a34-40b8-80de-4afbc26e3567 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:28.748433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 153/319] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:28.753724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547cbfb-ea93-4365-96ab-8165e6fb3d72 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:28.754015 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547cbfb-ea93-4365-96ab-8165e6fb3d72 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:28.754291 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547cbfb-ea93-4365-96ab-8165e6fb3d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:28.775043 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-b547cbfb-ea93-4365-96ab-8165e6fb3d72 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:28.776238 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-b547cbfb-ea93-4365-96ab-8165e6fb3d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:28.845893 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 167/320] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:28.869407 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f63c05-8a34-40b8-80de-4afbc26e3567 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:28.973751 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f63c05-8a34-40b8-80de-4afbc26e3567 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:29.007043 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd56ca-5cdd-4724-8eae-cfd9c8627ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:29.008375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd56ca-5cdd-4724-8eae-cfd9c8627ee9 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:29.008655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd56ca-5cdd-4724-8eae-cfd9c8627ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:29.008929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd56ca-5cdd-4724-8eae-cfd9c8627ee9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:29.019068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd56ca-5cdd-4724-8eae-cfd9c8627ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:29.026691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-0ddd56ca-5cdd-4724-8eae-cfd9c8627ee9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:29.026691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:29.026691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:29.026691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:29.026691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:29.026691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:29.026691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:29.026691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:29.026691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:29.026691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:29.026691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:29.026691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:29.026691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:29.026691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:29.026691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:29.026691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:29.027555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:29.027555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:29.027555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:29.027555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:29.027555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:29.027555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:29.027555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:29.027555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:29.027555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:29.027555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:29.027555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:29.027555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:29.027555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:29.027555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:29.027555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:29.027555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:29.033121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:29.033121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:29.033121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:29.033121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:29.033121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:29.033121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:29.033121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:29.033121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:29.033121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:29.033121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:29.033121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:29.033121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:29.033121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 154/321] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:29.035485 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547cbfb-ea93-4365-96ab-8165e6fb3d72 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:29.053469 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:29.136088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547cbfb-ea93-4365-96ab-8165e6fb3d72 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:29.169171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04db822-a24a-46bb-9a7f-9047fe748333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:29.169852 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04db822-a24a-46bb-9a7f-9047fe748333 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:29.170133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04db822-a24a-46bb-9a7f-9047fe748333 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:29.170406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04db822-a24a-46bb-9a7f-9047fe748333 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:29.171146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04db822-a24a-46bb-9a7f-9047fe748333 None admin] RBAC: Adding query filter params (name=member) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:29.171452 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04db822-a24a-46bb-9a7f-9047fe748333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:29.172814 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04db822-a24a-46bb-9a7f-9047fe748333 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:29.181661 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 168/322] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:29.186937 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd56ca-5cdd-4724-8eae-cfd9c8627ee9 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:29.221536 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:29.288586 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd56ca-5cdd-4724-8eae-cfd9c8627ee9 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:29.321541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906317ac-3ba4-4635-9b6a-1f75af3e1e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:29.322409 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906317ac-3ba4-4635-9b6a-1f75af3e1e6b None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:29.322692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906317ac-3ba4-4635-9b6a-1f75af3e1e6b None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:29.322965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906317ac-3ba4-4635-9b6a-1f75af3e1e6b None admin] PATH_INFO: `/v3/users/22f0fb67db85492c8580801a1a5638e2` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:29.324142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906317ac-3ba4-4635-9b6a-1f75af3e1e6b None admin] RBAC: Authorizing `identity:get_user(user_id=22f0fb67db85492c8580801a1a5638e2)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:29.325618 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906317ac-3ba4-4635-9b6a-1f75af3e1e6b None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:29.327436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 155/323] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:29 2022] GET /identity/v3/users/22f0fb67db85492c8580801a1a5638e2 => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:29.332888 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04db822-a24a-46bb-9a7f-9047fe748333 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:29.419957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:29.442979 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04db822-a24a-46bb-9a7f-9047fe748333 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:29.477091 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e45d7-a0ea-473b-a395-1fba85fc8d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:29.477773 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e45d7-a0ea-473b-a395-1fba85fc8d8c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:29.478060 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e45d7-a0ea-473b-a395-1fba85fc8d8c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:29.478336 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e45d7-a0ea-473b-a395-1fba85fc8d8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:29.479155 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e45d7-a0ea-473b-a395-1fba85fc8d8c None admin] RBAC: Adding query filter params (role.id=c7b1597b56ba4b88a4e6ac7689dc83fc, user.id=22f0fb67db85492c8580801a1a5638e2, scope.system=all) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:29.479467 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e45d7-a0ea-473b-a395-1fba85fc8d8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:29.480881 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e45d7-a0ea-473b-a395-1fba85fc8d8c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:29.493296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 169/324] 10.222.0.45 () {56 vars in 1308 bytes} [Thu May 26 13:39:29 2022] GET /identity/v3/role_assignments?user.id=22f0fb67db85492c8580801a1a5638e2&scope.system=all&role.id=c7b1597b56ba4b88a4e6ac7689dc83fc => generated 510 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:29.564500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7314cf-3a33-4926-a846-3a346b8aa2b3 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:29.564685 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7314cf-3a33-4926-a846-3a346b8aa2b3 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:29.564956 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7314cf-3a33-4926-a846-3a346b8aa2b3 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:29.566530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 156/325] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:29.572104 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c2b09-4a43-4d66-94b6-b0dbb3b7c064 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:29.572397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c2b09-4a43-4d66-94b6-b0dbb3b7c064 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:29.572666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c2b09-4a43-4d66-94b6-b0dbb3b7c064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:29.590677 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-268c2b09-4a43-4d66-94b6-b0dbb3b7c064 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:29.591887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-268c2b09-4a43-4d66-94b6-b0dbb3b7c064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:29.664703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 170/326] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:29.686782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7314cf-3a33-4926-a846-3a346b8aa2b3 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:29.801881 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7314cf-3a33-4926-a846-3a346b8aa2b3 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:29.803398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:29.836122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32ca58-8220-42ff-989a-a3664e4b6773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:29.836827 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32ca58-8220-42ff-989a-a3664e4b6773 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:29.837110 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32ca58-8220-42ff-989a-a3664e4b6773 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:29.837426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32ca58-8220-42ff-989a-a3664e4b6773 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:29.838569 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32ca58-8220-42ff-989a-a3664e4b6773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:29.840008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32ca58-8220-42ff-989a-a3664e4b6773 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:29.841635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 157/327] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:29.847299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c2b09-4a43-4d66-94b6-b0dbb3b7c064 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:29.909431 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:29.926431 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40ced1-91b5-4b2c-acc9-51e8c453e18b None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:29.926719 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40ced1-91b5-4b2c-acc9-51e8c453e18b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:29.926998 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40ced1-91b5-4b2c-acc9-51e8c453e18b None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:29.928344 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 158/328] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:39:29.933385 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cd890-0e9e-4ef1-94ec-605cdf41e645 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:29.933678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cd890-0e9e-4ef1-94ec-605cdf41e645 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:29.933961 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cd890-0e9e-4ef1-94ec-605cdf41e645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:29.944763 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c2b09-4a43-4d66-94b6-b0dbb3b7c064 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:29.950578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-287cd890-0e9e-4ef1-94ec-605cdf41e645 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:29.951777 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-287cd890-0e9e-4ef1-94ec-605cdf41e645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:29.978414 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ceaac-eb3a-47e6-b274-4d446a8b702a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:29.979068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ceaac-eb3a-47e6-b274-4d446a8b702a None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:29.979350 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ceaac-eb3a-47e6-b274-4d446a8b702a None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:29.979627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ceaac-eb3a-47e6-b274-4d446a8b702a None admin] PATH_INFO: `/v3/groups` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:29.980305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ceaac-eb3a-47e6-b274-4d446a8b702a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:29.981769 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ceaac-eb3a-47e6-b274-4d446a8b702a None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:29.995331 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 171/329] 10.222.0.45 () {60 vars in 1134 bytes} [Thu May 26 13:39:29 2022] POST /identity/v3/groups => generated 226 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:39:30.020677 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 159/330] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:39:30.043929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ceaac-eb3a-47e6-b274-4d446a8b702a None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:30.147906 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ceaac-eb3a-47e6-b274-4d446a8b702a None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:30.174841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:30.185878 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191d2a8-7efc-409d-8ce3-954ff47a1b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:30.186682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191d2a8-7efc-409d-8ce3-954ff47a1b7f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:30.187783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191d2a8-7efc-409d-8ce3-954ff47a1b7f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:30.187783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191d2a8-7efc-409d-8ce3-954ff47a1b7f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:30.197432 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191d2a8-7efc-409d-8ce3-954ff47a1b7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:30.205196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-5191d2a8-7efc-409d-8ce3-954ff47a1b7f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 13:39:30.205196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:30.205196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:30.205196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:30.205196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:30.205196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:30.205196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:30.205196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:30.205196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:30.205196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:30.205196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:30.205196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:30.205196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:30.205196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:30.205196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:30.205196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:30.206158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:30.206158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:30.206158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:30.206158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:30.206158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:30.206158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:30.206158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:30.206158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:30.206158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:30.206158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:30.206158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:30.206158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:30.206158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:30.206158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:30.206158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:30.206158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:30.206982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:30.206982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:30.206982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:30.206982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:30.206982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:30.206982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:30.206982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:30.206982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:30.206982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:30.206982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:30.206982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 13:39:30.206982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:30.206982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 172/331] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:39:30.212203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cd890-0e9e-4ef1-94ec-605cdf41e645 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:30.314339 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:30.317324 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cd890-0e9e-4ef1-94ec-605cdf41e645 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:30.352574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5551aa1-7fdb-48a6-a1b4-6517e4f032e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:30.353243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5551aa1-7fdb-48a6-a1b4-6517e4f032e8 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:30.353549 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5551aa1-7fdb-48a6-a1b4-6517e4f032e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:30.353821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5551aa1-7fdb-48a6-a1b4-6517e4f032e8 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:30.354596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5551aa1-7fdb-48a6-a1b4-6517e4f032e8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:30.354896 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5551aa1-7fdb-48a6-a1b4-6517e4f032e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:30.356258 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5551aa1-7fdb-48a6-a1b4-6517e4f032e8 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:30.365020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 160/332] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:30.370688 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191d2a8-7efc-409d-8ce3-954ff47a1b7f None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:30.489594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191d2a8-7efc-409d-8ce3-954ff47a1b7f None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:30.526372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96f7ab-71dd-4f3a-87e8-99f4363fbe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:30.527245 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96f7ab-71dd-4f3a-87e8-99f4363fbe25 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:30.527523 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96f7ab-71dd-4f3a-87e8-99f4363fbe25 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:30.527795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96f7ab-71dd-4f3a-87e8-99f4363fbe25 None admin] PATH_INFO: `/v3/users/5bcc6b766f5c4e4cb66260ccbe6f5970` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:30.528983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96f7ab-71dd-4f3a-87e8-99f4363fbe25 None admin] RBAC: Authorizing `identity:get_user(user_id=5bcc6b766f5c4e4cb66260ccbe6f5970)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:30.531923 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96f7ab-71dd-4f3a-87e8-99f4363fbe25 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:30.532379 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 173/333] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:30 2022] GET /identity/v3/users/5bcc6b766f5c4e4cb66260ccbe6f5970 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:30.537611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5551aa1-7fdb-48a6-a1b4-6517e4f032e8 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:30.644733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5551aa1-7fdb-48a6-a1b4-6517e4f032e8 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:30.687175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005ff5b-b30e-4a84-8a58-5053c603ff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:30.688037 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005ff5b-b30e-4a84-8a58-5053c603ff3b None admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:30.688313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005ff5b-b30e-4a84-8a58-5053c603ff3b None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:30.688583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005ff5b-b30e-4a84-8a58-5053c603ff3b None admin] PATH_INFO: `/v3/system/users/5bcc6b766f5c4e4cb66260ccbe6f5970/roles/37940959ca5f49c3af8aa8cc5097b00b` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:30.694030 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005ff5b-b30e-4a84-8a58-5053c603ff3b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5bcc6b766f5c4e4cb66260ccbe6f5970, role_id=37940959ca5f49c3af8aa8cc5097b00b)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:30.695950 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005ff5b-b30e-4a84-8a58-5053c603ff3b None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:30.706945 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 161/334] 10.222.0.45 () {58 vars in 1334 bytes} [Thu May 26 13:39:30 2022] PUT /identity/v3/system/users/5bcc6b766f5c4e4cb66260ccbe6f5970/roles/37940959ca5f49c3af8aa8cc5097b00b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:39:33.032467 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ffc50-59e6-4910-8d25-6b3c26073c37 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:33.033026 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ffc50-59e6-4910-8d25-6b3c26073c37 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:33.033026 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ffc50-59e6-4910-8d25-6b3c26073c37 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:33.034644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 174/335] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:33.041071 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb13643-ae32-48c6-8f6c-09141a46de94 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:33.041984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb13643-ae32-48c6-8f6c-09141a46de94 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:33.042467 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb13643-ae32-48c6-8f6c-09141a46de94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:33.066328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-aeb13643-ae32-48c6-8f6c-09141a46de94 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:33.067950 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-aeb13643-ae32-48c6-8f6c-09141a46de94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:33.094592 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:33.155812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e4151-8c3f-4fd0-af57-015e722b1769 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:33.156160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e4151-8c3f-4fd0-af57-015e722b1769 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:33.156361 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e4151-8c3f-4fd0-af57-015e722b1769 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:33.158023 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 175/336] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:33.160098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 162/337] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:39:33.183283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a97403-8efe-4ee6-a9e5-ce3c28830761 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:33.183603 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a97403-8efe-4ee6-a9e5-ce3c28830761 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:33.183842 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a97403-8efe-4ee6-a9e5-ce3c28830761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:33.205232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-57a97403-8efe-4ee6-a9e5-ce3c28830761 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:33.206432 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-57a97403-8efe-4ee6-a9e5-ce3c28830761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:33.224131 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb13643-ae32-48c6-8f6c-09141a46de94 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:33.297562 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:33.334613 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 176/338] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:33.359874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a97403-8efe-4ee6-a9e5-ce3c28830761 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:33.407237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb13643-ae32-48c6-8f6c-09141a46de94 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:33.462665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b027750-b7b6-4cbb-bcae-957de8ec4100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:33.463792 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b027750-b7b6-4cbb-bcae-957de8ec4100 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:33.464254 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b027750-b7b6-4cbb-bcae-957de8ec4100 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:33.464708 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b027750-b7b6-4cbb-bcae-957de8ec4100 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:33.483262 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b027750-b7b6-4cbb-bcae-957de8ec4100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:33.496190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-7b027750-b7b6-4cbb-bcae-957de8ec4100 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:33.496190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:33.496190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:33.496190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:33.496190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:33.496190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:33.496190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:33.496190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:33.496190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:33.496190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:33.496190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:33.496190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:33.496190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:33.496190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:33.496190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:33.496190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:33.497201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:33.497201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:33.497201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:33.497201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:33.497201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:33.497201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:33.497201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:33.497201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:33.497201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:33.497201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:33.497201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:33.497201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:33.497201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:33.497201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:33.497201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:33.497201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:33.500218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:33.500218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:33.500218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:33.500218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:33.500218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:33.500218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:33.500218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:33.500218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:33.500218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:33.500218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:33.500218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:33.500218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:33.500218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 163/339] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:33.510966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b027750-b7b6-4cbb-bcae-957de8ec4100 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:33.517822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a97403-8efe-4ee6-a9e5-ce3c28830761 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:33.541824 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:33.572810 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793a421-34d9-481d-b200-1c1b1ff597de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:33.573905 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793a421-34d9-481d-b200-1c1b1ff597de None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:33.574345 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793a421-34d9-481d-b200-1c1b1ff597de None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:33.574763 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793a421-34d9-481d-b200-1c1b1ff597de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:33.592104 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793a421-34d9-481d-b200-1c1b1ff597de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:33.609004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-9793a421-34d9-481d-b200-1c1b1ff597de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:33.609004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:33.609004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:33.609004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:33.609004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:33.609004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:33.609004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:33.609004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:33.609004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:33.609004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:33.609004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:33.609004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:33.609004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:33.609004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:33.609004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:33.609004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:33.610362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:33.610362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:33.610362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:33.610362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:33.610362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:33.610362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:33.610362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:33.610362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:33.610362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:33.610362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:33.610362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:33.610362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:33.610362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:33.610362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:33.610362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:33.610362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:33.611282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:33.611282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:33.611282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:33.611282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:33.611282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:33.611282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:33.611282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:33.611282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:33.611282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:33.611282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:33.611282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:33.611282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:33.614269 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 177/340] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:39:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:39:33.621829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793a421-34d9-481d-b200-1c1b1ff597de None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:33.729113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:33.734430 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b027750-b7b6-4cbb-bcae-957de8ec4100 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:33.822528 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe87c38-ebe7-48c0-9d2f-b49ed6c26814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:33.823597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe87c38-ebe7-48c0-9d2f-b49ed6c26814 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:33.824029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe87c38-ebe7-48c0-9d2f-b49ed6c26814 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:33.824459 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe87c38-ebe7-48c0-9d2f-b49ed6c26814 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:33.825397 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe87c38-ebe7-48c0-9d2f-b49ed6c26814 None admin] RBAC: Adding query filter params (name=member) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:33.825850 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe87c38-ebe7-48c0-9d2f-b49ed6c26814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:33.827407 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe87c38-ebe7-48c0-9d2f-b49ed6c26814 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:33.828084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793a421-34d9-481d-b200-1c1b1ff597de None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:33.840930 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 164/341] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:33.846202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe87c38-ebe7-48c0-9d2f-b49ed6c26814 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:33.865570 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a7530-c3db-4c61-a7ff-1aac80bfd0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:33.867102 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a7530-c3db-4c61-a7ff-1aac80bfd0f0 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:33.867567 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a7530-c3db-4c61-a7ff-1aac80bfd0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:33.868038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a7530-c3db-4c61-a7ff-1aac80bfd0f0 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:33.868989 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a7530-c3db-4c61-a7ff-1aac80bfd0f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:33.869534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a7530-c3db-4c61-a7ff-1aac80bfd0f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:33.874776 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a7530-c3db-4c61-a7ff-1aac80bfd0f0 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:33.883601 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 178/342] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:39:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:33.889479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a7530-c3db-4c61-a7ff-1aac80bfd0f0 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:33.968201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:33.994552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe87c38-ebe7-48c0-9d2f-b49ed6c26814 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:34.032691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4e66b-94c2-4126-8158-d9c84d1269d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:34.033682 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4e66b-94c2-4126-8158-d9c84d1269d1 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:34.034152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4e66b-94c2-4126-8158-d9c84d1269d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:34.034607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4e66b-94c2-4126-8158-d9c84d1269d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:34.034874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a7530-c3db-4c61-a7ff-1aac80bfd0f0 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:34.042924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:34.081012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c3239-f866-4822-9857-b7259aaa1e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:34.081994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c3239-f866-4822-9857-b7259aaa1e9d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:34.082442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c3239-f866-4822-9857-b7259aaa1e9d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:34.082719 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c3239-f866-4822-9857-b7259aaa1e9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:34.138031 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4e66b-94c2-4126-8158-d9c84d1269d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:34.139924 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4e66b-94c2-4126-8158-d9c84d1269d1 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:34.167306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c3239-f866-4822-9857-b7259aaa1e9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:34.168769 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c3239-f866-4822-9857-b7259aaa1e9d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:34.239956 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:34.276828 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 165/343] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:34.283709 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d008bc-f13d-48aa-8034-1082c43461da None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:34.284198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d008bc-f13d-48aa-8034-1082c43461da None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:34.284666 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d008bc-f13d-48aa-8034-1082c43461da None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:34.286065 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 166/345] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:34.286303 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 179/345] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 13:39:34.287114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1954083-add2-4159-9fe9-2622c4c144f9 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:34.287457 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1954083-add2-4159-9fe9-2622c4c144f9 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:34.287557 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f3d3c-18a7-4654-b2eb-9068d8231e7d None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:34.287731 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1954083-add2-4159-9fe9-2622c4c144f9 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:34.287835 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f3d3c-18a7-4654-b2eb-9068d8231e7d None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:34.288042 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f3d3c-18a7-4654-b2eb-9068d8231e7d None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:34.290177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 180/346] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:34.291464 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f3d3c-18a7-4654-b2eb-9068d8231e7d None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:34.293937 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 167/347] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:34.295521 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65462615-5e3f-488f-b039-17da9ea2d540 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:34.296102 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65462615-5e3f-488f-b039-17da9ea2d540 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:34.296571 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65462615-5e3f-488f-b039-17da9ea2d540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:34.307357 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:34.316414 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-65462615-5e3f-488f-b039-17da9ea2d540 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:34.317936 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-65462615-5e3f-488f-b039-17da9ea2d540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:34.418565 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 168/348] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:34.419704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7365a4-d4f9-48fc-936d-68c5e128d456 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:34.419994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7365a4-d4f9-48fc-936d-68c5e128d456 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:34.420386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7365a4-d4f9-48fc-936d-68c5e128d456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:34.433744 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f3d3c-18a7-4654-b2eb-9068d8231e7d None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:34.436575 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-bd7365a4-d4f9-48fc-936d-68c5e128d456 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:34.438059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-bd7365a4-d4f9-48fc-936d-68c5e128d456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:34.478157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0a484-5404-4b5c-9dda-8e2229fdea1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:34.479031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0a484-5404-4b5c-9dda-8e2229fdea1e None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:34.479348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0a484-5404-4b5c-9dda-8e2229fdea1e None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:34.479583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0a484-5404-4b5c-9dda-8e2229fdea1e None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:34.480745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0a484-5404-4b5c-9dda-8e2229fdea1e None admin] RBAC: Authorizing `identity:get_project(project_id=df7e1b99ff17461db446a994311e1f0f)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:34.482232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0a484-5404-4b5c-9dda-8e2229fdea1e None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:34.484046 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 181/349] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:34 2022] GET /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:34.484714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0a484-5404-4b5c-9dda-8e2229fdea1e None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:34.536797 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 169/350] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:34.538674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4bd02-623a-461d-bad1-d55880aab343 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:34.539185 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4bd02-623a-461d-bad1-d55880aab343 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:34.539656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4bd02-623a-461d-bad1-d55880aab343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:34.566047 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-93f4bd02-623a-461d-bad1-d55880aab343 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:34.567237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-93f4bd02-623a-461d-bad1-d55880aab343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:34.592798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:34.610573 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:34.628001 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0a484-5404-4b5c-9dda-8e2229fdea1e None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:34.654908 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 170/351] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:34.656571 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4bd02-623a-461d-bad1-d55880aab343 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:34.682750 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621956ea-1bc8-485a-876e-2d93d7a9454c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:34.684889 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621956ea-1bc8-485a-876e-2d93d7a9454c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:34.684889 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621956ea-1bc8-485a-876e-2d93d7a9454c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:34.684889 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621956ea-1bc8-485a-876e-2d93d7a9454c None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:34.685779 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621956ea-1bc8-485a-876e-2d93d7a9454c None admin] RBAC: Authorizing `identity:get_project(project_id=df7e1b99ff17461db446a994311e1f0f)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:34.687832 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621956ea-1bc8-485a-876e-2d93d7a9454c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:34.690254 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 182/352] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:34 2022] GET /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:34.691981 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621956ea-1bc8-485a-876e-2d93d7a9454c None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:34.790561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4bd02-623a-461d-bad1-d55880aab343 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:34.825062 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621956ea-1bc8-485a-876e-2d93d7a9454c None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:34.828682 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e49f8-351f-49f3-9997-da77ca09adb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:34.829504 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e49f8-351f-49f3-9997-da77ca09adb6 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:34.829790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e49f8-351f-49f3-9997-da77ca09adb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:34.830070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e49f8-351f-49f3-9997-da77ca09adb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:34.841735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e49f8-351f-49f3-9997-da77ca09adb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:34.850448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-437e49f8-351f-49f3-9997-da77ca09adb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:34.850448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:34.850448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:34.850448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:34.850448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:34.850448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:34.850448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:34.850448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:34.850448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:34.850448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:34.850448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:34.850448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:34.850448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:34.850448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:34.850448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:34.850448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:34.851984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:34.851984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:34.851984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:34.851984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:34.851984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:34.851984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:34.851984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:34.851984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:34.851984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:34.851984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:34.851984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:34.851984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:34.851984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:34.851984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:34.851984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:34.851984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:34.852810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:34.852810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:34.852810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:34.852810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:34.852810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:34.852810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:34.852810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:34.852810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:34.852810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:34.852810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:34.852810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:34.852810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:34.852810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 171/353] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:34.853544 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e49f8-351f-49f3-9997-da77ca09adb6 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:34.869629 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfe717-5fa8-4a0e-a5dd-ed7b3594d2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:34.870786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfe717-5fa8-4a0e-a5dd-ed7b3594d2a9 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:34.871069 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfe717-5fa8-4a0e-a5dd-ed7b3594d2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:34.871347 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfe717-5fa8-4a0e-a5dd-ed7b3594d2a9 None admin] PATH_INFO: `/v3/groups/36888f067ad24144bda20db8072b790b` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:34.878319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdfe717-5fa8-4a0e-a5dd-ed7b3594d2a9 None admin] RBAC: Authorizing `identity:get_group(group_id=36888f067ad24144bda20db8072b790b)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:34.879927 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdfe717-5fa8-4a0e-a5dd-ed7b3594d2a9 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:34.881794 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 183/354] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 13:39:34 2022] GET /identity/v3/groups/36888f067ad24144bda20db8072b790b => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:34.882635 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfe717-5fa8-4a0e-a5dd-ed7b3594d2a9 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:34.885556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:34.892070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:34.978073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e49f8-351f-49f3-9997-da77ca09adb6 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:35.014232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfe717-5fa8-4a0e-a5dd-ed7b3594d2a9 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:35.025315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c13a04-1ae0-4ab3-8ec9-63c31bade735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:35.025724 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c13a04-1ae0-4ab3-8ec9-63c31bade735 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:35.026012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c13a04-1ae0-4ab3-8ec9-63c31bade735 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:35.026292 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c13a04-1ae0-4ab3-8ec9-63c31bade735 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:35.040013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c13a04-1ae0-4ab3-8ec9-63c31bade735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:35.047766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-b5c13a04-1ae0-4ab3-8ec9-63c31bade735 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 13:39:35.047766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:35.047766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:35.047766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:35.047766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:35.047766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:35.047766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:35.047766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:35.047766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:35.047766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:35.047766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:35.047766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:35.047766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:35.047766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:35.047766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:35.047766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:35.048678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:35.048678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:35.048678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:35.048678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:35.048678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:35.048678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:35.048678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:35.048678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:35.048678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:35.048678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:35.048678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:35.048678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:35.048678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:35.048678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:35.048678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:35.048678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:35.049537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:35.049537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:35.049537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:35.049537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:35.049537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:35.049537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:35.049537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:35.049537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:35.049537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:35.049537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:35.049537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 13:39:35.049537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:35.049537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 172/355] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:35.050232 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c13a04-1ae0-4ab3-8ec9-63c31bade735 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:35.065414 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89394f-d719-45e3-9f40-8983caa94794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:35.066318 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89394f-d719-45e3-9f40-8983caa94794 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:35.066610 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89394f-d719-45e3-9f40-8983caa94794 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:35.066894 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89394f-d719-45e3-9f40-8983caa94794 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:35.078142 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89394f-d719-45e3-9f40-8983caa94794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:35.087702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-3d89394f-d719-45e3-9f40-8983caa94794 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:35.087702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:35.087702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:35.087702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:35.087702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:35.087702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:35.087702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:35.087702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:35.087702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:35.087702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:35.087702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:35.087702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:35.087702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:35.087702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:35.087702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:35.087702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:35.088606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:35.088606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:35.088606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:35.088606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:35.088606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:35.088606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:35.088606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:35.088606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:35.088606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:35.088606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:35.088606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:35.088606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:35.088606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:35.088606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:35.088606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:35.088606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:35.089486 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:35.089486 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:35.089486 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:35.089486 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:35.089486 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:35.089486 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:35.089486 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:35.089486 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:35.089486 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:35.089486 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:35.089486 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:35.089486 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:35.089486 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 184/356] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:39:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:35.090177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637cab4-9026-46e7-b494-3c8b5223312e None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:35.090896 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637cab4-9026-46e7-b494-3c8b5223312e None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:35.090896 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637cab4-9026-46e7-b494-3c8b5223312e None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:35.091929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 185/357] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:35.092614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637cab4-9026-46e7-b494-3c8b5223312e None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:35.162452 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:35.176112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:35.179569 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c13a04-1ae0-4ab3-8ec9-63c31bade735 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:35.217057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637cab4-9026-46e7-b494-3c8b5223312e None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:35.223210 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14f98a-f548-4638-9a06-d35f0cec3301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:35.224078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14f98a-f548-4638-9a06-d35f0cec3301 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:35.224362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14f98a-f548-4638-9a06-d35f0cec3301 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:35.224633 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14f98a-f548-4638-9a06-d35f0cec3301 None admin] PATH_INFO: `/v3/groups/36888f067ad24144bda20db8072b790b` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:35.225883 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14f98a-f548-4638-9a06-d35f0cec3301 None admin] RBAC: Authorizing `identity:get_group(group_id=36888f067ad24144bda20db8072b790b)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:35.227347 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14f98a-f548-4638-9a06-d35f0cec3301 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:35.229142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 173/358] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 13:39:35 2022] GET /identity/v3/groups/36888f067ad24144bda20db8072b790b => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:35.229886 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14f98a-f548-4638-9a06-d35f0cec3301 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:35.260268 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a12d20-a07e-4099-982c-37ca8e9ce4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:35.261176 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a12d20-a07e-4099-982c-37ca8e9ce4c5 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:35.261492 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a12d20-a07e-4099-982c-37ca8e9ce4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:35.261767 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a12d20-a07e-4099-982c-37ca8e9ce4c5 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:35.262504 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a12d20-a07e-4099-982c-37ca8e9ce4c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:35.262808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a12d20-a07e-4099-982c-37ca8e9ce4c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:35.264314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a12d20-a07e-4099-982c-37ca8e9ce4c5 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:35.275086 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 186/359] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:35.275837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a12d20-a07e-4099-982c-37ca8e9ce4c5 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:35.348238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14f98a-f548-4638-9a06-d35f0cec3301 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:35.384453 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e4ee6-064a-4ec4-b1a6-e6916e8ba947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:35.385115 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4ee6-064a-4ec4-b1a6-e6916e8ba947 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:35.385437 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4ee6-064a-4ec4-b1a6-e6916e8ba947 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:35.385715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4ee6-064a-4ec4-b1a6-e6916e8ba947 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:35.386803 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4ee6-064a-4ec4-b1a6-e6916e8ba947 None admin] RBAC: Adding query filter params (group.id=36888f067ad24144bda20db8072b790b, role.id=c7b1597b56ba4b88a4e6ac7689dc83fc, scope.project.id=df7e1b99ff17461db446a994311e1f0f) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:35.387835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4ee6-064a-4ec4-b1a6-e6916e8ba947 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:35.388564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4ee6-064a-4ec4-b1a6-e6916e8ba947 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:35.394750 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 174/360] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 13:39:35 2022] GET /identity/v3/role_assignments?group.id=36888f067ad24144bda20db8072b790b&scope.project.id=df7e1b99ff17461db446a994311e1f0f&role.id=c7b1597b56ba4b88a4e6ac7689dc83fc => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:35.395855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a12d20-a07e-4099-982c-37ca8e9ce4c5 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:35.395970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753f58d-e855-42ad-a5e1-cef2b5760ae2 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:35.396239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753f58d-e855-42ad-a5e1-cef2b5760ae2 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:35.396520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753f58d-e855-42ad-a5e1-cef2b5760ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:35.421084 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a753f58d-e855-42ad-a5e1-cef2b5760ae2 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:35.422571 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a753f58d-e855-42ad-a5e1-cef2b5760ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:35.435508 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:35.443689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:35.446286 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a57219-a1b5-40b4-990b-7ec721576ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:35.447302 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a57219-a1b5-40b4-990b-7ec721576ec2 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:35.447302 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a57219-a1b5-40b4-990b-7ec721576ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:35.447487 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a57219-a1b5-40b4-990b-7ec721576ec2 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:35.448849 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a57219-a1b5-40b4-990b-7ec721576ec2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:35.448849 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a57219-a1b5-40b4-990b-7ec721576ec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:35.449955 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a57219-a1b5-40b4-990b-7ec721576ec2 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:35.464149 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 187/361] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:35.465466 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a57219-a1b5-40b4-990b-7ec721576ec2 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:35.514717 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 175/362] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:35.515151 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753f58d-e855-42ad-a5e1-cef2b5760ae2 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:35.597481 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a57219-a1b5-40b4-990b-7ec721576ec2 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:35.640371 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5b0fa-844a-4416-9f1b-5ab2216d49c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:35.641045 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5b0fa-844a-4416-9f1b-5ab2216d49c7 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:35.641687 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5b0fa-844a-4416-9f1b-5ab2216d49c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:35.641687 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5b0fa-844a-4416-9f1b-5ab2216d49c7 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:35.642375 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5b0fa-844a-4416-9f1b-5ab2216d49c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:35.642682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5b0fa-844a-4416-9f1b-5ab2216d49c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:35.644054 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5b0fa-844a-4416-9f1b-5ab2216d49c7 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:35.651641 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753f58d-e855-42ad-a5e1-cef2b5760ae2 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:35.654165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 188/363] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:39:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:35.655933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5b0fa-844a-4416-9f1b-5ab2216d49c7 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:35.707067 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376ab34-a920-41a4-8374-83e557a83901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:35.707980 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376ab34-a920-41a4-8374-83e557a83901 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:35.708378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376ab34-a920-41a4-8374-83e557a83901 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:35.708659 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376ab34-a920-41a4-8374-83e557a83901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:35.709530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376ab34-a920-41a4-8374-83e557a83901 None admin] RBAC: Adding query filter params (group.id=36888f067ad24144bda20db8072b790b, role.id=e6b3c27ed485430a88f59247935bfa08, scope.project.id=df7e1b99ff17461db446a994311e1f0f) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:35.709839 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376ab34-a920-41a4-8374-83e557a83901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:35.711484 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376ab34-a920-41a4-8374-83e557a83901 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:35.717617 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 176/364] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 13:39:35 2022] GET /identity/v3/role_assignments?group.id=36888f067ad24144bda20db8072b790b&scope.project.id=df7e1b99ff17461db446a994311e1f0f&role.id=e6b3c27ed485430a88f59247935bfa08 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:35.718298 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376ab34-a920-41a4-8374-83e557a83901 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:35.729079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:35.737066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:35.813517 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5b0fa-844a-4416-9f1b-5ab2216d49c7 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:35.840443 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376ab34-a920-41a4-8374-83e557a83901 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:35.867622 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173e000-9c81-46f8-adf6-5f94aed86255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:35.868926 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173e000-9c81-46f8-adf6-5f94aed86255 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:35.869717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173e000-9c81-46f8-adf6-5f94aed86255 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:35.870702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173e000-9c81-46f8-adf6-5f94aed86255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:35.878497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb97689-cf90-42a9-bb79-ddf89c79bbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:35.879391 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb97689-cf90-42a9-bb79-ddf89c79bbb5 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:35.879670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb97689-cf90-42a9-bb79-ddf89c79bbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:35.879947 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb97689-cf90-42a9-bb79-ddf89c79bbb5 None admin] PATH_INFO: `/v3/users/5bcc6b766f5c4e4cb66260ccbe6f5970` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:35.881208 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb97689-cf90-42a9-bb79-ddf89c79bbb5 None admin] RBAC: Authorizing `identity:get_user(user_id=5bcc6b766f5c4e4cb66260ccbe6f5970)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:35.883294 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb97689-cf90-42a9-bb79-ddf89c79bbb5 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:35.885170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 177/365] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:39:35 2022] GET /identity/v3/users/5bcc6b766f5c4e4cb66260ccbe6f5970 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:35.885895 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb97689-cf90-42a9-bb79-ddf89c79bbb5 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:35.958110 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173e000-9c81-46f8-adf6-5f94aed86255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:35.960220 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173e000-9c81-46f8-adf6-5f94aed86255 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:35.977236 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:35.997035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb97689-cf90-42a9-bb79-ddf89c79bbb5 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:36.023922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:36.032157 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee3634-e6a4-4dba-9c47-905078a1731f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:36.033072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee3634-e6a4-4dba-9c47-905078a1731f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:36.033484 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee3634-e6a4-4dba-9c47-905078a1731f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:36.033856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee3634-e6a4-4dba-9c47-905078a1731f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:36.044944 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee3634-e6a4-4dba-9c47-905078a1731f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:36.052893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-7aee3634-e6a4-4dba-9c47-905078a1731f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:39:36.052893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:36.052893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:36.052893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:36.052893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:36.052893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:36.052893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:36.052893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:36.052893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:36.052893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:36.052893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:36.052893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:36.052893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:36.052893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:36.052893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:36.052893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:36.054469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:36.054469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:36.054469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:36.054469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:36.054469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:36.054469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:36.054469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:36.054469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:36.054469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:36.054469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:36.054469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:36.054469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:36.054469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:36.054469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:36.054469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:36.054469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:36.055293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:36.055293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:36.055293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:36.055293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:36.055293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:36.055293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:36.055293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:36.055293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:36.055293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:36.055293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:36.055293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:39:36.055293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:36.055293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 178/366] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:39:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:36.056106 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee3634-e6a4-4dba-9c47-905078a1731f None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:36.086483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 189/367] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:36.088094 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173e000-9c81-46f8-adf6-5f94aed86255 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:36.158724 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee3634-e6a4-4dba-9c47-905078a1731f None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:36.193748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22304c04-63ed-4e81-a36a-5088b3d6aa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:36.194408 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22304c04-63ed-4e81-a36a-5088b3d6aa5d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:36.194692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22304c04-63ed-4e81-a36a-5088b3d6aa5d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:36.194970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22304c04-63ed-4e81-a36a-5088b3d6aa5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:36.199878 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173e000-9c81-46f8-adf6-5f94aed86255 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:36.207716 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:36.239664 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30d162-4ac0-420f-879d-795e0a2a8e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:36.240651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30d162-4ac0-420f-879d-795e0a2a8e75 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:36.241183 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30d162-4ac0-420f-879d-795e0a2a8e75 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:36.242213 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30d162-4ac0-420f-879d-795e0a2a8e75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:36.243222 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30d162-4ac0-420f-879d-795e0a2a8e75 None admin] RBAC: Adding query filter params (role.id=37940959ca5f49c3af8aa8cc5097b00b, user.id=5bcc6b766f5c4e4cb66260ccbe6f5970, scope.system=all) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:36.243726 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30d162-4ac0-420f-879d-795e0a2a8e75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:36.245581 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30d162-4ac0-420f-879d-795e0a2a8e75 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:36.258918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 190/368] 10.222.0.45 () {56 vars in 1308 bytes} [Thu May 26 13:39:36 2022] GET /identity/v3/role_assignments?user.id=5bcc6b766f5c4e4cb66260ccbe6f5970&scope.system=all&role.id=37940959ca5f49c3af8aa8cc5097b00b => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:36.260089 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30d162-4ac0-420f-879d-795e0a2a8e75 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:36.286626 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:36.290530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22304c04-63ed-4e81-a36a-5088b3d6aa5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:36.292372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22304c04-63ed-4e81-a36a-5088b3d6aa5d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:36.461244 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30d162-4ac0-420f-879d-795e0a2a8e75 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:36.473961 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 179/369] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:36.474830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22304c04-63ed-4e81-a36a-5088b3d6aa5d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:36.517861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715dfec-7f0e-4e62-b8c7-61d44a1e281a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:36.519008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715dfec-7f0e-4e62-b8c7-61d44a1e281a None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:36.519542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715dfec-7f0e-4e62-b8c7-61d44a1e281a None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:36.520058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715dfec-7f0e-4e62-b8c7-61d44a1e281a None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:36.521035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715dfec-7f0e-4e62-b8c7-61d44a1e281a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:36.522322 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715dfec-7f0e-4e62-b8c7-61d44a1e281a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:36.525047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715dfec-7f0e-4e62-b8c7-61d44a1e281a None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:36.526520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:36.540529 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 191/370] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:36.542136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715dfec-7f0e-4e62-b8c7-61d44a1e281a None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:36.595982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22304c04-63ed-4e81-a36a-5088b3d6aa5d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:36.640297 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c611335-12fb-4d78-9f59-2d506b0eeead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:36.641564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c611335-12fb-4d78-9f59-2d506b0eeead None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:36.642065 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c611335-12fb-4d78-9f59-2d506b0eeead None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:36.642537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c611335-12fb-4d78-9f59-2d506b0eeead None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:36.644376 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c611335-12fb-4d78-9f59-2d506b0eeead None admin] RBAC: Authorizing `identity:get_project(project_id=954de20b90ec45ea91ae6997825c8772)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:36.645612 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:36.646454 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c611335-12fb-4d78-9f59-2d506b0eeead None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:36.649799 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 180/371] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:36 2022] GET /identity/v3/projects/954de20b90ec45ea91ae6997825c8772 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:36.650682 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c611335-12fb-4d78-9f59-2d506b0eeead None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:36.683881 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715dfec-7f0e-4e62-b8c7-61d44a1e281a None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:36.726548 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709554e-6297-4d87-9e53-e19d09602fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:36.727326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709554e-6297-4d87-9e53-e19d09602fa0 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:36.727611 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709554e-6297-4d87-9e53-e19d09602fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:36.727893 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709554e-6297-4d87-9e53-e19d09602fa0 None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:36.729596 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709554e-6297-4d87-9e53-e19d09602fa0 None admin] RBAC: Authorizing `identity:get_project(project_id=954de20b90ec45ea91ae6997825c8772)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:36.731485 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709554e-6297-4d87-9e53-e19d09602fa0 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:36.734575 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 192/372] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:36 2022] GET /identity/v3/projects/954de20b90ec45ea91ae6997825c8772 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:36.735196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709554e-6297-4d87-9e53-e19d09602fa0 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:36.799596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c611335-12fb-4d78-9f59-2d506b0eeead None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:36.814883 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:36.852265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ecb53-1c15-4329-8096-5829907a3263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:36.854043 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ecb53-1c15-4329-8096-5829907a3263 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:36.854334 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ecb53-1c15-4329-8096-5829907a3263 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:36.854619 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ecb53-1c15-4329-8096-5829907a3263 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:36.882203 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709554e-6297-4d87-9e53-e19d09602fa0 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:36.935321 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592eb3fc-5767-424f-9752-4a1a8a84bb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:36.936797 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592eb3fc-5767-424f-9752-4a1a8a84bb17 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:36.937547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592eb3fc-5767-424f-9752-4a1a8a84bb17 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:36.938437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592eb3fc-5767-424f-9752-4a1a8a84bb17 None admin] PATH_INFO: `/v3/groups/36888f067ad24144bda20db8072b790b` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:36.940152 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592eb3fc-5767-424f-9752-4a1a8a84bb17 None admin] RBAC: Authorizing `identity:get_group(group_id=36888f067ad24144bda20db8072b790b)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:36.942099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592eb3fc-5767-424f-9752-4a1a8a84bb17 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:36.945225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 193/373] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 13:39:36 2022] GET /identity/v3/groups/36888f067ad24144bda20db8072b790b => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:36.946312 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592eb3fc-5767-424f-9752-4a1a8a84bb17 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:36.950175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ecb53-1c15-4329-8096-5829907a3263 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:36.951654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ecb53-1c15-4329-8096-5829907a3263 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:36.959928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:37.083447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592eb3fc-5767-424f-9752-4a1a8a84bb17 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:37.088962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 181/374] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:37.090215 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ecb53-1c15-4329-8096-5829907a3263 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:37.106054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:37.123050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f7e21-0d28-4782-87e1-5892f641543d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:37.124911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f7e21-0d28-4782-87e1-5892f641543d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:37.125196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f7e21-0d28-4782-87e1-5892f641543d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:37.125523 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f7e21-0d28-4782-87e1-5892f641543d None admin] PATH_INFO: `/v3/groups/36888f067ad24144bda20db8072b790b` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:37.126770 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f7e21-0d28-4782-87e1-5892f641543d None admin] RBAC: Authorizing `identity:get_group(group_id=36888f067ad24144bda20db8072b790b)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:37.128214 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f7e21-0d28-4782-87e1-5892f641543d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:37.129942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 194/375] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 13:39:36 2022] GET /identity/v3/groups/36888f067ad24144bda20db8072b790b => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:37.130664 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f7e21-0d28-4782-87e1-5892f641543d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:37.224690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:37.232996 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ecb53-1c15-4329-8096-5829907a3263 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:37.253395 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f7e21-0d28-4782-87e1-5892f641543d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:37.277907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506ef91-e0f4-47d8-9fbc-251a86637346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:37.279012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506ef91-e0f4-47d8-9fbc-251a86637346 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:37.279793 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506ef91-e0f4-47d8-9fbc-251a86637346 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:37.280535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506ef91-e0f4-47d8-9fbc-251a86637346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:37.281725 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506ef91-e0f4-47d8-9fbc-251a86637346 None admin] RBAC: Adding query filter params (group.id=36888f067ad24144bda20db8072b790b, role.id=c7b1597b56ba4b88a4e6ac7689dc83fc, scope.project.id=954de20b90ec45ea91ae6997825c8772) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:37.282224 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506ef91-e0f4-47d8-9fbc-251a86637346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:37.284502 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506ef91-e0f4-47d8-9fbc-251a86637346 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:37.293721 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9655a0-939d-4981-a9bb-21572e493270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:37.293721 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9655a0-939d-4981-a9bb-21572e493270 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:37.293721 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9655a0-939d-4981-a9bb-21572e493270 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:37.293721 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9655a0-939d-4981-a9bb-21572e493270 None admin] PATH_INFO: `/v3/projects/066fbe760dac4adba6eafb0592a4a0b1` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:37.296043 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 182/376] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 13:39:37 2022] GET /identity/v3/role_assignments?group.id=36888f067ad24144bda20db8072b790b&scope.project.id=954de20b90ec45ea91ae6997825c8772&role.id=c7b1597b56ba4b88a4e6ac7689dc83fc => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:37.296043 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506ef91-e0f4-47d8-9fbc-251a86637346 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:37.298401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9655a0-939d-4981-a9bb-21572e493270 None admin] RBAC: Authorizing `identity:get_project(project_id=066fbe760dac4adba6eafb0592a4a0b1)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:37.299583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9655a0-939d-4981-a9bb-21572e493270 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:37.301645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 195/377] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:37 2022] GET /identity/v3/projects/066fbe760dac4adba6eafb0592a4a0b1 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:37.307008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9655a0-939d-4981-a9bb-21572e493270 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:37.452032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9655a0-939d-4981-a9bb-21572e493270 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:37.461428 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:37.500922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe956812-eaa1-435e-b519-2f7051632749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:37.502240 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe956812-eaa1-435e-b519-2f7051632749 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:37.503910 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe956812-eaa1-435e-b519-2f7051632749 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:37.504524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe956812-eaa1-435e-b519-2f7051632749 None admin] PATH_INFO: `/v3/groups/18163a18b6c44977afcbb9a95c821aa0` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:37.517722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506ef91-e0f4-47d8-9fbc-251a86637346 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:37.518681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe956812-eaa1-435e-b519-2f7051632749 None admin] RBAC: Authorizing `identity:get_group(group_id=18163a18b6c44977afcbb9a95c821aa0)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:37.520472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe956812-eaa1-435e-b519-2f7051632749 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:37.533788 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 196/378] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 13:39:37 2022] GET /identity/v3/groups/18163a18b6c44977afcbb9a95c821aa0 => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:37.539282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe956812-eaa1-435e-b519-2f7051632749 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:37.570300 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:37.575068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bced63-d442-4cbd-a15d-a784f8f1af4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:37.575797 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bced63-d442-4cbd-a15d-a784f8f1af4b None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:37.576387 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bced63-d442-4cbd-a15d-a784f8f1af4b None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:37.576387 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bced63-d442-4cbd-a15d-a784f8f1af4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:37.579507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bced63-d442-4cbd-a15d-a784f8f1af4b None admin] RBAC: Adding query filter params (group.id=36888f067ad24144bda20db8072b790b, role.id=e6b3c27ed485430a88f59247935bfa08, scope.project.id=954de20b90ec45ea91ae6997825c8772) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:37.581641 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bced63-d442-4cbd-a15d-a784f8f1af4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:37.584082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bced63-d442-4cbd-a15d-a784f8f1af4b None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:37.603445 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 183/379] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 13:39:37 2022] GET /identity/v3/role_assignments?group.id=36888f067ad24144bda20db8072b790b&scope.project.id=954de20b90ec45ea91ae6997825c8772&role.id=e6b3c27ed485430a88f59247935bfa08 => generated 260 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:37.707985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe956812-eaa1-435e-b519-2f7051632749 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:37.759963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22db12-84d5-4cab-b1cb-eac01c2eeab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:37.760661 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22db12-84d5-4cab-b1cb-eac01c2eeab6 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:37.761211 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22db12-84d5-4cab-b1cb-eac01c2eeab6 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:37.761516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22db12-84d5-4cab-b1cb-eac01c2eeab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:37.762365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22db12-84d5-4cab-b1cb-eac01c2eeab6 None admin] RBAC: Adding query filter params (group.id=18163a18b6c44977afcbb9a95c821aa0, role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.project.id=066fbe760dac4adba6eafb0592a4a0b1) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:37.762681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22db12-84d5-4cab-b1cb-eac01c2eeab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:37.764156 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22db12-84d5-4cab-b1cb-eac01c2eeab6 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:37.770867 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 197/380] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 13:39:37 2022] GET /identity/v3/role_assignments?group.id=18163a18b6c44977afcbb9a95c821aa0&scope.project.id=066fbe760dac4adba6eafb0592a4a0b1&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:37.787149 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373aadde-5cd2-4171-944c-b4b878d927f6 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:37.787491 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373aadde-5cd2-4171-944c-b4b878d927f6 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:37.787717 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373aadde-5cd2-4171-944c-b4b878d927f6 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:37.789452 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 184/381] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:37.795508 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93571d-4b7c-4cd8-a5c9-b41798a5aca2 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:37.796171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93571d-4b7c-4cd8-a5c9-b41798a5aca2 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:37.796658 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93571d-4b7c-4cd8-a5c9-b41798a5aca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:37.825295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-df93571d-4b7c-4cd8-a5c9-b41798a5aca2 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:37.826863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-df93571d-4b7c-4cd8-a5c9-b41798a5aca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:37.905392 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 198/382] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:37.924531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373aadde-5cd2-4171-944c-b4b878d927f6 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:38.047664 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373aadde-5cd2-4171-944c-b4b878d927f6 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:38.084556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aedb86-767a-4ac3-8d7f-cf7cd7d3c6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:38.085839 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aedb86-767a-4ac3-8d7f-cf7cd7d3c6fe None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:38.086335 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aedb86-767a-4ac3-8d7f-cf7cd7d3c6fe None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:38.086809 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aedb86-767a-4ac3-8d7f-cf7cd7d3c6fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:38.095053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:38.099555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aedb86-767a-4ac3-8d7f-cf7cd7d3c6fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:38.107760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-e1aedb86-767a-4ac3-8d7f-cf7cd7d3c6fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:38.107760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:38.107760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:38.107760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:38.107760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:38.107760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:38.107760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:38.107760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:38.107760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:38.107760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:38.107760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:38.107760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:38.107760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:38.107760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:38.107760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:38.107760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:38.108662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:38.108662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:38.108662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:38.108662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:38.108662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:38.108662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:38.108662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:38.108662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:38.108662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:38.108662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:38.108662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:38.108662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:38.108662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:38.108662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:38.108662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:38.108662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:38.109530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:38.109530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:38.109530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:38.109530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:38.109530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:38.109530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:38.109530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:38.109530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:38.109530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:38.109530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:38.109530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:38.109530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:38.117403 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 185/383] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:38.119027 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93571d-4b7c-4cd8-a5c9-b41798a5aca2 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:38.123270 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:38.224094 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe001be2-ad16-486e-93a4-8e9f5a69ad37 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:38.224418 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe001be2-ad16-486e-93a4-8e9f5a69ad37 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:38.224653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe001be2-ad16-486e-93a4-8e9f5a69ad37 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:38.226861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 186/384] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:38.232072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd282f18-6907-4c13-894d-8f822323eea2 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:38.232359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd282f18-6907-4c13-894d-8f822323eea2 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:38.232635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd282f18-6907-4c13-894d-8f822323eea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:38.240986 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93571d-4b7c-4cd8-a5c9-b41798a5aca2 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:38.258298 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-dd282f18-6907-4c13-894d-8f822323eea2 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:38.259495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-dd282f18-6907-4c13-894d-8f822323eea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:38.310656 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52a7ca-11c4-4680-9d70-d84a3307ecf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:38.311247 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52a7ca-11c4-4680-9d70-d84a3307ecf4 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:38.311532 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52a7ca-11c4-4680-9d70-d84a3307ecf4 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:38.311811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52a7ca-11c4-4680-9d70-d84a3307ecf4 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:38.312562 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52a7ca-11c4-4680-9d70-d84a3307ecf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:38.312876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52a7ca-11c4-4680-9d70-d84a3307ecf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:38.314272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52a7ca-11c4-4680-9d70-d84a3307ecf4 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:38.327992 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 199/385] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:38.334350 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52a7ca-11c4-4680-9d70-d84a3307ecf4 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:38.400097 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 187/386] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:39:38.454846 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:38.470721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd282f18-6907-4c13-894d-8f822323eea2 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:38.490681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52a7ca-11c4-4680-9d70-d84a3307ecf4 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:38.527454 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ba39c-2541-41b3-9399-4626a9efcc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:38.528319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ba39c-2541-41b3-9399-4626a9efcc7f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:38.528599 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ba39c-2541-41b3-9399-4626a9efcc7f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:38.528881 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ba39c-2541-41b3-9399-4626a9efcc7f None admin] PATH_INFO: `/v3/groups/36888f067ad24144bda20db8072b790b` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:38.530452 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ba39c-2541-41b3-9399-4626a9efcc7f None admin] RBAC: Authorizing `identity:get_group(group_id=36888f067ad24144bda20db8072b790b)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:38.532015 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ba39c-2541-41b3-9399-4626a9efcc7f None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:38.534004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 200/387] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 13:39:38 2022] GET /identity/v3/groups/36888f067ad24144bda20db8072b790b => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:38.542235 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ba39c-2541-41b3-9399-4626a9efcc7f None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:38.650035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ba39c-2541-41b3-9399-4626a9efcc7f None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:38.693683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:38.700226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356038ce-6b33-49f6-94e3-156fd9c62646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:38.701295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356038ce-6b33-49f6-94e3-156fd9c62646 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:38.701751 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356038ce-6b33-49f6-94e3-156fd9c62646 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:38.702172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356038ce-6b33-49f6-94e3-156fd9c62646 None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:38.703598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356038ce-6b33-49f6-94e3-156fd9c62646 None admin] RBAC: Authorizing `identity:get_project(project_id=df7e1b99ff17461db446a994311e1f0f)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:38.706416 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356038ce-6b33-49f6-94e3-156fd9c62646 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:38.717589 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 201/388] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:38 2022] GET /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:38.726701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356038ce-6b33-49f6-94e3-156fd9c62646 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:38.730041 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd282f18-6907-4c13-894d-8f822323eea2 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:38.766509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:38.774993 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99961378-a7f7-4a81-bb67-b51cda52eaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:38.776119 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99961378-a7f7-4a81-bb67-b51cda52eaf0 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:38.776575 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99961378-a7f7-4a81-bb67-b51cda52eaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:38.777781 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99961378-a7f7-4a81-bb67-b51cda52eaf0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:38.788526 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99961378-a7f7-4a81-bb67-b51cda52eaf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:38.796873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-99961378-a7f7-4a81-bb67-b51cda52eaf0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:38.796873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:38.796873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:38.796873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:38.796873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:38.796873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:38.796873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:38.796873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:38.796873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:38.796873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:38.796873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:38.796873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:38.796873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:38.796873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:38.796873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:38.796873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:38.798015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:38.798015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:38.798015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:38.798015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:38.798015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:38.798015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:38.798015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:38.798015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:38.798015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:38.798015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:38.798015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:38.798015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:38.798015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:38.798015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:38.798015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:38.798015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:38.799013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:38.799013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:38.799013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:38.799013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:38.799013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:38.799013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:38.799013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:38.799013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:38.799013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:38.799013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:38.799013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:38.799013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:38.801018 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 188/389] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:39:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:39:38.807425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99961378-a7f7-4a81-bb67-b51cda52eaf0 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:38.910896 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99961378-a7f7-4a81-bb67-b51cda52eaf0 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:38.948663 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ac245-be85-40c3-ad82-79a20cf84d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:38.951510 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ac245-be85-40c3-ad82-79a20cf84d4d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:38.951946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ac245-be85-40c3-ad82-79a20cf84d4d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:38.954160 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ac245-be85-40c3-ad82-79a20cf84d4d None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:38.956203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ac245-be85-40c3-ad82-79a20cf84d4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:38.957390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ac245-be85-40c3-ad82-79a20cf84d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:38.959130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ac245-be85-40c3-ad82-79a20cf84d4d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:38.978824 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 189/390] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:39:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:38.986670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ac245-be85-40c3-ad82-79a20cf84d4d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:39.003735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356038ce-6b33-49f6-94e3-156fd9c62646 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:39.073952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a41170-a698-4225-b9eb-0b32f0aee24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:39.075095 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a41170-a698-4225-b9eb-0b32f0aee24b None admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:39.077054 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a41170-a698-4225-b9eb-0b32f0aee24b None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:39.078855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a41170-a698-4225-b9eb-0b32f0aee24b None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f/groups/36888f067ad24144bda20db8072b790b/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:39.081653 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a41170-a698-4225-b9eb-0b32f0aee24b None admin] RBAC: Authorizing `identity:create_grant(project_id=df7e1b99ff17461db446a994311e1f0f, group_id=36888f067ad24144bda20db8072b790b, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:39.084934 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a41170-a698-4225-b9eb-0b32f0aee24b None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:39.089888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:39.108659 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 202/391] 10.222.0.45 () {58 vars in 1442 bytes} [Thu May 26 13:39:38 2022] PUT /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f/groups/36888f067ad24144bda20db8072b790b/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:39:39.173398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ac245-be85-40c3-ad82-79a20cf84d4d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:39.217491 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487edddd-2039-4420-b5fc-f19c37bbc36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:39.218673 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487edddd-2039-4420-b5fc-f19c37bbc36c None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:39.219101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487edddd-2039-4420-b5fc-f19c37bbc36c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:39.219523 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487edddd-2039-4420-b5fc-f19c37bbc36c None admin] PATH_INFO: `/v3/groups/36888f067ad24144bda20db8072b790b` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:39.220993 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487edddd-2039-4420-b5fc-f19c37bbc36c None admin] RBAC: Authorizing `identity:get_group(group_id=36888f067ad24144bda20db8072b790b)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:39.222676 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487edddd-2039-4420-b5fc-f19c37bbc36c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:39.229075 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 190/392] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 13:39:38 2022] GET /identity/v3/groups/36888f067ad24144bda20db8072b790b => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:39.231231 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a41170-a698-4225-b9eb-0b32f0aee24b None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:39.324177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:39.370798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a41170-a698-4225-b9eb-0b32f0aee24b None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:39.418026 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656860c-2742-4529-b818-f08d39996a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:39.419167 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656860c-2742-4529-b818-f08d39996a27 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:39.419644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656860c-2742-4529-b818-f08d39996a27 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:39.420064 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656860c-2742-4529-b818-f08d39996a27 None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:39.421744 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656860c-2742-4529-b818-f08d39996a27 None admin] RBAC: Authorizing `identity:get_project(project_id=df7e1b99ff17461db446a994311e1f0f)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:39.423379 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656860c-2742-4529-b818-f08d39996a27 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:39.425816 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 203/393] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:39 2022] GET /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:39.431904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487edddd-2039-4420-b5fc-f19c37bbc36c None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:39.542379 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487edddd-2039-4420-b5fc-f19c37bbc36c None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:39.563303 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:39.577676 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26a9b1-5a54-4f27-ac0d-a0849723685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:39.578559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26a9b1-5a54-4f27-ac0d-a0849723685e None admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:39.578843 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26a9b1-5a54-4f27-ac0d-a0849723685e None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:39.579118 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26a9b1-5a54-4f27-ac0d-a0849723685e None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f/groups/36888f067ad24144bda20db8072b790b/roles/e6b3c27ed485430a88f59247935bfa08` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:39.581340 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26a9b1-5a54-4f27-ac0d-a0849723685e None admin] RBAC: Authorizing `identity:create_grant(project_id=df7e1b99ff17461db446a994311e1f0f, group_id=36888f067ad24144bda20db8072b790b, role_id=e6b3c27ed485430a88f59247935bfa08)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:39.582846 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26a9b1-5a54-4f27-ac0d-a0849723685e None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:39.601319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 191/394] 10.222.0.45 () {58 vars in 1442 bytes} [Thu May 26 13:39:39 2022] PUT /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f/groups/36888f067ad24144bda20db8072b790b/roles/e6b3c27ed485430a88f59247935bfa08 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:39:40.346847 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d084d73-38b5-4c97-a2c9-b7768f863e93 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:40.347384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d084d73-38b5-4c97-a2c9-b7768f863e93 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:40.347384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d084d73-38b5-4c97-a2c9-b7768f863e93 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:40.349017 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 204/395] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:40.354745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09c803-3335-4393-baf1-689ff776f23c None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:40.355037 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09c803-3335-4393-baf1-689ff776f23c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:40.355318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09c803-3335-4393-baf1-689ff776f23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:40.382978 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-1e09c803-3335-4393-baf1-689ff776f23c None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:40.384160 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1e09c803-3335-4393-baf1-689ff776f23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:40.390016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bae2c-2f20-439c-bd1f-addd3aee6822 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:40.390310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bae2c-2f20-439c-bd1f-addd3aee6822 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:40.390597 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bae2c-2f20-439c-bd1f-addd3aee6822 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:40.392238 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 205/396] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:39:40.397060 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3998f-38e2-42e7-96c5-39d3fa8f6780 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:40.397928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3998f-38e2-42e7-96c5-39d3fa8f6780 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:40.398216 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3998f-38e2-42e7-96c5-39d3fa8f6780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:40.415682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-a2d3998f-38e2-42e7-96c5-39d3fa8f6780 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:40.417011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-a2d3998f-38e2-42e7-96c5-39d3fa8f6780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:40.479323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 192/397] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:40.480711 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166ed15-f322-4d0e-8bba-697440094d72 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:40.481004 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166ed15-f322-4d0e-8bba-697440094d72 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:40.481347 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166ed15-f322-4d0e-8bba-697440094d72 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:40.482834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 193/398] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:40.487986 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6027c59-05d4-4ae5-b014-a75a56ebcc84 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:40.488273 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6027c59-05d4-4ae5-b014-a75a56ebcc84 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:40.488553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6027c59-05d4-4ae5-b014-a75a56ebcc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:40.496417 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 206/399] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:39:40.507397 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a6027c59-05d4-4ae5-b014-a75a56ebcc84 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:40.508575 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a6027c59-05d4-4ae5-b014-a75a56ebcc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:40.519087 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3998f-38e2-42e7-96c5-39d3fa8f6780 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:40.587188 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:40.606970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 194/400] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:40.610310 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6027c59-05d4-4ae5-b014-a75a56ebcc84 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:40.656122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3998f-38e2-42e7-96c5-39d3fa8f6780 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:40.658045 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:40.704987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0631f6-d569-4915-a235-324fb65180ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:40.705945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0631f6-d569-4915-a235-324fb65180ac None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:40.706227 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0631f6-d569-4915-a235-324fb65180ac None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:40.706502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0631f6-d569-4915-a235-324fb65180ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:40.723228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0631f6-d569-4915-a235-324fb65180ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:40.734716 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6027c59-05d4-4ae5-b014-a75a56ebcc84 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:40.736005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-1d0631f6-d569-4915-a235-324fb65180ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:40.736005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:40.736005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:40.736005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:40.736005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:40.736005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:40.736005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:40.736005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:40.736005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:40.736005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:40.736005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:40.736005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:40.736005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:40.736005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:40.736005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:40.736005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:40.736883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:40.736883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:40.736883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:40.736883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:40.736883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:40.736883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:40.736883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:40.736883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:40.736883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:40.736883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:40.736883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:40.736883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:40.736883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:40.736883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:40.736883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:40.736883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:40.737750 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:40.737750 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:40.737750 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:40.737750 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:40.737750 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:40.737750 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:40.737750 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:40.737750 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:40.737750 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:40.737750 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:40.737750 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:40.737750 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:40.738913 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 207/401] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:39:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:40.738913 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0631f6-d569-4915-a235-324fb65180ac None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:40.773350 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25374c34-7a54-4d53-a88a-da0be2d5e196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:40.774271 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25374c34-7a54-4d53-a88a-da0be2d5e196 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:40.774470 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25374c34-7a54-4d53-a88a-da0be2d5e196 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:40.774731 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25374c34-7a54-4d53-a88a-da0be2d5e196 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:40.788403 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25374c34-7a54-4d53-a88a-da0be2d5e196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:40.801472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-25374c34-7a54-4d53-a88a-da0be2d5e196 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:40.801472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:40.801472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:40.801472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:40.801472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:40.801472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:40.801472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:40.801472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:40.801472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:40.801472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:40.801472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:40.801472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:40.801472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:40.801472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:40.801472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:40.801472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:40.802377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:40.802377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:40.802377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:40.802377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:40.802377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:40.802377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:40.802377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:40.802377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:40.802377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:40.802377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:40.802377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:40.802377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:40.802377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:40.802377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:40.802377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:40.802377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:40.804127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:40.804127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:40.804127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:40.804127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:40.804127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:40.804127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:40.804127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:40.804127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:40.804127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:40.804127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:40.804127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:40.804127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:40.804127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 195/402] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:40.808526 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25374c34-7a54-4d53-a88a-da0be2d5e196 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:40.857697 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0631f6-d569-4915-a235-324fb65180ac None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:40.876094 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:40.894853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fdd26-b94b-44e0-8d30-a8f63e0cfb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:40.895872 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fdd26-b94b-44e0-8d30-a8f63e0cfb51 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:40.896363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fdd26-b94b-44e0-8d30-a8f63e0cfb51 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:40.896862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fdd26-b94b-44e0-8d30-a8f63e0cfb51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:40.907825 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fdd26-b94b-44e0-8d30-a8f63e0cfb51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:40.915977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-f59fdd26-b94b-44e0-8d30-a8f63e0cfb51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:39:40.915977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:40.915977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:40.915977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:40.915977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:40.915977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:40.915977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:40.915977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:40.915977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:40.915977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:40.915977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:40.915977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:40.915977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:40.915977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:40.915977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:40.915977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:40.916854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:40.916854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:40.916854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:40.916854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:40.916854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:40.916854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:40.916854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:40.916854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:40.916854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:40.916854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:40.916854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:40.916854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:40.916854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:40.916854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:40.916854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:40.916854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:40.917703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:40.917703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:40.917703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:40.917703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:40.917703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:40.917703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:40.917703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:40.917703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:40.917703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:40.917703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:40.917703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:39:40.917703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:40.920472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 208/403] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:39:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:40.921666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fdd26-b94b-44e0-8d30-a8f63e0cfb51 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:40.946163 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:40.953290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25374c34-7a54-4d53-a88a-da0be2d5e196 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:40.995385 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cefef2-bef5-46a4-a8d5-5f1bb0b75f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:40.996107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cefef2-bef5-46a4-a8d5-5f1bb0b75f9b None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:40.996397 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cefef2-bef5-46a4-a8d5-5f1bb0b75f9b None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:40.996679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cefef2-bef5-46a4-a8d5-5f1bb0b75f9b None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:40.997459 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cefef2-bef5-46a4-a8d5-5f1bb0b75f9b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:40.997773 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cefef2-bef5-46a4-a8d5-5f1bb0b75f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:40.999287 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cefef2-bef5-46a4-a8d5-5f1bb0b75f9b None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:41.008197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 196/404] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:39:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:41.009039 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cefef2-bef5-46a4-a8d5-5f1bb0b75f9b None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:41.037131 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fdd26-b94b-44e0-8d30-a8f63e0cfb51 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:41.075911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315f79a-1952-4dfa-9e75-49d5e016c4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:41.076845 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315f79a-1952-4dfa-9e75-49d5e016c4e6 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:41.077304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315f79a-1952-4dfa-9e75-49d5e016c4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:41.077733 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315f79a-1952-4dfa-9e75-49d5e016c4e6 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:41.078653 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315f79a-1952-4dfa-9e75-49d5e016c4e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:41.079150 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315f79a-1952-4dfa-9e75-49d5e016c4e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:41.080736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315f79a-1952-4dfa-9e75-49d5e016c4e6 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:41.094660 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 209/405] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:41.094660 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315f79a-1952-4dfa-9e75-49d5e016c4e6 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:41.135411 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cefef2-bef5-46a4-a8d5-5f1bb0b75f9b None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:41.139029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:41.174856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4feea9-8455-44b4-887b-b120ae832d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:41.175458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4feea9-8455-44b4-887b-b120ae832d74 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:41.175741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4feea9-8455-44b4-887b-b120ae832d74 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:41.176017 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4feea9-8455-44b4-887b-b120ae832d74 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:41.176758 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4feea9-8455-44b4-887b-b120ae832d74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:41.177526 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4feea9-8455-44b4-887b-b120ae832d74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:41.178595 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4feea9-8455-44b4-887b-b120ae832d74 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:41.187607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 197/406] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:41.188422 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4feea9-8455-44b4-887b-b120ae832d74 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:41.215788 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:41.223284 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315f79a-1952-4dfa-9e75-49d5e016c4e6 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:41.265921 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfa7ea-4325-49ca-8ff9-e71125b6ff54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:41.267868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfa7ea-4325-49ca-8ff9-e71125b6ff54 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:41.268377 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfa7ea-4325-49ca-8ff9-e71125b6ff54 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:41.268853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfa7ea-4325-49ca-8ff9-e71125b6ff54 None admin] PATH_INFO: `/v3/groups/36888f067ad24144bda20db8072b790b` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:41.270282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfa7ea-4325-49ca-8ff9-e71125b6ff54 None admin] RBAC: Authorizing `identity:get_group(group_id=36888f067ad24144bda20db8072b790b)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:41.272925 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfa7ea-4325-49ca-8ff9-e71125b6ff54 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:41.275545 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 210/407] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 13:39:41 2022] GET /identity/v3/groups/36888f067ad24144bda20db8072b790b => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:41.276601 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfa7ea-4325-49ca-8ff9-e71125b6ff54 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:41.311119 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4feea9-8455-44b4-887b-b120ae832d74 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:41.349412 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86d99d-d0dd-48e6-963d-7739968e8d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:41.350295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86d99d-d0dd-48e6-963d-7739968e8d0c None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:41.350630 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86d99d-d0dd-48e6-963d-7739968e8d0c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:41.351203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86d99d-d0dd-48e6-963d-7739968e8d0c None admin] PATH_INFO: `/v3/groups/36888f067ad24144bda20db8072b790b` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:41.352785 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86d99d-d0dd-48e6-963d-7739968e8d0c None admin] RBAC: Authorizing `identity:get_group(group_id=36888f067ad24144bda20db8072b790b)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:41.354869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86d99d-d0dd-48e6-963d-7739968e8d0c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:41.362566 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 198/408] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 13:39:41 2022] GET /identity/v3/groups/36888f067ad24144bda20db8072b790b => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:41.362566 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86d99d-d0dd-48e6-963d-7739968e8d0c None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:41.403871 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfa7ea-4325-49ca-8ff9-e71125b6ff54 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:41.419267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:41.448632 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5fcb3-2c58-42d6-a0e4-f896d30cddb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:41.449681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5fcb3-2c58-42d6-a0e4-f896d30cddb3 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:41.450077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5fcb3-2c58-42d6-a0e4-f896d30cddb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:41.450457 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5fcb3-2c58-42d6-a0e4-f896d30cddb3 None admin] PATH_INFO: `/v3/groups/18163a18b6c44977afcbb9a95c821aa0` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:41.451863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5fcb3-2c58-42d6-a0e4-f896d30cddb3 None admin] RBAC: Authorizing `identity:get_group(group_id=18163a18b6c44977afcbb9a95c821aa0)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:41.453426 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5fcb3-2c58-42d6-a0e4-f896d30cddb3 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:41.456298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 211/409] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 13:39:41 2022] GET /identity/v3/groups/18163a18b6c44977afcbb9a95c821aa0 => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:41.457642 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5fcb3-2c58-42d6-a0e4-f896d30cddb3 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:41.470416 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:41.483159 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86d99d-d0dd-48e6-963d-7739968e8d0c None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:41.522014 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ff4d9-b26a-4593-8179-500bd87984ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:41.523471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ff4d9-b26a-4593-8179-500bd87984ea None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:41.523751 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ff4d9-b26a-4593-8179-500bd87984ea None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:41.524030 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ff4d9-b26a-4593-8179-500bd87984ea None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:41.525419 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ff4d9-b26a-4593-8179-500bd87984ea None admin] RBAC: Authorizing `identity:get_project(project_id=954de20b90ec45ea91ae6997825c8772)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:41.526959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ff4d9-b26a-4593-8179-500bd87984ea None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:41.528785 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 199/410] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:41 2022] GET /identity/v3/projects/954de20b90ec45ea91ae6997825c8772 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:41.533539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ff4d9-b26a-4593-8179-500bd87984ea None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:41.588646 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5fcb3-2c58-42d6-a0e4-f896d30cddb3 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:41.626586 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc94917-047d-4a37-95ad-7f42faeb2258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:41.627977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc94917-047d-4a37-95ad-7f42faeb2258 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:41.628489 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc94917-047d-4a37-95ad-7f42faeb2258 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:41.628973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc94917-047d-4a37-95ad-7f42faeb2258 None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:41.630563 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc94917-047d-4a37-95ad-7f42faeb2258 None admin] RBAC: Authorizing `identity:get_project(project_id=954de20b90ec45ea91ae6997825c8772)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:41.632858 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc94917-047d-4a37-95ad-7f42faeb2258 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:41.635315 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 212/411] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:41 2022] GET /identity/v3/projects/954de20b90ec45ea91ae6997825c8772 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:41.636643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc94917-047d-4a37-95ad-7f42faeb2258 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:41.641987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ff4d9-b26a-4593-8179-500bd87984ea None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:41.684607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbec24-513c-413c-94f8-ec69c1f01dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:41.685721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbec24-513c-413c-94f8-ec69c1f01dd2 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:41.686173 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbec24-513c-413c-94f8-ec69c1f01dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:41.686705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbec24-513c-413c-94f8-ec69c1f01dd2 None admin] PATH_INFO: `/v3/projects/066fbe760dac4adba6eafb0592a4a0b1` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:41.688099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:41.688351 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbec24-513c-413c-94f8-ec69c1f01dd2 None admin] RBAC: Authorizing `identity:get_project(project_id=066fbe760dac4adba6eafb0592a4a0b1)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:41.690133 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbec24-513c-413c-94f8-ec69c1f01dd2 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:41.692246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 200/412] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:41 2022] GET /identity/v3/projects/066fbe760dac4adba6eafb0592a4a0b1 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:41.693477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbec24-513c-413c-94f8-ec69c1f01dd2 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:41.724364 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:41.749305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc94917-047d-4a37-95ad-7f42faeb2258 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:41.784834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099f8d1-b5d5-46e3-818a-daa6cfc4ceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:41.785754 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099f8d1-b5d5-46e3-818a-daa6cfc4ceaf None admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:41.786036 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099f8d1-b5d5-46e3-818a-daa6cfc4ceaf None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:41.786320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099f8d1-b5d5-46e3-818a-daa6cfc4ceaf None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772/groups/36888f067ad24144bda20db8072b790b/roles/e6b3c27ed485430a88f59247935bfa08` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:41.788611 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099f8d1-b5d5-46e3-818a-daa6cfc4ceaf None admin] RBAC: Authorizing `identity:create_grant(project_id=954de20b90ec45ea91ae6997825c8772, group_id=36888f067ad24144bda20db8072b790b, role_id=e6b3c27ed485430a88f59247935bfa08)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:41.790088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099f8d1-b5d5-46e3-818a-daa6cfc4ceaf None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:41.802127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbec24-513c-413c-94f8-ec69c1f01dd2 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:41.806628 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 213/413] 10.222.0.45 () {58 vars in 1442 bytes} [Thu May 26 13:39:41 2022] PUT /identity/v3/projects/954de20b90ec45ea91ae6997825c8772/groups/36888f067ad24144bda20db8072b790b/roles/e6b3c27ed485430a88f59247935bfa08 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:39:41.807633 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099f8d1-b5d5-46e3-818a-daa6cfc4ceaf None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:41.843379 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42348414-ca56-42ca-bc2a-4c6dabcd9b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:41.844368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42348414-ca56-42ca-bc2a-4c6dabcd9b29 None admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:41.844955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42348414-ca56-42ca-bc2a-4c6dabcd9b29 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:41.845245 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42348414-ca56-42ca-bc2a-4c6dabcd9b29 None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772/groups/36888f067ad24144bda20db8072b790b/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:41.847794 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42348414-ca56-42ca-bc2a-4c6dabcd9b29 None admin] RBAC: Authorizing `identity:create_grant(project_id=954de20b90ec45ea91ae6997825c8772, group_id=36888f067ad24144bda20db8072b790b, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:41.849309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42348414-ca56-42ca-bc2a-4c6dabcd9b29 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:41.869760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 201/414] 10.222.0.45 () {58 vars in 1442 bytes} [Thu May 26 13:39:41 2022] PUT /identity/v3/projects/954de20b90ec45ea91ae6997825c8772/groups/36888f067ad24144bda20db8072b790b/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:39:41.871276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc79ee-3045-4a57-a391-2812f295e3ff None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:41.871591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc79ee-3045-4a57-a391-2812f295e3ff None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:41.871959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc79ee-3045-4a57-a391-2812f295e3ff None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:41.877839 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 202/415] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:41.883544 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18a04c-6540-47a0-9239-cdc8ef7a474c None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:41.884238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18a04c-6540-47a0-9239-cdc8ef7a474c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:41.884743 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18a04c-6540-47a0-9239-cdc8ef7a474c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:41.923759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-0a18a04c-6540-47a0-9239-cdc8ef7a474c None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:41.926992 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-0a18a04c-6540-47a0-9239-cdc8ef7a474c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:42.028033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 203/416] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:42.035130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099f8d1-b5d5-46e3-818a-daa6cfc4ceaf None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:42.038917 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:42.077651 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18a04c-6540-47a0-9239-cdc8ef7a474c None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:42.087289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f34124-bd30-4aeb-86a5-f3895d076e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:42.088186 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f34124-bd30-4aeb-86a5-f3895d076e95 None admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:42.088469 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f34124-bd30-4aeb-86a5-f3895d076e95 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:42.088745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f34124-bd30-4aeb-86a5-f3895d076e95 None admin] PATH_INFO: `/v3/projects/066fbe760dac4adba6eafb0592a4a0b1/groups/18163a18b6c44977afcbb9a95c821aa0/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:42.090893 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f34124-bd30-4aeb-86a5-f3895d076e95 None admin] RBAC: Authorizing `identity:create_grant(project_id=066fbe760dac4adba6eafb0592a4a0b1, group_id=18163a18b6c44977afcbb9a95c821aa0, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:42.092319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f34124-bd30-4aeb-86a5-f3895d076e95 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:42.104717 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:42.111622 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 214/417] 10.222.0.45 () {58 vars in 1442 bytes} [Thu May 26 13:39:41 2022] PUT /identity/v3/projects/066fbe760dac4adba6eafb0592a4a0b1/groups/18163a18b6c44977afcbb9a95c821aa0/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:39:42.213499 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18a04c-6540-47a0-9239-cdc8ef7a474c None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:42.261499 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d9870-cb8e-4c9b-8d95-90030169fd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:42.262315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d9870-cb8e-4c9b-8d95-90030169fd7f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:42.262598 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d9870-cb8e-4c9b-8d95-90030169fd7f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:42.262874 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d9870-cb8e-4c9b-8d95-90030169fd7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:42.279503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d9870-cb8e-4c9b-8d95-90030169fd7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:42.287464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-323d9870-cb8e-4c9b-8d95-90030169fd7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:42.287464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:42.287464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:42.287464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:42.287464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:42.287464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:42.287464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:42.287464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:42.287464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:42.287464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:42.287464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:42.287464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:42.287464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:42.287464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:42.287464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:42.287464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:42.288398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:42.288398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:42.288398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:42.288398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:42.288398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:42.288398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:42.288398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:42.288398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:42.288398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:42.288398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:42.288398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:42.288398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:42.288398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:42.288398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:42.288398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:42.288398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:42.289213 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:42.289213 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:42.289213 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:42.289213 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:42.289213 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:42.289213 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:42.289213 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:42.289213 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:42.289213 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:42.289213 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:42.289213 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:42.289213 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:42.291410 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 204/418] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:42.296448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f34124-bd30-4aeb-86a5-f3895d076e95 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:42.351939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326c334-7a1e-42ed-95a9-7cbb5d388eb1 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:42.352317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326c334-7a1e-42ed-95a9-7cbb5d388eb1 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:42.352512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326c334-7a1e-42ed-95a9-7cbb5d388eb1 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:42.354180 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 205/419] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:39:42.360576 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff253f-00cc-435c-9e83-3cc09d0dd034 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:42.360850 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff253f-00cc-435c-9e83-3cc09d0dd034 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:42.361132 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff253f-00cc-435c-9e83-3cc09d0dd034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:42.383258 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-6bff253f-00cc-435c-9e83-3cc09d0dd034 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:42.384468 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6bff253f-00cc-435c-9e83-3cc09d0dd034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:42.431584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f34124-bd30-4aeb-86a5-f3895d076e95 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:42.476205 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d5044-aa64-4348-90a1-e3198969caef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:42.476874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d5044-aa64-4348-90a1-e3198969caef None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:42.477159 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d5044-aa64-4348-90a1-e3198969caef None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:42.477482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d5044-aa64-4348-90a1-e3198969caef None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:42.478232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d5044-aa64-4348-90a1-e3198969caef None admin] RBAC: Adding query filter params (name=member) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:42.478540 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d5044-aa64-4348-90a1-e3198969caef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:42.479895 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d5044-aa64-4348-90a1-e3198969caef None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:42.489498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 215/420] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:42.495426 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d5044-aa64-4348-90a1-e3198969caef None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:42.498979 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 206/421] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:42.524948 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:42.540381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff253f-00cc-435c-9e83-3cc09d0dd034 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:42.559056 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:42.660647 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d5044-aa64-4348-90a1-e3198969caef None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:42.730541 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29ef4e-ac2e-49cb-87ab-7422d60790ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:42.731199 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29ef4e-ac2e-49cb-87ab-7422d60790ff None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:42.731490 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29ef4e-ac2e-49cb-87ab-7422d60790ff None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:42.731769 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29ef4e-ac2e-49cb-87ab-7422d60790ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:42.747168 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff253f-00cc-435c-9e83-3cc09d0dd034 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:42.809039 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884c950-fb37-46a0-9d44-e50f4dd31abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:42.810335 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884c950-fb37-46a0-9d44-e50f4dd31abd None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:42.810842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884c950-fb37-46a0-9d44-e50f4dd31abd None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:42.811367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884c950-fb37-46a0-9d44-e50f4dd31abd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:42.823658 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29ef4e-ac2e-49cb-87ab-7422d60790ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:42.825189 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29ef4e-ac2e-49cb-87ab-7422d60790ff None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:42.839658 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884c950-fb37-46a0-9d44-e50f4dd31abd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:42.848476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-9884c950-fb37-46a0-9d44-e50f4dd31abd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:42.848476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:42.848476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:42.848476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:42.848476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:42.848476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:42.848476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:42.848476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:42.848476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:42.848476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:42.848476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:42.848476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:42.848476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:42.848476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:42.848476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:42.848476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:42.849434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:42.849434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:42.849434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:42.849434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:42.849434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:42.849434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:42.849434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:42.849434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:42.849434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:42.849434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:42.849434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:42.849434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:42.849434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:42.849434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:42.849434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:42.849434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:42.850815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:42.850815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:42.850815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:42.850815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:42.850815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:42.850815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:42.850815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:42.850815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:42.850815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:42.850815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:42.850815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:42.850815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:42.859278 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:42.860477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 207/422] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:39:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:39:42.867937 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884c950-fb37-46a0-9d44-e50f4dd31abd None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:42.933730 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 216/423] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:42.939386 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29ef4e-ac2e-49cb-87ab-7422d60790ff None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:42.993614 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:43.033116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884c950-fb37-46a0-9d44-e50f4dd31abd None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:43.080266 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55230fef-8edf-4971-b4b7-51bb38565774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:43.080850 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55230fef-8edf-4971-b4b7-51bb38565774 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:43.081134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55230fef-8edf-4971-b4b7-51bb38565774 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:43.081440 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55230fef-8edf-4971-b4b7-51bb38565774 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:43.082183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55230fef-8edf-4971-b4b7-51bb38565774 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:43.082491 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55230fef-8edf-4971-b4b7-51bb38565774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:43.083855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55230fef-8edf-4971-b4b7-51bb38565774 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:43.108600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 208/424] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:39:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:43.130945 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55230fef-8edf-4971-b4b7-51bb38565774 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:43.155590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29ef4e-ac2e-49cb-87ab-7422d60790ff None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:43.192085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:43.211055 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae839f-a0c6-4b32-b4ca-680a44012bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:43.211937 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae839f-a0c6-4b32-b4ca-680a44012bdd None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:43.212220 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae839f-a0c6-4b32-b4ca-680a44012bdd None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:43.212496 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae839f-a0c6-4b32-b4ca-680a44012bdd None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:43.218243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae839f-a0c6-4b32-b4ca-680a44012bdd None admin] RBAC: Authorizing `identity:get_project(project_id=df7e1b99ff17461db446a994311e1f0f)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:43.219729 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae839f-a0c6-4b32-b4ca-680a44012bdd None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:43.221579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 217/425] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:42 2022] GET /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:43.227294 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae839f-a0c6-4b32-b4ca-680a44012bdd None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:43.287989 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55230fef-8edf-4971-b4b7-51bb38565774 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:43.332983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae839f-a0c6-4b32-b4ca-680a44012bdd None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:43.341586 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:43.353121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16485982-3569-4904-8258-bee157998fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:43.353796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16485982-3569-4904-8258-bee157998fb0 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:43.354078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16485982-3569-4904-8258-bee157998fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:43.354355 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16485982-3569-4904-8258-bee157998fb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:43.428932 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dbde4-f634-4b54-988b-b7b4d3947a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:43.429894 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dbde4-f634-4b54-988b-b7b4d3947a9f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:43.430394 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dbde4-f634-4b54-988b-b7b4d3947a9f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:43.430675 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dbde4-f634-4b54-988b-b7b4d3947a9f None admin] PATH_INFO: `/v3/groups/36888f067ad24144bda20db8072b790b` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:43.433606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dbde4-f634-4b54-988b-b7b4d3947a9f None admin] RBAC: Authorizing `identity:get_group(group_id=36888f067ad24144bda20db8072b790b)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:43.435038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dbde4-f634-4b54-988b-b7b4d3947a9f None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:43.441112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 218/426] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 13:39:43 2022] GET /identity/v3/groups/36888f067ad24144bda20db8072b790b => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:43.446290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dbde4-f634-4b54-988b-b7b4d3947a9f None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:43.464726 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16485982-3569-4904-8258-bee157998fb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:43.466342 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16485982-3569-4904-8258-bee157998fb0 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:43.556062 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:43.599253 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 209/427] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 13:39:43.605043 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16485982-3569-4904-8258-bee157998fb0 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:43.611913 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dbde4-f634-4b54-988b-b7b4d3947a9f None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:43.636423 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:43.647950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df22b00-9f79-47b2-9789-e9de97bf894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:43.648612 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df22b00-9f79-47b2-9789-e9de97bf894f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:43.648904 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df22b00-9f79-47b2-9789-e9de97bf894f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:43.649366 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df22b00-9f79-47b2-9789-e9de97bf894f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:43.650207 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df22b00-9f79-47b2-9789-e9de97bf894f None admin] RBAC: Adding query filter params (group.id=36888f067ad24144bda20db8072b790b, role.id=c7b1597b56ba4b88a4e6ac7689dc83fc, scope.project.id=df7e1b99ff17461db446a994311e1f0f) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:43.650521 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df22b00-9f79-47b2-9789-e9de97bf894f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:43.651947 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df22b00-9f79-47b2-9789-e9de97bf894f None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:43.667238 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 219/428] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 13:39:43 2022] GET /identity/v3/role_assignments?group.id=36888f067ad24144bda20db8072b790b&scope.project.id=df7e1b99ff17461db446a994311e1f0f&role.id=c7b1597b56ba4b88a4e6ac7689dc83fc => generated 611 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:43.723499 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16485982-3569-4904-8258-bee157998fb0 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:43.762147 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0d637-9a40-4f12-8b63-46956f14cb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:43.763370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0d637-9a40-4f12-8b63-46956f14cb75 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:43.763849 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0d637-9a40-4f12-8b63-46956f14cb75 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:43.764331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0d637-9a40-4f12-8b63-46956f14cb75 None admin] PATH_INFO: `/v3/projects/df7e1b99ff17461db446a994311e1f0f` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:43.765752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0d637-9a40-4f12-8b63-46956f14cb75 None admin] RBAC: Authorizing `identity:get_project(project_id=df7e1b99ff17461db446a994311e1f0f)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:43.767456 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0d637-9a40-4f12-8b63-46956f14cb75 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:43.769706 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 210/429] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:43 2022] GET /identity/v3/projects/df7e1b99ff17461db446a994311e1f0f => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:43.775327 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df22b00-9f79-47b2-9789-e9de97bf894f None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:43.918067 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df22b00-9f79-47b2-9789-e9de97bf894f None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:43.945659 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:43.956136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4c007-cb2c-494c-a558-4bcec3612a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:43.956997 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4c007-cb2c-494c-a558-4bcec3612a3b None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:43.957295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4c007-cb2c-494c-a558-4bcec3612a3b None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:43.957596 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4c007-cb2c-494c-a558-4bcec3612a3b None admin] PATH_INFO: `/v3/groups/36888f067ad24144bda20db8072b790b` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:43.958776 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4c007-cb2c-494c-a558-4bcec3612a3b None admin] RBAC: Authorizing `identity:get_group(group_id=36888f067ad24144bda20db8072b790b)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:43.960734 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4c007-cb2c-494c-a558-4bcec3612a3b None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:43.962703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 220/430] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 13:39:43 2022] GET /identity/v3/groups/36888f067ad24144bda20db8072b790b => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:43.968263 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0d637-9a40-4f12-8b63-46956f14cb75 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:44.078198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:44.083770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0d637-9a40-4f12-8b63-46956f14cb75 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:44.123203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b04ca-79e1-4810-9650-adb7df1cecb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:44.123860 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b04ca-79e1-4810-9650-adb7df1cecb4 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:44.124145 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b04ca-79e1-4810-9650-adb7df1cecb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:44.124424 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b04ca-79e1-4810-9650-adb7df1cecb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:44.125249 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b04ca-79e1-4810-9650-adb7df1cecb4 None admin] RBAC: Adding query filter params (group.id=36888f067ad24144bda20db8072b790b, role.id=e6b3c27ed485430a88f59247935bfa08, scope.project.id=df7e1b99ff17461db446a994311e1f0f) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:44.125592 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b04ca-79e1-4810-9650-adb7df1cecb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:44.127084 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b04ca-79e1-4810-9650-adb7df1cecb4 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:44.133515 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 211/431] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 13:39:43 2022] GET /identity/v3/role_assignments?group.id=36888f067ad24144bda20db8072b790b&scope.project.id=df7e1b99ff17461db446a994311e1f0f&role.id=e6b3c27ed485430a88f59247935bfa08 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:44.450998 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d97e73-32e3-4373-ae3e-af5c1f65a0fd None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:44.451528 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d97e73-32e3-4373-ae3e-af5c1f65a0fd None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:44.451528 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d97e73-32e3-4373-ae3e-af5c1f65a0fd None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:44.453083 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 221/432] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:44.458841 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ae156-f1fa-4bde-b75c-69b3508f44f4 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:44.459391 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ae156-f1fa-4bde-b75c-69b3508f44f4 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:44.460476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ae156-f1fa-4bde-b75c-69b3508f44f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:44.478238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-dd6ae156-f1fa-4bde-b75c-69b3508f44f4 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:44.479773 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-dd6ae156-f1fa-4bde-b75c-69b3508f44f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:44.551472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 212/433] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:44.574719 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d97e73-32e3-4373-ae3e-af5c1f65a0fd None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:44.581933 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006287d-4dc1-4718-946a-906f28c19ccc None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:44.582224 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006287d-4dc1-4718-946a-906f28c19ccc None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:44.582511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006287d-4dc1-4718-946a-906f28c19ccc None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:44.586091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 213/434] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:39:44.591143 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddfcc1-3367-4d86-a6ba-4df2cc064a5c None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:44.591478 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddfcc1-3367-4d86-a6ba-4df2cc064a5c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:44.591710 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddfcc1-3367-4d86-a6ba-4df2cc064a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:44.610249 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-2cddfcc1-3367-4d86-a6ba-4df2cc064a5c None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:44.611452 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-2cddfcc1-3367-4d86-a6ba-4df2cc064a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:44.701559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d97e73-32e3-4373-ae3e-af5c1f65a0fd None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:44.710769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 214/435] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:39:44.736401 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddfcc1-3367-4d86-a6ba-4df2cc064a5c None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:44.742560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc979838-c5ee-4aeb-b051-daef4d6ef63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:44.743353 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc979838-c5ee-4aeb-b051-daef4d6ef63f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:44.743631 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc979838-c5ee-4aeb-b051-daef4d6ef63f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:44.743907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc979838-c5ee-4aeb-b051-daef4d6ef63f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:44.759037 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc979838-c5ee-4aeb-b051-daef4d6ef63f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:44.761215 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:44.769133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-fc979838-c5ee-4aeb-b051-daef4d6ef63f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:44.769133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:44.769133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:44.769133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:44.769133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:44.769133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:44.769133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:44.769133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:44.769133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:44.769133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:44.769133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:44.769133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:44.769133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:44.769133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:44.769133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:44.769133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:44.770393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:44.770393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:44.770393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:44.770393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:44.770393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:44.770393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:44.770393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:44.770393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:44.770393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:44.770393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:44.770393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:44.770393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:44.770393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:44.770393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:44.770393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:44.770393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:44.771388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:44.771388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:44.771388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:44.771388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:44.771388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:44.771388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:44.771388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:44.771388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:44.771388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:44.771388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:44.771388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 13:39:44.771388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:44.773355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 222/436] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:44.775199 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc7f84-d5a6-4a10-a725-00ea52b46b07 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:44.775491 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc7f84-d5a6-4a10-a725-00ea52b46b07 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:44.775768 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc7f84-d5a6-4a10-a725-00ea52b46b07 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:44.779036 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 223/437] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:44.779036 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc7f84-d5a6-4a10-a725-00ea52b46b07 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:44.837510 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:44.846974 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddfcc1-3367-4d86-a6ba-4df2cc064a5c None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:44.880501 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25019eec-0608-45fe-addb-55c9ad17d6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:44.881335 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25019eec-0608-45fe-addb-55c9ad17d6df None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:44.881618 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25019eec-0608-45fe-addb-55c9ad17d6df None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:44.881897 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25019eec-0608-45fe-addb-55c9ad17d6df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:44.882726 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc7f84-d5a6-4a10-a725-00ea52b46b07 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:44.892426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25019eec-0608-45fe-addb-55c9ad17d6df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:44.901101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-25019eec-0608-45fe-addb-55c9ad17d6df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:44.901101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:44.901101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:44.901101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:44.901101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:44.901101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:44.901101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:44.901101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:44.901101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:44.901101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:44.901101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:44.901101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:44.901101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:44.901101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:44.901101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:44.901101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:44.902053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:44.902053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:44.902053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:44.902053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:44.902053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:44.902053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:44.902053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:44.902053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:44.902053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:44.902053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:44.902053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:44.902053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:44.902053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:44.902053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:44.902053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:44.902053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:44.902904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:44.902904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:44.902904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:44.902904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:44.902904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:44.902904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:44.902904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:44.902904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:44.902904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:44.902904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:44.902904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:44.902904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:44.902904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 215/438] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:39:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:39:44.903705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007f370-be7b-4443-9a5d-7259fe4f882c None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:44.903705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007f370-be7b-4443-9a5d-7259fe4f882c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:44.903983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007f370-be7b-4443-9a5d-7259fe4f882c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:44.919155 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8256223-e55e-41b4-b9ac-47f0294781fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:44.919821 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8256223-e55e-41b4-b9ac-47f0294781fd None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:44.920107 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8256223-e55e-41b4-b9ac-47f0294781fd None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:44.920301 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a007f370-be7b-4443-9a5d-7259fe4f882c None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:44.920392 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8256223-e55e-41b4-b9ac-47f0294781fd None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:44.921111 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8256223-e55e-41b4-b9ac-47f0294781fd None admin] RBAC: Adding query filter params (name=member) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:44.921450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8256223-e55e-41b4-b9ac-47f0294781fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:44.921586 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a007f370-be7b-4443-9a5d-7259fe4f882c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:44.922817 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8256223-e55e-41b4-b9ac-47f0294781fd None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:44.931317 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 224/439] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:39:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:44.932105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8256223-e55e-41b4-b9ac-47f0294781fd None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:44.987641 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 216/440] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:44.988387 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007f370-be7b-4443-9a5d-7259fe4f882c None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:45.007275 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:45.034332 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8256223-e55e-41b4-b9ac-47f0294781fd None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:45.050303 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:45.068764 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66b57a-f581-4a3f-a481-f7706401b7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:45.069963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66b57a-f581-4a3f-a481-f7706401b7c4 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:45.070251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66b57a-f581-4a3f-a481-f7706401b7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:45.070525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66b57a-f581-4a3f-a481-f7706401b7c4 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:45.071268 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66b57a-f581-4a3f-a481-f7706401b7c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:45.071578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66b57a-f581-4a3f-a481-f7706401b7c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:45.073031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66b57a-f581-4a3f-a481-f7706401b7c4 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:45.080872 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 225/441] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:39:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:45.081678 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66b57a-f581-4a3f-a481-f7706401b7c4 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:45.094887 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007f370-be7b-4443-9a5d-7259fe4f882c None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:45.128816 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033bd89-a99c-4974-9fa1-a0fa0360a3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:45.129481 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033bd89-a99c-4974-9fa1-a0fa0360a3a4 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:45.129758 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033bd89-a99c-4974-9fa1-a0fa0360a3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:45.130033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033bd89-a99c-4974-9fa1-a0fa0360a3a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:45.179579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66b57a-f581-4a3f-a481-f7706401b7c4 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:45.195360 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033bd89-a99c-4974-9fa1-a0fa0360a3a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:45.196820 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033bd89-a99c-4974-9fa1-a0fa0360a3a4 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:45.207539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:45.213385 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56a4e4-a2e2-48c9-ae10-92e5b3e918ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:45.214165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56a4e4-a2e2-48c9-ae10-92e5b3e918ae None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:45.214450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56a4e4-a2e2-48c9-ae10-92e5b3e918ae None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:45.214726 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56a4e4-a2e2-48c9-ae10-92e5b3e918ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:45.224538 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56a4e4-a2e2-48c9-ae10-92e5b3e918ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:45.232133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-ae56a4e4-a2e2-48c9-ae10-92e5b3e918ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:39:45.232133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:45.232133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:45.232133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:45.232133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:45.232133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:45.232133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:45.232133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:45.232133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:45.232133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:45.232133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:45.232133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:45.232133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:45.232133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:45.232133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:45.232133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:45.233033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:45.233033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:45.233033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:45.233033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:45.233033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:45.233033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:45.233033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:45.233033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:45.233033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:45.233033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:45.233033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:45.233033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:45.233033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:45.233033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:45.233033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:45.233033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:45.233885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:45.233885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:45.233885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:45.233885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:45.233885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:45.233885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:45.233885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:45.233885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:45.233885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:45.233885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:45.233885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:39:45.233885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:45.233885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 226/442] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:39:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:45.234573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56a4e4-a2e2-48c9-ae10-92e5b3e918ae None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:45.273408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:45.296366 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 217/443] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:45.297392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033bd89-a99c-4974-9fa1-a0fa0360a3a4 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:45.335599 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56a4e4-a2e2-48c9-ae10-92e5b3e918ae None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:45.367518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4643f48-8d93-4d59-b646-925e23cbd94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:45.368158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4643f48-8d93-4d59-b646-925e23cbd94d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:45.368437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4643f48-8d93-4d59-b646-925e23cbd94d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:45.368709 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4643f48-8d93-4d59-b646-925e23cbd94d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:45.394664 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033bd89-a99c-4974-9fa1-a0fa0360a3a4 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:45.404889 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:45.429679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0dc70-fd16-41c8-886c-bec27be9c8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:45.430336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0dc70-fd16-41c8-886c-bec27be9c8a3 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:45.430619 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0dc70-fd16-41c8-886c-bec27be9c8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:45.430894 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0dc70-fd16-41c8-886c-bec27be9c8a3 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:45.431626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0dc70-fd16-41c8-886c-bec27be9c8a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:45.431931 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0dc70-fd16-41c8-886c-bec27be9c8a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:45.433331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0dc70-fd16-41c8-886c-bec27be9c8a3 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:45.437678 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4643f48-8d93-4d59-b646-925e23cbd94d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:45.439442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4643f48-8d93-4d59-b646-925e23cbd94d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:45.442518 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 218/444] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:45.443114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0dc70-fd16-41c8-886c-bec27be9c8a3 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:45.478310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:45.538677 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 227/445] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:45.539261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0dc70-fd16-41c8-886c-bec27be9c8a3 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:45.539501 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4643f48-8d93-4d59-b646-925e23cbd94d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:45.575795 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1763fb6-b36a-4698-b27e-0e0a7d560ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:45.576635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1763fb6-b36a-4698-b27e-0e0a7d560ffe None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:45.576913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1763fb6-b36a-4698-b27e-0e0a7d560ffe None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:45.577189 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1763fb6-b36a-4698-b27e-0e0a7d560ffe None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:45.578371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1763fb6-b36a-4698-b27e-0e0a7d560ffe None admin] RBAC: Authorizing `identity:get_project(project_id=954de20b90ec45ea91ae6997825c8772)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:45.579784 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1763fb6-b36a-4698-b27e-0e0a7d560ffe None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:45.581452 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 219/446] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:45 2022] GET /identity/v3/projects/954de20b90ec45ea91ae6997825c8772 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:45.582271 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1763fb6-b36a-4698-b27e-0e0a7d560ffe None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:45.621920 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:45.636986 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4643f48-8d93-4d59-b646-925e23cbd94d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:45.669261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f3e03-2db1-4dd7-aa3b-657955def4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:45.669942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f3e03-2db1-4dd7-aa3b-657955def4ac None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:45.670231 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f3e03-2db1-4dd7-aa3b-657955def4ac None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:45.670510 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f3e03-2db1-4dd7-aa3b-657955def4ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:45.679163 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:45.685464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1763fb6-b36a-4698-b27e-0e0a7d560ffe None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:45.718602 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73d808-3785-4c4b-890a-03e6d584a687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:45.719460 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73d808-3785-4c4b-890a-03e6d584a687 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:45.719750 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73d808-3785-4c4b-890a-03e6d584a687 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:45.720025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73d808-3785-4c4b-890a-03e6d584a687 None admin] PATH_INFO: `/v3/projects/954de20b90ec45ea91ae6997825c8772` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:45.721214 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73d808-3785-4c4b-890a-03e6d584a687 None admin] RBAC: Authorizing `identity:get_project(project_id=954de20b90ec45ea91ae6997825c8772)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:45.722675 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73d808-3785-4c4b-890a-03e6d584a687 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:45.724354 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 220/447] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:45 2022] GET /identity/v3/projects/954de20b90ec45ea91ae6997825c8772 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:45.725671 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73d808-3785-4c4b-890a-03e6d584a687 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:45.744027 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f3e03-2db1-4dd7-aa3b-657955def4ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:45.745524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f3e03-2db1-4dd7-aa3b-657955def4ac None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:45.823456 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73d808-3785-4c4b-890a-03e6d584a687 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:45.831997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:45.842728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 228/448] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:45.843563 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f3e03-2db1-4dd7-aa3b-657955def4ac None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:45.858969 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c35c3a-9747-461d-9b30-6fe617f5a615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:45.859817 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35c3a-9747-461d-9b30-6fe617f5a615 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:45.860098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35c3a-9747-461d-9b30-6fe617f5a615 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:45.860381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35c3a-9747-461d-9b30-6fe617f5a615 None admin] PATH_INFO: `/v3/groups/36888f067ad24144bda20db8072b790b` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:45.861576 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c35c3a-9747-461d-9b30-6fe617f5a615 None admin] RBAC: Authorizing `identity:get_group(group_id=36888f067ad24144bda20db8072b790b)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:45.863031 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c35c3a-9747-461d-9b30-6fe617f5a615 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:45.864630 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 221/449] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 13:39:45 2022] GET /identity/v3/groups/36888f067ad24144bda20db8072b790b => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:45.865401 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c35c3a-9747-461d-9b30-6fe617f5a615 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:45.886304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:45.944929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f3e03-2db1-4dd7-aa3b-657955def4ac None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:45.962931 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c35c3a-9747-461d-9b30-6fe617f5a615 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:45.979583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e22b70-fb33-4f93-a6ce-4abe82b4a7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:45.980435 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e22b70-fb33-4f93-a6ce-4abe82b4a7b6 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:45.980718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e22b70-fb33-4f93-a6ce-4abe82b4a7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:45.981107 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e22b70-fb33-4f93-a6ce-4abe82b4a7b6 None admin] PATH_INFO: `/v3/groups/36888f067ad24144bda20db8072b790b` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:45.982317 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e22b70-fb33-4f93-a6ce-4abe82b4a7b6 None admin] RBAC: Authorizing `identity:get_group(group_id=36888f067ad24144bda20db8072b790b)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:45.983713 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e22b70-fb33-4f93-a6ce-4abe82b4a7b6 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:45.985362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 229/450] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 13:39:45 2022] GET /identity/v3/groups/36888f067ad24144bda20db8072b790b => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:45.986129 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e22b70-fb33-4f93-a6ce-4abe82b4a7b6 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:45.995701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a2c2f-1611-4bd5-9ebd-0015b29a76b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:45.996562 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a2c2f-1611-4bd5-9ebd-0015b29a76b3 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:45.996842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a2c2f-1611-4bd5-9ebd-0015b29a76b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:45.997115 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a2c2f-1611-4bd5-9ebd-0015b29a76b3 None admin] PATH_INFO: `/v3/projects/066fbe760dac4adba6eafb0592a4a0b1` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:45.998601 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a2c2f-1611-4bd5-9ebd-0015b29a76b3 None admin] RBAC: Authorizing `identity:get_project(project_id=066fbe760dac4adba6eafb0592a4a0b1)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:46.000028 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a2c2f-1611-4bd5-9ebd-0015b29a76b3 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:46.001852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 222/451] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:39:45 2022] GET /identity/v3/projects/066fbe760dac4adba6eafb0592a4a0b1 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:46.002467 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a2c2f-1611-4bd5-9ebd-0015b29a76b3 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:46.047892 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:46.087166 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e22b70-fb33-4f93-a6ce-4abe82b4a7b6 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:46.094522 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:46.106029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a2c2f-1611-4bd5-9ebd-0015b29a76b3 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:46.121881 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27f88a-1862-4a0f-96fa-fcd9f361441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:46.122538 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27f88a-1862-4a0f-96fa-fcd9f361441f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:46.122823 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27f88a-1862-4a0f-96fa-fcd9f361441f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:46.123101 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27f88a-1862-4a0f-96fa-fcd9f361441f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:46.123929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27f88a-1862-4a0f-96fa-fcd9f361441f None admin] RBAC: Adding query filter params (group.id=36888f067ad24144bda20db8072b790b, role.id=c7b1597b56ba4b88a4e6ac7689dc83fc, scope.project.id=954de20b90ec45ea91ae6997825c8772) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:46.124244 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27f88a-1862-4a0f-96fa-fcd9f361441f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:46.125698 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27f88a-1862-4a0f-96fa-fcd9f361441f None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:46.131457 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 230/452] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 13:39:45 2022] GET /identity/v3/role_assignments?group.id=36888f067ad24144bda20db8072b790b&scope.project.id=954de20b90ec45ea91ae6997825c8772&role.id=c7b1597b56ba4b88a4e6ac7689dc83fc => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:46.132345 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27f88a-1862-4a0f-96fa-fcd9f361441f None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:46.139772 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c6b51-c980-4c9b-afd6-d9fb0796022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:46.140437 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c6b51-c980-4c9b-afd6-d9fb0796022f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:46.140840 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c6b51-c980-4c9b-afd6-d9fb0796022f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:46.141131 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c6b51-c980-4c9b-afd6-d9fb0796022f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:46.142030 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c6b51-c980-4c9b-afd6-d9fb0796022f None admin] RBAC: Adding query filter params (group.id=36888f067ad24144bda20db8072b790b, role.id=e6b3c27ed485430a88f59247935bfa08, scope.project.id=954de20b90ec45ea91ae6997825c8772) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:46.142346 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c6b51-c980-4c9b-afd6-d9fb0796022f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:46.143860 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c6b51-c980-4c9b-afd6-d9fb0796022f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:46.160361 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 223/453] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 13:39:46 2022] GET /identity/v3/role_assignments?group.id=36888f067ad24144bda20db8072b790b&scope.project.id=954de20b90ec45ea91ae6997825c8772&role.id=e6b3c27ed485430a88f59247935bfa08 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:46.259825 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27f88a-1862-4a0f-96fa-fcd9f361441f None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:46.299354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fb8e3-be91-41bd-817a-40dd0a8a9921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:46.300250 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fb8e3-be91-41bd-817a-40dd0a8a9921 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:46.300532 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fb8e3-be91-41bd-817a-40dd0a8a9921 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:46.300809 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fb8e3-be91-41bd-817a-40dd0a8a9921 None admin] PATH_INFO: `/v3/groups/18163a18b6c44977afcbb9a95c821aa0` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:46.302145 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fb8e3-be91-41bd-817a-40dd0a8a9921 None admin] RBAC: Authorizing `identity:get_group(group_id=18163a18b6c44977afcbb9a95c821aa0)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:46.303699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fb8e3-be91-41bd-817a-40dd0a8a9921 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:46.305777 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 231/454] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 13:39:46 2022] GET /identity/v3/groups/18163a18b6c44977afcbb9a95c821aa0 => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:46.311619 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c6b51-c980-4c9b-afd6-d9fb0796022f None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:46.424495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c6b51-c980-4c9b-afd6-d9fb0796022f None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:46.434413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:46.462230 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a87b69-a7c9-4fc5-885d-31fcaf263e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:46.462877 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a87b69-a7c9-4fc5-885d-31fcaf263e72 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:46.463158 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a87b69-a7c9-4fc5-885d-31fcaf263e72 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:46.463428 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a87b69-a7c9-4fc5-885d-31fcaf263e72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:46.464248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a87b69-a7c9-4fc5-885d-31fcaf263e72 None admin] RBAC: Adding query filter params (group.id=18163a18b6c44977afcbb9a95c821aa0, role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.project.id=066fbe760dac4adba6eafb0592a4a0b1) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:46.464559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a87b69-a7c9-4fc5-885d-31fcaf263e72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:46.466267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a87b69-a7c9-4fc5-885d-31fcaf263e72 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:46.472692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 224/455] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 13:39:46 2022] GET /identity/v3/role_assignments?group.id=18163a18b6c44977afcbb9a95c821aa0&scope.project.id=066fbe760dac4adba6eafb0592a4a0b1&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:49.055101 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8813f6-566a-464f-b683-34272b7c5445 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:49.055655 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8813f6-566a-464f-b683-34272b7c5445 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:49.055655 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8813f6-566a-464f-b683-34272b7c5445 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:49.057221 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 232/456] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:49.062742 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c829e-c2e3-48bd-bd0f-24109b651b17 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:49.063150 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c829e-c2e3-48bd-bd0f-24109b651b17 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:49.063339 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c829e-c2e3-48bd-bd0f-24109b651b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:49.090343 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-f07c829e-c2e3-48bd-bd0f-24109b651b17 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:49.091571 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f07c829e-c2e3-48bd-bd0f-24109b651b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:49.177623 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 225/457] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:39:49.212793 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8813f6-566a-464f-b683-34272b7c5445 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:49.289882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:49.381068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8813f6-566a-464f-b683-34272b7c5445 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:49.429068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc8af2-74a1-4f02-a8a2-4c4f90a32f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:49.429894 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc8af2-74a1-4f02-a8a2-4c4f90a32f1f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:49.430179 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc8af2-74a1-4f02-a8a2-4c4f90a32f1f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:49.430456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc8af2-74a1-4f02-a8a2-4c4f90a32f1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:49.451840 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc8af2-74a1-4f02-a8a2-4c4f90a32f1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:49.453346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc8af2-74a1-4f02-a8a2-4c4f90a32f1f None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:49.473084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-a2bc8af2-74a1-4f02-a8a2-4c4f90a32f1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:49.473084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:49.473084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:49.473084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:49.473084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:49.473084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:49.473084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:49.473084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:49.473084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:49.473084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:49.473084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:49.473084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:49.473084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:39:49.473084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:39:49.473084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:39:49.474070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:39:49.474070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:49.474070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:49.474070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:49.474070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:49.474070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:49.474070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:49.474070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:49.474070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:49.474070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:49.474070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:49.474070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:49.474070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:49.474070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:49.474070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:49.474070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:49.474070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:49.475346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:39:49.475346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:39:49.475346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:49.475346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:49.475346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 233/458] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:49.481930 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c829e-c2e3-48bd-bd0f-24109b651b17 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:49.577310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dba883-995d-49c8-a48b-97e9ec6a0219 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:49.577310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dba883-995d-49c8-a48b-97e9ec6a0219 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:49.577310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dba883-995d-49c8-a48b-97e9ec6a0219 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:49.578411 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 234/459] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:39:49.587122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f1ee0-c559-431c-a8d5-ef949c795bfd None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:49.587557 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f1ee0-c559-431c-a8d5-ef949c795bfd None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:49.587974 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f1ee0-c559-431c-a8d5-ef949c795bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:49.622768 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-442f1ee0-c559-431c-a8d5-ef949c795bfd None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:49.624259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-442f1ee0-c559-431c-a8d5-ef949c795bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:49.634232 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c829e-c2e3-48bd-bd0f-24109b651b17 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:49.637563 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:49.691048 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ee40b-5e84-4bc9-bc0c-5f975214c74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:49.692089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ee40b-5e84-4bc9-bc0c-5f975214c74d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:49.692599 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ee40b-5e84-4bc9-bc0c-5f975214c74d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:49.693070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ee40b-5e84-4bc9-bc0c-5f975214c74d None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:49.694568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ee40b-5e84-4bc9-bc0c-5f975214c74d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:49.695073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ee40b-5e84-4bc9-bc0c-5f975214c74d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:49.696620 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ee40b-5e84-4bc9-bc0c-5f975214c74d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:49.714441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 226/460] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:49.716122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67558a0-4cd5-4b79-bb16-cef93c32f35a None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:49.716483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67558a0-4cd5-4b79-bb16-cef93c32f35a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:49.716833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67558a0-4cd5-4b79-bb16-cef93c32f35a None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:49.718680 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 227/461] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:49.719670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67558a0-4cd5-4b79-bb16-cef93c32f35a None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:49.728982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 235/462] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:49.730552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04883f-688e-4cca-b6c4-6f4c31a2c9f9 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:49.730963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04883f-688e-4cca-b6c4-6f4c31a2c9f9 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:49.731364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04883f-688e-4cca-b6c4-6f4c31a2c9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:49.760240 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-dd04883f-688e-4cca-b6c4-6f4c31a2c9f9 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:49.761976 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-dd04883f-688e-4cca-b6c4-6f4c31a2c9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:49.779104 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:49.846709 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 236/463] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:49.848461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04883f-688e-4cca-b6c4-6f4c31a2c9f9 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:49.851379 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67558a0-4cd5-4b79-bb16-cef93c32f35a None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:49.894957 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51a38f-d39c-43de-b962-d7b6c80f07c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:49.895534 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51a38f-d39c-43de-b962-d7b6c80f07c9 None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:49.895815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51a38f-d39c-43de-b962-d7b6c80f07c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:49.896091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51a38f-d39c-43de-b962-d7b6c80f07c9 None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:49.896815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51a38f-d39c-43de-b962-d7b6c80f07c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:49.898296 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51a38f-d39c-43de-b962-d7b6c80f07c9 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:49.919914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 228/464] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 13:39:49 2022] POST /identity/v3/users => generated 246 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:39:49.921616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3c72-d0dc-42f7-a0c1-08e27193d4a9 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:49.922052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3c72-d0dc-42f7-a0c1-08e27193d4a9 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:49.922476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3c72-d0dc-42f7-a0c1-08e27193d4a9 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:49.924350 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 229/465] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:49.925410 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b3c72-d0dc-42f7-a0c1-08e27193d4a9 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:49.958249 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:49.973597 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04883f-688e-4cca-b6c4-6f4c31a2c9f9 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:50.014230 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f2e4c-fb4a-4f92-a750-bb75f3263841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:50.015095 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f2e4c-fb4a-4f92-a750-bb75f3263841 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:50.015420 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f2e4c-fb4a-4f92-a750-bb75f3263841 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:50.015695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f2e4c-fb4a-4f92-a750-bb75f3263841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:50.029290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f2e4c-fb4a-4f92-a750-bb75f3263841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:50.031493 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f2e4c-fb4a-4f92-a750-bb75f3263841 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:50.052172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-a70f2e4c-fb4a-4f92-a750-bb75f3263841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:50.052172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:50.052172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:50.052172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:50.052172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:50.052172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:50.052172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:50.052172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:50.052172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:50.052172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:50.052172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:50.052172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:50.052172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:39:50.052172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:39:50.052172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:39:50.053685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:39:50.053685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:50.053685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:50.053685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:50.053685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:50.053685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:50.053685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:50.053685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:50.053685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:50.053685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:50.053685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:50.053685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:50.053685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:50.053685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:50.053685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:50.053685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:50.053685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:50.054542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:39:50.054542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:39:50.054542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:50.054542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:50.056874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 237/466] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:50.058913 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8d07f-fb3d-48e1-b21b-dd7d3608629a None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:50.059375 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8d07f-fb3d-48e1-b21b-dd7d3608629a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:50.059803 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8d07f-fb3d-48e1-b21b-dd7d3608629a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:50.060251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b3c72-d0dc-42f7-a0c1-08e27193d4a9 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:50.065504 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:50.082230 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-0da8d07f-fb3d-48e1-b21b-dd7d3608629a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:50.083682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0da8d07f-fb3d-48e1-b21b-dd7d3608629a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:50.101997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cdecc-8d84-4143-a790-5503df89c99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:50.102791 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cdecc-8d84-4143-a790-5503df89c99c None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:50.103072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cdecc-8d84-4143-a790-5503df89c99c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:50.103349 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cdecc-8d84-4143-a790-5503df89c99c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:50.115724 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00cdecc-8d84-4143-a790-5503df89c99c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:50.117424 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00cdecc-8d84-4143-a790-5503df89c99c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:50.137331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-a00cdecc-8d84-4143-a790-5503df89c99c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:50.137331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:50.137331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:50.137331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:50.137331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:50.137331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:50.137331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:50.137331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:50.137331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:50.137331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:50.137331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:50.137331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:50.137331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:39:50.137331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:39:50.137331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:39:50.138383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:39:50.138383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:50.138383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:50.138383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:50.138383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:50.138383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:50.138383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:50.138383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:50.138383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:50.138383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:50.138383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:50.138383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:50.138383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:50.138383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:50.138383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:50.138383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:50.138383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:50.139234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:39:50.139234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:39:50.139234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:50.139234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:50.139234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 230/467] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:50.139642 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cdecc-8d84-4143-a790-5503df89c99c None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:50.170694 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 238/468] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:50.172097 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8d07f-fb3d-48e1-b21b-dd7d3608629a None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:50.215201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:50.251796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cdecc-8d84-4143-a790-5503df89c99c None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:50.296213 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab408fb1-2b23-4472-9cbc-235b5d8a0e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:50.297323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab408fb1-2b23-4472-9cbc-235b5d8a0e8f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:50.297817 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab408fb1-2b23-4472-9cbc-235b5d8a0e8f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:50.298301 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab408fb1-2b23-4472-9cbc-235b5d8a0e8f None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:50.299255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab408fb1-2b23-4472-9cbc-235b5d8a0e8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:50.299798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab408fb1-2b23-4472-9cbc-235b5d8a0e8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:50.300932 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8d07f-fb3d-48e1-b21b-dd7d3608629a None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:50.301700 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab408fb1-2b23-4472-9cbc-235b5d8a0e8f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:50.316248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 231/469] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:50.317478 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab408fb1-2b23-4472-9cbc-235b5d8a0e8f None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:50.341716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:50.348855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c195d-300b-4fbf-94a5-260263f27ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:50.349553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c195d-300b-4fbf-94a5-260263f27ad2 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:50.349861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c195d-300b-4fbf-94a5-260263f27ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:50.350136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c195d-300b-4fbf-94a5-260263f27ad2 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:50.351114 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c195d-300b-4fbf-94a5-260263f27ad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:50.351419 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c195d-300b-4fbf-94a5-260263f27ad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:50.353502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c195d-300b-4fbf-94a5-260263f27ad2 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:50.373437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 239/470] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:50.375976 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c195d-300b-4fbf-94a5-260263f27ad2 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:50.449477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab408fb1-2b23-4472-9cbc-235b5d8a0e8f None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:50.483456 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:50.490644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508307e-630b-4c4c-96f9-abbab6ed7759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:50.491634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508307e-630b-4c4c-96f9-abbab6ed7759 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:50.491936 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508307e-630b-4c4c-96f9-abbab6ed7759 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:50.492362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508307e-630b-4c4c-96f9-abbab6ed7759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:50.500785 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c195d-300b-4fbf-94a5-260263f27ad2 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:50.503465 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508307e-630b-4c4c-96f9-abbab6ed7759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:50.504908 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508307e-630b-4c4c-96f9-abbab6ed7759 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:50.523823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-6508307e-630b-4c4c-96f9-abbab6ed7759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:50.523823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:50.523823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:50.523823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:50.523823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:50.523823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:50.523823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:50.523823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:50.523823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:50.523823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:50.523823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:50.523823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:50.523823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:39:50.523823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:39:50.523823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:39:50.524697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:39:50.524697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:50.524697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:50.524697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:50.524697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:50.524697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:50.524697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:50.524697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:50.524697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:50.524697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:50.524697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:50.524697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:50.524697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:50.524697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:50.524697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:50.524697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:50.524697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:50.525596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:39:50.525596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:39:50.525596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:50.525596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:50.525596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 232/471] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:50.525866 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508307e-630b-4c4c-96f9-abbab6ed7759 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:50.542353 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f19d0-f626-494c-9d36-80dc6a685635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:50.543492 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f19d0-f626-494c-9d36-80dc6a685635 None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:50.543983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f19d0-f626-494c-9d36-80dc6a685635 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:50.544271 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f19d0-f626-494c-9d36-80dc6a685635 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:50.544989 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f19d0-f626-494c-9d36-80dc6a685635 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:50.546821 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f19d0-f626-494c-9d36-80dc6a685635 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:50.570391 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 240/472] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 13:39:50 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:39:50.571533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0997d-275e-4522-92df-5445db6e0f12 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:50.571831 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0997d-275e-4522-92df-5445db6e0f12 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:50.572105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0997d-275e-4522-92df-5445db6e0f12 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:50.573384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 241/473] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:50.574137 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0997d-275e-4522-92df-5445db6e0f12 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:50.634664 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:50.682441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508307e-630b-4c4c-96f9-abbab6ed7759 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:50.708761 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0997d-275e-4522-92df-5445db6e0f12 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:50.725844 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14740b-1599-4f86-9d48-73f00c592619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:50.727181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14740b-1599-4f86-9d48-73f00c592619 None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:50.727684 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14740b-1599-4f86-9d48-73f00c592619 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:50.728610 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14740b-1599-4f86-9d48-73f00c592619 None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:50.729621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14740b-1599-4f86-9d48-73f00c592619 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:50.732020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14740b-1599-4f86-9d48-73f00c592619 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:50.749101 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84854334-90a9-47de-94eb-409119b199b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:50.750148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84854334-90a9-47de-94eb-409119b199b3 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:50.750577 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84854334-90a9-47de-94eb-409119b199b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:50.750905 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84854334-90a9-47de-94eb-409119b199b3 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:50.751753 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84854334-90a9-47de-94eb-409119b199b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:50.752095 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84854334-90a9-47de-94eb-409119b199b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:50.753530 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84854334-90a9-47de-94eb-409119b199b3 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:50.761978 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 233/474] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 13:39:50 2022] POST /identity/v3/users => generated 248 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:39:50.763734 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8230b-0a9e-4889-acfb-9f5a7c447f0a None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:50.764225 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8230b-0a9e-4889-acfb-9f5a7c447f0a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:50.764713 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8230b-0a9e-4889-acfb-9f5a7c447f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:50.775868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 242/475] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:50.783480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84854334-90a9-47de-94eb-409119b199b3 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:50.790436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-3ff8230b-0a9e-4889-acfb-9f5a7c447f0a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:50.792024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-3ff8230b-0a9e-4889-acfb-9f5a7c447f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:50.838703 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:50.897559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 234/476] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:50.926802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8230b-0a9e-4889-acfb-9f5a7c447f0a None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:50.935404 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84854334-90a9-47de-94eb-409119b199b3 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:50.947415 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:50.979229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9d137-9ea6-41bb-a5be-2bf61a8a7915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:50.979869 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9d137-9ea6-41bb-a5be-2bf61a8a7915 None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:50.980153 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9d137-9ea6-41bb-a5be-2bf61a8a7915 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:50.980480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9d137-9ea6-41bb-a5be-2bf61a8a7915 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:50.981198 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9d137-9ea6-41bb-a5be-2bf61a8a7915 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:50.982689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9d137-9ea6-41bb-a5be-2bf61a8a7915 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:51.005762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 243/477] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 13:39:50 2022] POST /identity/v3/users => generated 249 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:39:51.056105 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8230b-0a9e-4889-acfb-9f5a7c447f0a None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:51.100049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f39d3c-ca73-45d0-baa6-2eb3c10071a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:51.100732 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f39d3c-ca73-45d0-baa6-2eb3c10071a9 None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:51.101010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f39d3c-ca73-45d0-baa6-2eb3c10071a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:51.101293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f39d3c-ca73-45d0-baa6-2eb3c10071a9 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:51.102070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f39d3c-ca73-45d0-baa6-2eb3c10071a9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:51.103451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f39d3c-ca73-45d0-baa6-2eb3c10071a9 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:51.110183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.sql.core [None req-d5f39d3c-ca73-45d0-baa6-2eb3c10071a9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 13:39:51.110183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 13:39:51.110183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [parameters: {'id': 'bde0d43ce6fa44e3b3088f330fbe684a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 13:39:51.110183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91766) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 13:39:51.127126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-d5f39d3c-ca73-45d0-baa6-2eb3c10071a9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 13:39:51.127126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:51.127126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 13:39:51.127126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 13:39:51.127126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 13:39:51.127126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 13:39:51.127126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 13:39:51.127126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application result = self._query(query) May 26 13:39:51.127126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 13:39:51.127126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application conn.query(q) May 26 13:39:51.127126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 13:39:51.127126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 13:39:51.127126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 13:39:51.127126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application result.read() May 26 13:39:51.127126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 13:39:51.128054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 13:39:51.128054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 13:39:51.128054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 13:39:51.128054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 13:39:51.128054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 13:39:51.128054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 13:39:51.128054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 13:39:51.128054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 13:39:51.128054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:51.128054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 13:39:51.128054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:51.128054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:51.128054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 13:39:51.128054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 13:39:51.128054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 13:39:51.128054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return ref.to_dict() May 26 13:39:51.128054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 13:39:51.128054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application next(self.gen) May 26 13:39:51.128975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 13:39:51.128975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application yield resource May 26 13:39:51.128975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 13:39:51.128975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application next(self.gen) May 26 13:39:51.128975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 13:39:51.128975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self.session.rollback() May 26 13:39:51.128975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 13:39:51.128975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self.force_reraise() May 26 13:39:51.128975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 13:39:51.128975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise self.value May 26 13:39:51.128975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 13:39:51.128975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 13:39:51.128975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 13:39:51.128975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application session.commit() May 26 13:39:51.128975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 13:39:51.128975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 13:39:51.128975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 13:39:51.130776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._prepare_impl() May 26 13:39:51.130776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 13:39:51.130776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self.session.flush() May 26 13:39:51.130776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 13:39:51.130776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._flush(objects) May 26 13:39:51.130776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 13:39:51.130776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 13:39:51.130776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 13:39:51.130776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application compat.raise_( May 26 13:39:51.130776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 13:39:51.130776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception May 26 13:39:51.130776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 13:39:51.130776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application flush_context.execute() May 26 13:39:51.130776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 13:39:51.130776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rec.execute(self) May 26 13:39:51.130776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 13:39:51.130776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 13:39:51.132448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 13:39:51.132448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 13:39:51.132448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 13:39:51.132448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 13:39:51.132448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 13:39:51.132448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 13:39:51.132448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 13:39:51.132448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 13:39:51.132448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 13:39:51.132448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 13:39:51.132448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 13:39:51.132448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 13:39:51.132448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 13:39:51.132448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 13:39:51.132448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 13:39:51.132448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception May 26 13:39:51.133511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 13:39:51.133511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 13:39:51.133511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 13:39:51.133511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 13:39:51.133511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 13:39:51.133511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application result = self._query(query) May 26 13:39:51.133511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 13:39:51.133511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application conn.query(q) May 26 13:39:51.133511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 13:39:51.133511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 13:39:51.133511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 13:39:51.133511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application result.read() May 26 13:39:51.133511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 13:39:51.133511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 13:39:51.133511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 13:39:51.133511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 13:39:51.134800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 13:39:51.134800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 13:39:51.134800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 13:39:51.134800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 13:39:51.134800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 13:39:51.134800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 13:39:51.134800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [parameters: {'id': 'bde0d43ce6fa44e3b3088f330fbe684a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 13:39:51.134800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 13:39:51.134800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:51.134800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:39:51.134800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:51.134800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:51.134800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:51.134800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:51.134800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:51.134800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:51.136066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:51.136066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:51.136066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:51.136066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:51.136066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:51.136066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:51.136066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 13:39:51.136066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 13:39:51.136066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:51.136066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:51.136066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 13:39:51.136066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 13:39:51.136066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 13:39:51.136066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 13:39:51.136066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 13:39:51.136066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:51.137091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 235/478] 10.222.0.45 () {60 vars in 1131 bytes} [Thu May 26 13:39:50 2022] POST /identity/v3/roles => generated 144 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:51.142655 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9d137-9ea6-41bb-a5be-2bf61a8a7915 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:51.266624 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9d137-9ea6-41bb-a5be-2bf61a8a7915 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:51.306977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777effb-96ef-4e57-a13b-c0ab269641e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:51.307796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777effb-96ef-4e57-a13b-c0ab269641e5 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:51.308081 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777effb-96ef-4e57-a13b-c0ab269641e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:51.308361 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777effb-96ef-4e57-a13b-c0ab269641e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:51.322668 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777effb-96ef-4e57-a13b-c0ab269641e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:51.330924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-a777effb-96ef-4e57-a13b-c0ab269641e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:51.330924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:51.330924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:51.330924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:51.330924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:51.330924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:51.330924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:51.330924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:51.330924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:51.330924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:51.330924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:51.330924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:51.330924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:51.330924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:51.330924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:51.330924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:51.331841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:51.331841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:51.331841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:51.331841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:51.331841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:51.331841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:51.331841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:51.331841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:51.331841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:51.331841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:51.331841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:51.331841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:51.331841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:51.331841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:51.331841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:51.331841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:51.332650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:51.332650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:51.332650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:51.332650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:51.332650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:51.332650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:51.332650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:51.332650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:51.332650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:51.332650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:51.332650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 13:39:51.332650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:51.332650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 244/479] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:39:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:51.338658 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f39d3c-ca73-45d0-baa6-2eb3c10071a9 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:51.378418 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:51.456518 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f39d3c-ca73-45d0-baa6-2eb3c10071a9 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:51.491404 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0f77a-7906-421e-8bbd-a9147d4ae57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:51.492229 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0f77a-7906-421e-8bbd-a9147d4ae57d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:51.492660 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0f77a-7906-421e-8bbd-a9147d4ae57d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:51.493046 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0f77a-7906-421e-8bbd-a9147d4ae57d None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:51.493921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0f77a-7906-421e-8bbd-a9147d4ae57d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:51.494377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0f77a-7906-421e-8bbd-a9147d4ae57d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:51.495901 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0f77a-7906-421e-8bbd-a9147d4ae57d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:51.504793 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 236/480] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:39:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:52.416865 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00e7f2-b8a6-4a64-be98-176a61f7a976 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:52.417764 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00e7f2-b8a6-4a64-be98-176a61f7a976 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:52.418230 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00e7f2-b8a6-4a64-be98-176a61f7a976 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:52.420187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 245/481] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:52.426513 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78379c4-82ae-46cf-b4d9-298855b87cbd None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:52.427512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78379c4-82ae-46cf-b4d9-298855b87cbd None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:52.428077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78379c4-82ae-46cf-b4d9-298855b87cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:52.445763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-f78379c4-82ae-46cf-b4d9-298855b87cbd None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:52.447288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f78379c4-82ae-46cf-b4d9-298855b87cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:52.521464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 237/482] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:52.539795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00e7f2-b8a6-4a64-be98-176a61f7a976 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:52.575938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:52.682510 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00e7f2-b8a6-4a64-be98-176a61f7a976 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:52.728257 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566a939-dcfd-479d-8d9f-aefe333e23bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:52.729055 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566a939-dcfd-479d-8d9f-aefe333e23bd None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:52.729362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566a939-dcfd-479d-8d9f-aefe333e23bd None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:52.729641 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566a939-dcfd-479d-8d9f-aefe333e23bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:52.739772 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566a939-dcfd-479d-8d9f-aefe333e23bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:52.747615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-1566a939-dcfd-479d-8d9f-aefe333e23bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:39:52.747615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:52.747615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:52.747615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:52.747615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:52.747615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:52.747615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:52.747615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:52.747615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:52.747615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:52.747615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:52.747615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:52.747615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:52.747615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:52.747615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:52.747615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:52.748598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:52.748598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:52.748598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:52.748598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:52.748598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:52.748598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:52.748598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:52.748598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:52.748598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:52.748598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:52.748598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:52.748598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:52.748598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:52.748598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:52.748598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:52.748598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:52.749449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:52.749449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:52.749449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:52.749449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:52.749449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:52.749449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:52.749449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:52.749449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:52.749449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:52.749449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:52.749449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:39:52.749449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:52.753378 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 246/483] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:39:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:52.754995 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78379c4-82ae-46cf-b4d9-298855b87cbd None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:52.793633 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:52.879238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78379c4-82ae-46cf-b4d9-298855b87cbd None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:52.924767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc1a83-9742-43fe-b403-d178afe50d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:52.925459 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc1a83-9742-43fe-b403-d178afe50d77 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:52.925743 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc1a83-9742-43fe-b403-d178afe50d77 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:52.926018 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc1a83-9742-43fe-b403-d178afe50d77 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:52.926757 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc1a83-9742-43fe-b403-d178afe50d77 None admin] RBAC: Adding query filter params (name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:52.927061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc1a83-9742-43fe-b403-d178afe50d77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:52.929042 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc1a83-9742-43fe-b403-d178afe50d77 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:52.940630 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 238/484] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:39:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:52.946571 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566a939-dcfd-479d-8d9f-aefe333e23bd None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:53.045015 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:53.070185 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566a939-dcfd-479d-8d9f-aefe333e23bd None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:53.114841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089f5ff-b3a4-4b87-929b-7f90e90d21b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:53.116169 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089f5ff-b3a4-4b87-929b-7f90e90d21b6 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:53.116449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089f5ff-b3a4-4b87-929b-7f90e90d21b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:53.116724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089f5ff-b3a4-4b87-929b-7f90e90d21b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:53.127545 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089f5ff-b3a4-4b87-929b-7f90e90d21b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:53.129008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089f5ff-b3a4-4b87-929b-7f90e90d21b6 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:53.150864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-1089f5ff-b3a4-4b87-929b-7f90e90d21b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:53.150864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:53.150864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:53.150864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:53.150864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:53.150864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:53.150864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:53.150864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:53.150864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:53.150864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:53.150864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:53.150864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:53.150864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:39:53.150864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:39:53.150864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:39:53.151798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:39:53.151798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:53.151798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:53.151798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:53.151798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:53.151798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:53.151798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:53.151798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:53.151798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:53.151798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:53.151798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:53.151798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:53.151798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:53.151798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:53.151798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:53.151798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:53.151798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:53.152645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:39:53.152645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:39:53.152645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:53.152645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:53.152645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 247/485] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:53.158092 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc1a83-9742-43fe-b403-d178afe50d77 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:53.298230 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:53.313769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc1a83-9742-43fe-b403-d178afe50d77 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:53.348100 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5718da3-13d2-4fe0-94e8-3072ea9a24b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:53.348764 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5718da3-13d2-4fe0-94e8-3072ea9a24b1 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:53.349047 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5718da3-13d2-4fe0-94e8-3072ea9a24b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:53.349423 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5718da3-13d2-4fe0-94e8-3072ea9a24b1 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:53.350666 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5718da3-13d2-4fe0-94e8-3072ea9a24b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:53.350977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5718da3-13d2-4fe0-94e8-3072ea9a24b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:53.352347 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5718da3-13d2-4fe0-94e8-3072ea9a24b1 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:53.369193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 239/486] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:53.374640 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089f5ff-b3a4-4b87-929b-7f90e90d21b6 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:53.511505 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089f5ff-b3a4-4b87-929b-7f90e90d21b6 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:53.530013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94376a-537c-4980-b114-61ac48ed4be4 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:53.530483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94376a-537c-4980-b114-61ac48ed4be4 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:53.530585 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94376a-537c-4980-b114-61ac48ed4be4 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:53.533391 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 240/487] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:53.547007 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26cb42-711b-4c2f-b3f0-d378070dc3ea None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:53.547340 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26cb42-711b-4c2f-b3f0-d378070dc3ea None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:53.547568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26cb42-711b-4c2f-b3f0-d378070dc3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:53.566254 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b3d16-b1b6-4bd1-857d-70c37629ee0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:53.567031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b3d16-b1b6-4bd1-857d-70c37629ee0a None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:53.567408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b3d16-b1b6-4bd1-857d-70c37629ee0a None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:53.567571 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b3d16-b1b6-4bd1-857d-70c37629ee0a None admin] PATH_INFO: `/v3/users/nova` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:53.573151 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-6a26cb42-711b-4c2f-b3f0-d378070dc3ea None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:53.574888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6a26cb42-711b-4c2f-b3f0-d378070dc3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:53.576401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:53.582907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b3d16-b1b6-4bd1-857d-70c37629ee0a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:53.593745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b3d16-b1b6-4bd1-857d-70c37629ee0a None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:53.621354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-aa8b3d16-b1b6-4bd1-857d-70c37629ee0a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 13:39:53.621354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:53.621354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:53.621354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:53.621354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:53.621354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:53.621354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:53.621354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:53.621354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:53.621354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:53.621354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:53.621354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:53.621354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:39:53.621354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:39:53.621354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:39:53.621354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:39:53.622328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:53.622328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:53.622328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:39:53.622328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:39:53.622328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:39:53.622328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:39:53.622328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:53.622328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:53.622328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:53.622328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:53.622328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:53.622328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:53.622328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:53.622328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:53.622328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:53.622328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:53.622328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:53.622328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:53.623243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:53.623243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:53.623243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:39:53.623243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:39:53.623243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:39:53.623243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:39:53.623243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:39:53.623243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:39:53.623243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 13:39:53.623243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:53.623243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 248/488] 10.222.0.45 () {56 vars in 1093 bytes} [Thu May 26 13:39:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:53.627948 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b3d16-b1b6-4bd1-857d-70c37629ee0a None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:53.670389 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 241/489] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:53.703468 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26cb42-711b-4c2f-b3f0-d378070dc3ea None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:53.792564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b3d16-b1b6-4bd1-857d-70c37629ee0a None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:53.828548 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf1f7e-2982-4b42-87d9-327c28215b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:53.829564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf1f7e-2982-4b42-87d9-327c28215b21 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:53.830026 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf1f7e-2982-4b42-87d9-327c28215b21 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:53.830476 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf1f7e-2982-4b42-87d9-327c28215b21 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:53.831487 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf1f7e-2982-4b42-87d9-327c28215b21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:53.831996 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf1f7e-2982-4b42-87d9-327c28215b21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:53.833418 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:53.834662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf1f7e-2982-4b42-87d9-327c28215b21 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:53.851694 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26cb42-711b-4c2f-b3f0-d378070dc3ea None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:53.876575 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 249/490] 10.222.0.45 () {56 vars in 1133 bytes} [Thu May 26 13:39:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:53.876575 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260491e-c4a1-437f-8978-8c6d5acfaea4 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:53.876575 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260491e-c4a1-437f-8978-8c6d5acfaea4 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:53.876575 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260491e-c4a1-437f-8978-8c6d5acfaea4 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:53.876575 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 250/491] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:53.876993 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51e44d-d815-40a2-8f6c-fb090fcf644c None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:53.877067 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51e44d-d815-40a2-8f6c-fb090fcf644c None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:53.877678 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51e44d-d815-40a2-8f6c-fb090fcf644c None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:53.878888 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 251/492] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:53.883905 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51e44d-d815-40a2-8f6c-fb090fcf644c None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:53.898221 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bf9e3-f2ee-4808-8c45-a2d104a250ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:53.899016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bf9e3-f2ee-4808-8c45-a2d104a250ce None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:53.899293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bf9e3-f2ee-4808-8c45-a2d104a250ce None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:53.899565 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bf9e3-f2ee-4808-8c45-a2d104a250ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:53.909552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5bf9e3-f2ee-4808-8c45-a2d104a250ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:53.917665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-cc5bf9e3-f2ee-4808-8c45-a2d104a250ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:39:53.917665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:53.917665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:53.917665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:53.917665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:53.917665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:53.917665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:53.917665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:53.917665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:53.917665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:53.917665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:53.917665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:53.917665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:53.917665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:53.917665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:53.917665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:53.918678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:53.918678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:53.918678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:53.918678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:53.918678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:53.918678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:53.918678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:53.918678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:53.918678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:53.918678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:53.918678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:53.918678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:53.918678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:53.918678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:53.918678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:53.918678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:53.919482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:53.919482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:53.919482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:53.919482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:53.919482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:53.919482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:53.919482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:53.919482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:53.919482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:53.919482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:53.919482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:39:53.919482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:53.919482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 242/493] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:39:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:39:53.921416 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d24304-6c6f-48eb-94b5-33da81b83e98 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:53.921416 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d24304-6c6f-48eb-94b5-33da81b83e98 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:53.921416 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d24304-6c6f-48eb-94b5-33da81b83e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:53.938449 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-f0d24304-6c6f-48eb-94b5-33da81b83e98 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:53.939626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f0d24304-6c6f-48eb-94b5-33da81b83e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:53.944857 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:53.994103 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51e44d-d815-40a2-8f6c-fb090fcf644c None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:54.014699 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 243/494] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:54.015970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b8f04-7b66-4a04-8c35-a52f819ed893 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:54.016252 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b8f04-7b66-4a04-8c35-a52f819ed893 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:54.016522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b8f04-7b66-4a04-8c35-a52f819ed893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:54.033694 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-9c3b8f04-7b66-4a04-8c35-a52f819ed893 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:54.034933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d2651-227f-4ab3-a2a0-561fd671ccff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:54.035061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9c3b8f04-7b66-4a04-8c35-a52f819ed893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:54.035932 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d2651-227f-4ab3-a2a0-561fd671ccff None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:54.036416 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d2651-227f-4ab3-a2a0-561fd671ccff None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:54.037184 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d2651-227f-4ab3-a2a0-561fd671ccff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:54.102583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:54.108899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d2651-227f-4ab3-a2a0-561fd671ccff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:54.110391 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d2651-227f-4ab3-a2a0-561fd671ccff None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:54.121565 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 244/495] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:54.121565 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b8f04-7b66-4a04-8c35-a52f819ed893 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:54.182605 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:54.218528 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b8f04-7b66-4a04-8c35-a52f819ed893 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:54.238405 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 252/496] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:54.238405 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d2651-227f-4ab3-a2a0-561fd671ccff None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:54.258518 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e142cc-573b-4b0a-aab1-533d50891419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:54.259282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e142cc-573b-4b0a-aab1-533d50891419 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:54.259654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e142cc-573b-4b0a-aab1-533d50891419 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:54.259939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e142cc-573b-4b0a-aab1-533d50891419 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:54.260936 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e142cc-573b-4b0a-aab1-533d50891419 None admin] RBAC: Adding query filter params (name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:54.261248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e142cc-573b-4b0a-aab1-533d50891419 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:54.262655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e142cc-573b-4b0a-aab1-533d50891419 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:54.270950 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 245/497] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:39:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:54.272326 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e142cc-573b-4b0a-aab1-533d50891419 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:54.333815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:54.348681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d2651-227f-4ab3-a2a0-561fd671ccff None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:54.384802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e142cc-573b-4b0a-aab1-533d50891419 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:54.386713 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271997e-af21-4f23-9683-c0bc87cd652b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:54.387512 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271997e-af21-4f23-9683-c0bc87cd652b None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:54.387793 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271997e-af21-4f23-9683-c0bc87cd652b None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:54.388069 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271997e-af21-4f23-9683-c0bc87cd652b None admin] PATH_INFO: `/v3/roles/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:54.398435 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271997e-af21-4f23-9683-c0bc87cd652b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:54.406193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-5271997e-af21-4f23-9683-c0bc87cd652b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:39:54.406193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:54.406193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:54.406193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:54.406193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:54.406193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:54.406193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:54.406193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:54.406193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:54.406193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:54.406193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:54.406193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:54.406193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:54.406193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:54.406193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:54.406193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:54.407320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:54.407320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:54.407320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:54.407320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:54.407320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:54.407320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:54.407320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:54.407320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:54.407320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:54.407320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:54.407320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:54.407320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:54.407320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:54.407320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:54.407320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:54.407320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:54.408160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:54.408160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:54.408160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:54.408160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:54.408160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:54.408160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:54.408160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:54.408160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:54.408160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:54.408160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:54.408160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:39:54.408160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:54.408160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 253/498] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:39:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:54.408835 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271997e-af21-4f23-9683-c0bc87cd652b None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:54.426340 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8a4ce-bdbd-453a-a464-2021f5517174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:54.426871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8a4ce-bdbd-453a-a464-2021f5517174 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:54.427135 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:54.427240 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8a4ce-bdbd-453a-a464-2021f5517174 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:54.427415 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8a4ce-bdbd-453a-a464-2021f5517174 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:54.438851 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8a4ce-bdbd-453a-a464-2021f5517174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:54.447135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-f4b8a4ce-bdbd-453a-a464-2021f5517174 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:39:54.447135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:54.447135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:54.447135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:54.447135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:54.447135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:54.447135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:54.447135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:54.447135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:54.447135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:54.447135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:54.447135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:54.447135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:54.447135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:54.447135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:54.447135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:54.448068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:54.448068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:54.448068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:54.448068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:54.448068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:54.448068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:54.448068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:54.448068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:54.448068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:54.448068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:54.448068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:54.448068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:54.448068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:54.448068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:54.448068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:54.448068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:54.448869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:54.448869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:54.448869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:54.448869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:54.448869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:54.448869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:54.448869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:54.448869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:54.448869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:54.448869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:54.448869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:39:54.448869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:54.448869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 246/499] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:39:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:54.449579 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8a4ce-bdbd-453a-a464-2021f5517174 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:54.527238 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271997e-af21-4f23-9683-c0bc87cd652b None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:54.559481 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8a4ce-bdbd-453a-a464-2021f5517174 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:54.565258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd00ff-975d-4a3c-a8a4-bade72aa3432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:54.566080 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd00ff-975d-4a3c-a8a4-bade72aa3432 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:54.566358 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd00ff-975d-4a3c-a8a4-bade72aa3432 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:54.566628 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd00ff-975d-4a3c-a8a4-bade72aa3432 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:54.578581 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd00ff-975d-4a3c-a8a4-bade72aa3432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:54.580032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd00ff-975d-4a3c-a8a4-bade72aa3432 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:54.581239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:54.597561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-6cdd00ff-975d-4a3c-a8a4-bade72aa3432 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:54.597561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:54.597561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:54.597561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:54.597561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:54.597561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:54.597561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:54.597561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:54.597561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:54.597561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:54.597561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:54.597561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:54.597561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:39:54.597561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:39:54.597561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:39:54.598649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:39:54.598649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:54.598649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:54.598649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:54.598649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:54.598649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:54.598649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:54.598649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:54.598649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:54.598649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:54.598649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:54.598649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:54.598649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:54.598649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:54.598649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:54.598649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:54.598649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:54.599572 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:39:54.599572 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:39:54.599572 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:54.599572 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:54.599572 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 254/500] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:54.599572 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd00ff-975d-4a3c-a8a4-bade72aa3432 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:54.605998 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa718d-a34d-47a0-8136-3342819b42ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:54.607805 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa718d-a34d-47a0-8136-3342819b42ff None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:54.608247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa718d-a34d-47a0-8136-3342819b42ff None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:54.608674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa718d-a34d-47a0-8136-3342819b42ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:54.622293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa718d-a34d-47a0-8136-3342819b42ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:54.623922 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa718d-a34d-47a0-8136-3342819b42ff None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:54.643583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-b3aa718d-a34d-47a0-8136-3342819b42ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:54.643583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:54.643583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:54.643583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:54.643583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:54.643583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:54.643583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:54.643583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:54.643583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:54.643583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:54.643583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:54.643583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:54.643583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:39:54.643583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:39:54.643583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:39:54.644621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:39:54.644621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:54.644621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:54.644621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:54.644621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:54.644621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:54.644621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:54.644621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:54.644621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:54.644621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:54.644621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:54.644621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:54.644621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:54.644621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:54.644621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:54.644621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:54.644621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:54.645720 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:39:54.645720 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:39:54.645720 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:54.645720 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:54.646741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 247/501] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:54.648663 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa718d-a34d-47a0-8136-3342819b42ff None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:54.685489 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:54.724288 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd00ff-975d-4a3c-a8a4-bade72aa3432 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:54.752388 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa718d-a34d-47a0-8136-3342819b42ff None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:54.759851 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d054da-1b02-4abc-b466-c4a4863b53d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:54.760855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d054da-1b02-4abc-b466-c4a4863b53d6 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:54.761140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d054da-1b02-4abc-b466-c4a4863b53d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:54.761451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d054da-1b02-4abc-b466-c4a4863b53d6 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:54.762200 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d054da-1b02-4abc-b466-c4a4863b53d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:54.762506 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d054da-1b02-4abc-b466-c4a4863b53d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:54.763882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d054da-1b02-4abc-b466-c4a4863b53d6 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:54.771682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 255/502] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:39:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:54.772458 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d054da-1b02-4abc-b466-c4a4863b53d6 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:54.790990 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17aec6-1c84-4c8d-83cd-812cafb34907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:54.791736 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17aec6-1c84-4c8d-83cd-812cafb34907 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:54.792013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17aec6-1c84-4c8d-83cd-812cafb34907 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:54.792288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17aec6-1c84-4c8d-83cd-812cafb34907 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:54.793018 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17aec6-1c84-4c8d-83cd-812cafb34907 None admin] RBAC: Adding query filter params (name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:54.793343 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17aec6-1c84-4c8d-83cd-812cafb34907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:54.794711 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17aec6-1c84-4c8d-83cd-812cafb34907 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:54.802645 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 248/503] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:39:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:54.803929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17aec6-1c84-4c8d-83cd-812cafb34907 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:54.836238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:54.879616 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d054da-1b02-4abc-b466-c4a4863b53d6 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:54.903728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17aec6-1c84-4c8d-83cd-812cafb34907 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:54.906789 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:54.913886 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a9caa-5b0b-46ce-89d3-2d04c9e3600b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:54.914595 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a9caa-5b0b-46ce-89d3-2d04c9e3600b None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:54.914882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a9caa-5b0b-46ce-89d3-2d04c9e3600b None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:54.915163 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a9caa-5b0b-46ce-89d3-2d04c9e3600b None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:54.915906 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a9caa-5b0b-46ce-89d3-2d04c9e3600b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:54.916214 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a9caa-5b0b-46ce-89d3-2d04c9e3600b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:54.917591 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a9caa-5b0b-46ce-89d3-2d04c9e3600b None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:54.929258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 256/504] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:54.930510 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e844843-baf8-48f4-827e-bc180ca55e29 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:54.930800 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e844843-baf8-48f4-827e-bc180ca55e29 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:54.931085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e844843-baf8-48f4-827e-bc180ca55e29 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:54.932333 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 257/505] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:54.933027 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e844843-baf8-48f4-827e-bc180ca55e29 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:54.940475 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728159d9-0119-4dcb-80da-e7a122d478e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:54.941140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728159d9-0119-4dcb-80da-e7a122d478e7 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:54.941460 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728159d9-0119-4dcb-80da-e7a122d478e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:54.941738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728159d9-0119-4dcb-80da-e7a122d478e7 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:54.942457 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728159d9-0119-4dcb-80da-e7a122d478e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:54.942768 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728159d9-0119-4dcb-80da-e7a122d478e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:54.944680 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728159d9-0119-4dcb-80da-e7a122d478e7 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:54.956560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 249/506] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:54.957373 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728159d9-0119-4dcb-80da-e7a122d478e7 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:55.039090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e844843-baf8-48f4-827e-bc180ca55e29 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:55.048938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:55.058854 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728159d9-0119-4dcb-80da-e7a122d478e7 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:55.074168 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd2fb6-3453-4e19-9d78-cd04c99ac49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:55.074948 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2fb6-3453-4e19-9d78-cd04c99ac49b None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:55.075245 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2fb6-3453-4e19-9d78-cd04c99ac49b None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:55.075504 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2fb6-3453-4e19-9d78-cd04c99ac49b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:55.086253 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd2fb6-3453-4e19-9d78-cd04c99ac49b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:55.087689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd2fb6-3453-4e19-9d78-cd04c99ac49b None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:55.092027 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe680f-7467-48a0-afac-8e459ce2e0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:55.092806 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe680f-7467-48a0-afac-8e459ce2e0f2 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:55.093086 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe680f-7467-48a0-afac-8e459ce2e0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:55.093392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe680f-7467-48a0-afac-8e459ce2e0f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:55.103198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe680f-7467-48a0-afac-8e459ce2e0f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:55.104629 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe680f-7467-48a0-afac-8e459ce2e0f2 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:55.104749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-27cd2fb6-3453-4e19-9d78-cd04c99ac49b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:55.104749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:55.104749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:55.104749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:55.104749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:55.104749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:55.104749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:55.104749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:55.104749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:55.104749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:55.104749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:55.104749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:55.104749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:39:55.104749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:39:55.104749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:39:55.105741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:39:55.105741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:55.105741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:55.105741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:55.105741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:55.105741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:55.105741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:55.105741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:55.105741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:55.105741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:55.105741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:55.105741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:55.105741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:55.105741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:55.105741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:55.105741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:55.105741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:55.106642 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:39:55.106642 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:39:55.106642 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:55.106642 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:55.106642 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 258/507] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:55.107089 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc229bd6-5dbf-4236-8079-68e0ad04ae8c None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:55.107373 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc229bd6-5dbf-4236-8079-68e0ad04ae8c None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:55.107652 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc229bd6-5dbf-4236-8079-68e0ad04ae8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:55.123663 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-cc229bd6-5dbf-4236-8079-68e0ad04ae8c None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:55.124868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-cc229bd6-5dbf-4236-8079-68e0ad04ae8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:55.126916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-30fe680f-7467-48a0-afac-8e459ce2e0f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:55.126916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:55.126916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:55.126916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:55.126916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:55.126916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:55.126916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:55.126916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:55.126916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:55.126916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:55.126916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:55.126916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:55.126916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:39:55.126916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:39:55.126916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:39:55.127786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:39:55.127786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:55.127786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:55.127786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:55.127786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:55.127786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:55.127786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:55.127786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:55.127786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:55.127786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:55.127786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:55.127786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:55.127786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:55.127786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:55.127786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:55.127786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:55.127786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:55.128667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:39:55.128667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:39:55.128667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:55.128667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:55.128667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 250/508] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:55.129238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe680f-7467-48a0-afac-8e459ce2e0f2 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:55.159679 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:55.192246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 259/509] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:55.193066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc229bd6-5dbf-4236-8079-68e0ad04ae8c None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:55.230365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe680f-7467-48a0-afac-8e459ce2e0f2 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:55.265065 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875dee34-a5bc-4555-ace3-87ddacc2e1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:55.265878 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dee34-a5bc-4555-ace3-87ddacc2e1ca None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:55.266157 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dee34-a5bc-4555-ace3-87ddacc2e1ca None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:55.266438 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dee34-a5bc-4555-ace3-87ddacc2e1ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:55.272954 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875dee34-a5bc-4555-ace3-87ddacc2e1ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:55.274422 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875dee34-a5bc-4555-ace3-87ddacc2e1ca None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:55.288328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-875dee34-a5bc-4555-ace3-87ddacc2e1ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:39:55.288328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:55.288328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:55.288328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:55.288328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:55.288328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:55.288328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:55.288328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:55.288328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:55.288328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:55.288328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:55.288328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:55.288328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:39:55.288328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:39:55.288328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:39:55.289336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:39:55.289336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:55.289336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:55.289336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:55.289336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:55.289336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:55.289336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:55.289336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:55.289336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:55.289336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:55.289336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:55.289336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:55.289336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:55.289336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:55.289336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:55.289336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:55.289336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:55.290522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:39:55.290522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:39:55.290522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:39:55.290522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:39:55.290522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:39:55.290522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:39:55.290522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:39:55.290522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:55.290522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 251/510] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:39:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:55.291135 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc229bd6-5dbf-4236-8079-68e0ad04ae8c None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:55.294142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875dee34-a5bc-4555-ace3-87ddacc2e1ca None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:55.298405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:55.325625 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ed769-b3be-4045-bf7a-d221fa0437be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:55.326413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ed769-b3be-4045-bf7a-d221fa0437be None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:55.326702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ed769-b3be-4045-bf7a-d221fa0437be None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:55.326977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ed769-b3be-4045-bf7a-d221fa0437be None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:55.333911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ed769-b3be-4045-bf7a-d221fa0437be None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:55.335325 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ed769-b3be-4045-bf7a-d221fa0437be None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:55.349450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-891ed769-b3be-4045-bf7a-d221fa0437be None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 13:39:55.349450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:55.349450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:55.349450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:55.349450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:55.349450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:55.349450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:55.349450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:55.349450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:55.349450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:55.349450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:55.349450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:55.349450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:39:55.349450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:39:55.349450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:39:55.349450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:39:55.350479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:55.350479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:55.350479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:39:55.350479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:39:55.350479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:39:55.350479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:39:55.350479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:55.350479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:55.350479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:55.350479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:55.350479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:55.350479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:55.350479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:55.350479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:55.350479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:55.350479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:55.350479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:55.350479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:55.356099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:55.356099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:55.356099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:39:55.356099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:39:55.356099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:39:55.356099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:39:55.356099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:39:55.356099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:39:55.356099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 13:39:55.356099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:55.356099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 260/511] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:55.356099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ed769-b3be-4045-bf7a-d221fa0437be None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:55.383064 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:55.395298 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875dee34-a5bc-4555-ace3-87ddacc2e1ca None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:55.429885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f4d98-d0a5-444a-8d2d-251ebf3a4a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:55.430539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f4d98-d0a5-444a-8d2d-251ebf3a4a5c None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:55.430820 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f4d98-d0a5-444a-8d2d-251ebf3a4a5c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:55.431092 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f4d98-d0a5-444a-8d2d-251ebf3a4a5c None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:55.431799 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f4d98-d0a5-444a-8d2d-251ebf3a4a5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:55.432451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f4d98-d0a5-444a-8d2d-251ebf3a4a5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:55.434015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f4d98-d0a5-444a-8d2d-251ebf3a4a5c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:55.446494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 252/512] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:55.447276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f4d98-d0a5-444a-8d2d-251ebf3a4a5c None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:55.451184 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ed769-b3be-4045-bf7a-d221fa0437be None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:55.487625 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801aab4-9bdc-4edd-8699-0f238a6796d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:55.488283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801aab4-9bdc-4edd-8699-0f238a6796d2 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:55.488565 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801aab4-9bdc-4edd-8699-0f238a6796d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:55.488841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801aab4-9bdc-4edd-8699-0f238a6796d2 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:55.489597 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801aab4-9bdc-4edd-8699-0f238a6796d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:55.490717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801aab4-9bdc-4edd-8699-0f238a6796d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:55.491853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801aab4-9bdc-4edd-8699-0f238a6796d2 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:55.503032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 261/513] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:55.503927 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801aab4-9bdc-4edd-8699-0f238a6796d2 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:55.508728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:55.546677 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f4d98-d0a5-444a-8d2d-251ebf3a4a5c None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:55.579362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cc1a3-a633-45a6-9896-b23bbe667890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:55.580151 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cc1a3-a633-45a6-9896-b23bbe667890 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:55.580429 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cc1a3-a633-45a6-9896-b23bbe667890 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:55.580703 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cc1a3-a633-45a6-9896-b23bbe667890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:55.590574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03cc1a3-a633-45a6-9896-b23bbe667890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:55.592037 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03cc1a3-a633-45a6-9896-b23bbe667890 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:55.596516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:55.607236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801aab4-9bdc-4edd-8699-0f238a6796d2 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:55.610392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-e03cc1a3-a633-45a6-9896-b23bbe667890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:55.610392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:55.610392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:55.610392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:55.610392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:55.610392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:55.610392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:55.610392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:55.610392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:55.610392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:55.610392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:55.610392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:55.610392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:39:55.610392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:39:55.610392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:39:55.611372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:39:55.611372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:55.611372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:55.611372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:55.611372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:55.611372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:55.611372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:55.611372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:55.611372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:55.611372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:55.611372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:55.611372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:55.611372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:55.611372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:55.611372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:55.611372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:55.611372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:55.612503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:39:55.612503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:39:55.612503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:55.612503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:55.612503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 253/514] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:55.612894 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cc1a3-a633-45a6-9896-b23bbe667890 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:55.644481 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b4ead-3f70-4e26-8270-700bf13581a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:55.645131 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b4ead-3f70-4e26-8270-700bf13581a6 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:55.645443 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b4ead-3f70-4e26-8270-700bf13581a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:55.645716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b4ead-3f70-4e26-8270-700bf13581a6 None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:55.646591 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b4ead-3f70-4e26-8270-700bf13581a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:55.647015 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b4ead-3f70-4e26-8270-700bf13581a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:55.648425 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b4ead-3f70-4e26-8270-700bf13581a6 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:55.666597 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 262/515] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:39:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:55.667301 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b4ead-3f70-4e26-8270-700bf13581a6 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:55.715235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cc1a3-a633-45a6-9896-b23bbe667890 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:55.735733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:55.756891 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61c5fc-e8c2-4a31-8fa4-950d647afca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:55.757582 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61c5fc-e8c2-4a31-8fa4-950d647afca5 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:55.757857 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61c5fc-e8c2-4a31-8fa4-950d647afca5 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:55.758124 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61c5fc-e8c2-4a31-8fa4-950d647afca5 None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:55.758946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61c5fc-e8c2-4a31-8fa4-950d647afca5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:55.759248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61c5fc-e8c2-4a31-8fa4-950d647afca5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:55.760929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61c5fc-e8c2-4a31-8fa4-950d647afca5 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:55.777114 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b4ead-3f70-4e26-8270-700bf13581a6 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:55.797589 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 254/516] 10.222.0.45 () {56 vars in 1137 bytes} [Thu May 26 13:39:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:55.798422 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61c5fc-e8c2-4a31-8fa4-950d647afca5 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:55.811723 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54216a-b289-478b-8efe-99cc23e604e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:55.812522 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54216a-b289-478b-8efe-99cc23e604e1 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:55.812804 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54216a-b289-478b-8efe-99cc23e604e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:55.813084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54216a-b289-478b-8efe-99cc23e604e1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:55.822117 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54216a-b289-478b-8efe-99cc23e604e1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:55.823556 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54216a-b289-478b-8efe-99cc23e604e1 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:55.839408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-6c54216a-b289-478b-8efe-99cc23e604e1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 13:39:55.839408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:55.839408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:55.839408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:55.839408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:55.839408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:55.839408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:55.839408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:55.839408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:55.839408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:55.839408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:55.839408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:55.839408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:39:55.839408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:39:55.839408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:39:55.839408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:39:55.840348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:55.840348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:55.840348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:39:55.840348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:39:55.840348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:39:55.840348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:39:55.840348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:55.840348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:55.840348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:55.840348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:55.840348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:55.840348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:55.840348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:55.840348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:55.840348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:55.840348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:55.840348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:55.840348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:55.841330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:55.841330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:55.841330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:39:55.841330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:39:55.841330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:39:55.841330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:39:55.841330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:39:55.841330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:39:55.841330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 13:39:55.841330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:55.844517 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 263/517] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:39:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:55.845071 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54216a-b289-478b-8efe-99cc23e604e1 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:55.857401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:55.905840 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61c5fc-e8c2-4a31-8fa4-950d647afca5 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:55.943683 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b521d9b-db4f-4462-b083-622bf3c2127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:55.944397 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b521d9b-db4f-4462-b083-622bf3c2127f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:55.944688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b521d9b-db4f-4462-b083-622bf3c2127f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:55.944965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b521d9b-db4f-4462-b083-622bf3c2127f None admin] PATH_INFO: `/v3/users/glance` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:55.946738 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54216a-b289-478b-8efe-99cc23e604e1 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:55.955872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b521d9b-db4f-4462-b083-622bf3c2127f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:55.957353 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b521d9b-db4f-4462-b083-622bf3c2127f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:55.973695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-9b521d9b-db4f-4462-b083-622bf3c2127f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 13:39:55.973695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:55.973695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:55.973695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:55.973695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:55.973695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:55.973695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:55.973695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:55.973695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:55.973695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:55.973695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:55.973695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:55.973695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:39:55.973695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:39:55.973695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:39:55.973695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:39:55.975400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:55.975400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:55.975400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:39:55.975400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:39:55.975400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:39:55.975400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:39:55.975400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:55.975400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:55.975400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:55.975400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:55.975400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:55.975400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:55.975400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:55.975400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:55.975400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:55.975400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:55.975400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:55.975400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:55.976532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:55.976532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:55.976532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:39:55.976532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:39:55.976532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:39:55.976532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:39:55.976532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:39:55.976532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:39:55.976532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 13:39:55.976532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:55.976532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 255/518] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:39:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:55.976532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b521d9b-db4f-4462-b083-622bf3c2127f None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:55.984919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c7334-de86-4f0d-b488-92990007b458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:55.985609 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c7334-de86-4f0d-b488-92990007b458 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:55.985889 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c7334-de86-4f0d-b488-92990007b458 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:55.986162 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c7334-de86-4f0d-b488-92990007b458 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:55.986878 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c7334-de86-4f0d-b488-92990007b458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:55.987181 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c7334-de86-4f0d-b488-92990007b458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:55.988529 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c7334-de86-4f0d-b488-92990007b458 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:55.999792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 264/519] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:56.000616 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c7334-de86-4f0d-b488-92990007b458 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:56.015121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:56.073039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:56.086589 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b521d9b-db4f-4462-b083-622bf3c2127f None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:56.108087 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c7334-de86-4f0d-b488-92990007b458 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:56.121855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aae763-4cb5-4ca8-a165-6ff007ffb2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:56.122519 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aae763-4cb5-4ca8-a165-6ff007ffb2bd None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:56.122801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aae763-4cb5-4ca8-a165-6ff007ffb2bd None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:56.123080 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aae763-4cb5-4ca8-a165-6ff007ffb2bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:56.124798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aae763-4cb5-4ca8-a165-6ff007ffb2bd None admin] RBAC: Adding query filter params (role.id=0bb0d62bb4f84638888ceb6ecabda8b3, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=1994043a81bb454297c208839794a479) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:56.124798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aae763-4cb5-4ca8-a165-6ff007ffb2bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:56.125667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aae763-4cb5-4ca8-a165-6ff007ffb2bd None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:56.133321 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 256/520] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:39:55 2022] GET /identity/v3/role_assignments?user.id=1994043a81bb454297c208839794a479&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=0bb0d62bb4f84638888ceb6ecabda8b3 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:56.133321 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aae763-4cb5-4ca8-a165-6ff007ffb2bd None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:56.149033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6657ba0-2b45-419b-9929-df355f0997f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:56.149765 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6657ba0-2b45-419b-9929-df355f0997f0 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:56.150050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6657ba0-2b45-419b-9929-df355f0997f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:56.150330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6657ba0-2b45-419b-9929-df355f0997f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:56.241336 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6657ba0-2b45-419b-9929-df355f0997f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:56.242760 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6657ba0-2b45-419b-9929-df355f0997f0 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:56.253130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:56.260052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aae763-4cb5-4ca8-a165-6ff007ffb2bd None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:56.306225 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dc053-9a6c-442e-8645-756c8525f05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:56.306831 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dc053-9a6c-442e-8645-756c8525f05d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:56.307113 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dc053-9a6c-442e-8645-756c8525f05d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:56.307382 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dc053-9a6c-442e-8645-756c8525f05d None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:56.308240 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0dc053-9a6c-442e-8645-756c8525f05d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:56.308721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0dc053-9a6c-442e-8645-756c8525f05d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:56.310260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0dc053-9a6c-442e-8645-756c8525f05d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:56.320873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:56.336913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 257/521] 10.222.0.45 () {56 vars in 1139 bytes} [Thu May 26 13:39:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:56.336913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dc053-9a6c-442e-8645-756c8525f05d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:56.365176 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 265/522] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:56.366304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6657ba0-2b45-419b-9929-df355f0997f0 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:56.445077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dc053-9a6c-442e-8645-756c8525f05d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:56.471563 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6657ba0-2b45-419b-9929-df355f0997f0 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:56.481364 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6173909-e1dd-45e6-8be6-504926a7aab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:56.482039 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6173909-e1dd-45e6-8be6-504926a7aab9 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:56.482320 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6173909-e1dd-45e6-8be6-504926a7aab9 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:56.482594 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6173909-e1dd-45e6-8be6-504926a7aab9 None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:56.483522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6173909-e1dd-45e6-8be6-504926a7aab9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:56.483838 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6173909-e1dd-45e6-8be6-504926a7aab9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:56.485261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6173909-e1dd-45e6-8be6-504926a7aab9 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:56.503050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 258/523] 10.222.0.45 () {56 vars in 1137 bytes} [Thu May 26 13:39:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:56.503797 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6173909-e1dd-45e6-8be6-504926a7aab9 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:56.512646 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ba05b-892e-4bf4-b090-bed494392f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:56.513761 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ba05b-892e-4bf4-b090-bed494392f9e None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:56.514050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ba05b-892e-4bf4-b090-bed494392f9e None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:56.514329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ba05b-892e-4bf4-b090-bed494392f9e None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:56.515376 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ba05b-892e-4bf4-b090-bed494392f9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:56.517113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ba05b-892e-4bf4-b090-bed494392f9e None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:56.520352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:56.539308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 266/524] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 13:39:56 2022] POST /identity/v3/users => generated 247 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:39:56.540482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ba05b-892e-4bf4-b090-bed494392f9e None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:56.581835 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:56.642693 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6173909-e1dd-45e6-8be6-504926a7aab9 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:56.687758 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ba05b-892e-4bf4-b090-bed494392f9e None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:56.699893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7c61c-b10a-4e77-a10a-cbb58b2d6178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:56.701077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7c61c-b10a-4e77-a10a-cbb58b2d6178 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:56.701403 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7c61c-b10a-4e77-a10a-cbb58b2d6178 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:56.701687 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7c61c-b10a-4e77-a10a-cbb58b2d6178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:56.739306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711c688-ad88-4f2e-bec4-49ebb9a03f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:56.740474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711c688-ad88-4f2e-bec4-49ebb9a03f2f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:56.740823 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711c688-ad88-4f2e-bec4-49ebb9a03f2f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:56.741098 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711c688-ad88-4f2e-bec4-49ebb9a03f2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:56.753120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711c688-ad88-4f2e-bec4-49ebb9a03f2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:56.754546 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711c688-ad88-4f2e-bec4-49ebb9a03f2f None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:56.775912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-7711c688-ad88-4f2e-bec4-49ebb9a03f2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:56.775912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:56.775912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:56.775912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:56.775912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:56.775912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:56.775912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:56.775912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:56.775912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:56.775912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:56.775912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:56.775912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:56.775912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:39:56.775912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:39:56.775912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:39:56.776805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:39:56.776805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:56.776805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:56.776805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:56.776805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:56.776805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:56.776805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:56.776805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:56.776805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:56.776805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:56.776805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:56.776805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:56.776805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:56.776805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:56.776805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:56.776805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:56.776805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:56.777748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:39:56.777748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:39:56.777748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:56.777748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:56.777748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 267/525] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:56.778652 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711c688-ad88-4f2e-bec4-49ebb9a03f2f None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:56.804477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7c61c-b10a-4e77-a10a-cbb58b2d6178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:56.806153 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7c61c-b10a-4e77-a10a-cbb58b2d6178 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:56.823845 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:56.878272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:56.907194 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711c688-ad88-4f2e-bec4-49ebb9a03f2f None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:56.935713 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 259/526] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:56.937453 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7c61c-b10a-4e77-a10a-cbb58b2d6178 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:56.958087 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7fa73-956f-4969-a34c-c99154bfcb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:56.959153 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7fa73-956f-4969-a34c-c99154bfcb0c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:56.959923 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7fa73-956f-4969-a34c-c99154bfcb0c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:56.960297 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7fa73-956f-4969-a34c-c99154bfcb0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:57.050158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7fa73-956f-4969-a34c-c99154bfcb0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:57.051597 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7fa73-956f-4969-a34c-c99154bfcb0c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:57.074639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7c61c-b10a-4e77-a10a-cbb58b2d6178 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:57.095668 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:57.138002 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:57.139796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcb733-7874-4bd1-a2f2-8ba0d0d3d91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:57.140891 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb733-7874-4bd1-a2f2-8ba0d0d3d91c None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:57.141326 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb733-7874-4bd1-a2f2-8ba0d0d3d91c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:57.142106 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb733-7874-4bd1-a2f2-8ba0d0d3d91c None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:57.143290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcb733-7874-4bd1-a2f2-8ba0d0d3d91c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:57.143745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcb733-7874-4bd1-a2f2-8ba0d0d3d91c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:57.146462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcb733-7874-4bd1-a2f2-8ba0d0d3d91c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:57.162435 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 268/527] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:39:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:39:57.162852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 260/528] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:57.163095 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7fa73-956f-4969-a34c-c99154bfcb0c None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:57.168078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcb733-7874-4bd1-a2f2-8ba0d0d3d91c None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:57.267818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7fa73-956f-4969-a34c-c99154bfcb0c None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:57.275269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcb733-7874-4bd1-a2f2-8ba0d0d3d91c None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:57.304100 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153fa57-5960-427b-9b76-bb559d30ca51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:57.304819 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153fa57-5960-427b-9b76-bb559d30ca51 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:57.305103 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153fa57-5960-427b-9b76-bb559d30ca51 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:57.305430 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153fa57-5960-427b-9b76-bb559d30ca51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:57.312601 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1df8d2-0438-4ab4-925c-b08b2d0994f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:57.313532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1df8d2-0438-4ab4-925c-b08b2d0994f0 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:57.313914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1df8d2-0438-4ab4-925c-b08b2d0994f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:57.314341 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1df8d2-0438-4ab4-925c-b08b2d0994f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:57.316452 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153fa57-5960-427b-9b76-bb559d30ca51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:57.317932 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153fa57-5960-427b-9b76-bb559d30ca51 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:57.326014 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1df8d2-0438-4ab4-925c-b08b2d0994f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:57.327710 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1df8d2-0438-4ab4-925c-b08b2d0994f0 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:57.336638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-0153fa57-5960-427b-9b76-bb559d30ca51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:57.336638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:57.336638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:57.336638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:57.336638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:57.336638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:57.336638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:57.336638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:57.336638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:57.336638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:57.336638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:57.336638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:57.336638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:39:57.336638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:39:57.336638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:39:57.337704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:39:57.337704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:57.337704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:57.337704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:57.337704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:57.337704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:57.337704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:57.337704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:57.337704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:57.337704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:57.337704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:57.337704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:57.337704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:57.337704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:57.337704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:57.337704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:57.337704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:57.338770 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:39:57.338770 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:39:57.338770 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:57.338770 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:57.342402 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 269/529] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:57.343250 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153fa57-5960-427b-9b76-bb559d30ca51 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:57.348507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-7a1df8d2-0438-4ab4-925c-b08b2d0994f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:57.348507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:57.348507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:57.348507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:57.348507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:57.348507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:57.348507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:57.348507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:57.348507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:57.348507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:57.348507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:57.348507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:57.348507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:39:57.348507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:39:57.348507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:39:57.350197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:39:57.350197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:57.350197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:57.350197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:57.350197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:57.350197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:57.350197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:57.350197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:57.350197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:57.350197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:57.350197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:57.350197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:57.350197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:57.350197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:57.350197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:57.350197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:57.350197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:57.351263 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:39:57.351263 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:39:57.351263 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:57.351263 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:57.352950 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 261/530] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:57.358338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1df8d2-0438-4ab4-925c-b08b2d0994f0 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:57.375149 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:57.393731 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:57.451609 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153fa57-5960-427b-9b76-bb559d30ca51 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:57.472037 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1df8d2-0438-4ab4-925c-b08b2d0994f0 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:57.489057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6b27c-a1cc-44bf-9213-25c719fd0b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:57.489926 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6b27c-a1cc-44bf-9213-25c719fd0b75 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:57.490209 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6b27c-a1cc-44bf-9213-25c719fd0b75 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:57.490487 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6b27c-a1cc-44bf-9213-25c719fd0b75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:57.497891 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6b27c-a1cc-44bf-9213-25c719fd0b75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:57.499439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6b27c-a1cc-44bf-9213-25c719fd0b75 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:57.509505 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562af87-1326-4708-a615-e6a3572c9e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:57.510534 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562af87-1326-4708-a615-e6a3572c9e84 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:57.510910 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562af87-1326-4708-a615-e6a3572c9e84 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:57.511283 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562af87-1326-4708-a615-e6a3572c9e84 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:57.512092 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562af87-1326-4708-a615-e6a3572c9e84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:57.512495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562af87-1326-4708-a615-e6a3572c9e84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:57.513983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562af87-1326-4708-a615-e6a3572c9e84 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:57.514945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-bba6b27c-a1cc-44bf-9213-25c719fd0b75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:39:57.514945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:57.514945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:57.514945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:57.514945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:57.514945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:57.514945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:57.514945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:57.514945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:57.514945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:57.514945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:57.514945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:57.514945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:39:57.514945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:39:57.514945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:39:57.515950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:39:57.515950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:57.515950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:57.515950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:57.515950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:57.515950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:57.515950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:57.515950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:57.515950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:57.515950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:57.515950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:57.515950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:57.515950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:57.515950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:57.515950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:57.515950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:57.515950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:57.517573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:39:57.517573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:39:57.517573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:39:57.517573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:39:57.517573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:39:57.517573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:39:57.517573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:39:57.517573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:57.517573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 270/531] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:39:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:57.517573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6b27c-a1cc-44bf-9213-25c719fd0b75 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:57.532944 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 262/532] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:57.533795 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562af87-1326-4708-a615-e6a3572c9e84 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:57.618141 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:57.620898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:57.630781 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6b27c-a1cc-44bf-9213-25c719fd0b75 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:57.633173 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562af87-1326-4708-a615-e6a3572c9e84 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:57.673206 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7645ea7-96d3-44d3-bd36-9256fe3f69de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:57.673899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7645ea7-96d3-44d3-bd36-9256fe3f69de None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:57.674176 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7645ea7-96d3-44d3-bd36-9256fe3f69de None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:57.677289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7645ea7-96d3-44d3-bd36-9256fe3f69de None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:57.677515 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5331f7-7ad9-4eb8-ad7c-dbab55438327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:57.677515 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5331f7-7ad9-4eb8-ad7c-dbab55438327 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:57.677515 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5331f7-7ad9-4eb8-ad7c-dbab55438327 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:57.677515 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5331f7-7ad9-4eb8-ad7c-dbab55438327 None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:57.678447 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5331f7-7ad9-4eb8-ad7c-dbab55438327 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:57.678591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5331f7-7ad9-4eb8-ad7c-dbab55438327 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:57.679932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5331f7-7ad9-4eb8-ad7c-dbab55438327 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:57.680913 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7645ea7-96d3-44d3-bd36-9256fe3f69de None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:57.681175 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7645ea7-96d3-44d3-bd36-9256fe3f69de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:57.682566 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7645ea7-96d3-44d3-bd36-9256fe3f69de None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:57.700814 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 271/533] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:57.701637 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7645ea7-96d3-44d3-bd36-9256fe3f69de None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:57.707705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 263/534] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:39:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:57.709442 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5331f7-7ad9-4eb8-ad7c-dbab55438327 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:57.822154 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7645ea7-96d3-44d3-bd36-9256fe3f69de None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:57.838569 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5331f7-7ad9-4eb8-ad7c-dbab55438327 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:57.864306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d135473-8991-4d14-aaa1-7c23360b5d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:57.865068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d135473-8991-4d14-aaa1-7c23360b5d90 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:57.865451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d135473-8991-4d14-aaa1-7c23360b5d90 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:57.865739 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d135473-8991-4d14-aaa1-7c23360b5d90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:57.873127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d135473-8991-4d14-aaa1-7c23360b5d90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:57.875138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d135473-8991-4d14-aaa1-7c23360b5d90 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:57.880367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1d85-ffb7-4afc-883f-805be374e358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:57.882017 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1d85-ffb7-4afc-883f-805be374e358 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:57.882520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1d85-ffb7-4afc-883f-805be374e358 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:57.883025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1d85-ffb7-4afc-883f-805be374e358 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:57.890197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-0d135473-8991-4d14-aaa1-7c23360b5d90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:39:57.890197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:57.890197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:57.890197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:57.890197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:57.890197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:57.890197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:57.890197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:57.890197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:57.890197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:57.890197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:57.890197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:57.890197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:39:57.890197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:39:57.890197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:39:57.891050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:39:57.891050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:57.891050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:57.891050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:57.891050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:57.891050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:57.891050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:57.891050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:57.891050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:57.891050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:57.891050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:57.891050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:57.891050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:57.891050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:57.891050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:57.891050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:57.891050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:57.891920 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:39:57.891920 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:39:57.891920 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:39:57.891920 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:39:57.891920 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:39:57.891920 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:39:57.891920 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:39:57.891920 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:57.893426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef1d85-ffb7-4afc-883f-805be374e358 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:57.895127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef1d85-ffb7-4afc-883f-805be374e358 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:57.897331 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 272/535] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:39:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:57.898206 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d135473-8991-4d14-aaa1-7c23360b5d90 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:57.911261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:57.914607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-83ef1d85-ffb7-4afc-883f-805be374e358 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:39:57.914607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:57.914607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:57.914607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:57.914607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:57.914607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:57.914607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:57.914607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:57.914607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:57.914607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:57.914607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:57.914607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:57.914607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:39:57.914607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:39:57.914607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:39:57.917434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:39:57.917434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:57.917434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:57.917434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:57.917434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:57.917434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:57.917434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:57.917434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:57.917434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:57.917434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:57.917434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:57.917434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:57.917434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:57.917434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:57.917434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:57.917434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:57.917434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:57.918583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:39:57.918583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:39:57.918583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:39:57.918583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:39:57.918583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:39:57.918583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:39:57.918583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:39:57.918583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:57.918583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 264/536] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:39:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:57.920005 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1d85-ffb7-4afc-883f-805be374e358 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:57.930864 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:58.010000 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d135473-8991-4d14-aaa1-7c23360b5d90 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:58.028279 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1d85-ffb7-4afc-883f-805be374e358 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:58.045638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5a0d4-9f92-48ed-a7ef-12c2659523de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:58.046348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5a0d4-9f92-48ed-a7ef-12c2659523de None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:58.046563 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5a0d4-9f92-48ed-a7ef-12c2659523de None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:58.046841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5a0d4-9f92-48ed-a7ef-12c2659523de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:58.047665 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5a0d4-9f92-48ed-a7ef-12c2659523de None admin] RBAC: Adding query filter params (role.id=0bb0d62bb4f84638888ceb6ecabda8b3, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=c8aed4c31eb14a3bbba08bef799ee450) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:58.047974 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5a0d4-9f92-48ed-a7ef-12c2659523de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:58.049494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5a0d4-9f92-48ed-a7ef-12c2659523de None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:58.061811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 273/537] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:39:57 2022] GET /identity/v3/role_assignments?user.id=c8aed4c31eb14a3bbba08bef799ee450&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=0bb0d62bb4f84638888ceb6ecabda8b3 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:58.063017 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5a0d4-9f92-48ed-a7ef-12c2659523de None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:58.067986 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad8ade-ed1c-4711-ac5a-0d4908ac5044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:58.069020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad8ade-ed1c-4711-ac5a-0d4908ac5044 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:58.069534 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad8ade-ed1c-4711-ac5a-0d4908ac5044 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:58.070072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad8ade-ed1c-4711-ac5a-0d4908ac5044 None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:58.071177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad8ade-ed1c-4711-ac5a-0d4908ac5044 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:58.071687 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad8ade-ed1c-4711-ac5a-0d4908ac5044 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:58.073395 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad8ade-ed1c-4711-ac5a-0d4908ac5044 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:58.087551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 265/538] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:39:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:58.113767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad8ade-ed1c-4711-ac5a-0d4908ac5044 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:58.192749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5a0d4-9f92-48ed-a7ef-12c2659523de None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:58.205675 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:58.241172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94890953-b9a2-40f5-bb11-6ed48bc950d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:58.243707 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94890953-b9a2-40f5-bb11-6ed48bc950d0 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:58.245033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94890953-b9a2-40f5-bb11-6ed48bc950d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:58.245560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94890953-b9a2-40f5-bb11-6ed48bc950d0 None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:58.247348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94890953-b9a2-40f5-bb11-6ed48bc950d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:58.248096 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94890953-b9a2-40f5-bb11-6ed48bc950d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:58.251153 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94890953-b9a2-40f5-bb11-6ed48bc950d0 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:58.261659 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:58.278767 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 274/539] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:39:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:58.284505 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94890953-b9a2-40f5-bb11-6ed48bc950d0 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:58.323919 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad8ade-ed1c-4711-ac5a-0d4908ac5044 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:58.373008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8fd89-4ab7-4e8e-aa03-6b04cc2d0e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:58.373998 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8fd89-4ab7-4e8e-aa03-6b04cc2d0e1d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:58.374283 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8fd89-4ab7-4e8e-aa03-6b04cc2d0e1d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:58.374794 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8fd89-4ab7-4e8e-aa03-6b04cc2d0e1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:58.376054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8fd89-4ab7-4e8e-aa03-6b04cc2d0e1d None admin] RBAC: Adding query filter params (role.id=0bb0d62bb4f84638888ceb6ecabda8b3, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=45105360300a4cae802fdbda91b9d5cb) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:58.377757 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8fd89-4ab7-4e8e-aa03-6b04cc2d0e1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:58.379225 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8fd89-4ab7-4e8e-aa03-6b04cc2d0e1d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:58.386311 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 266/540] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:39:58 2022] GET /identity/v3/role_assignments?user.id=45105360300a4cae802fdbda91b9d5cb&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=0bb0d62bb4f84638888ceb6ecabda8b3 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:58.432465 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908d44c-07b6-4b15-96e3-e7f57f8e3de6 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:58.432821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908d44c-07b6-4b15-96e3-e7f57f8e3de6 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:58.433035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908d44c-07b6-4b15-96e3-e7f57f8e3de6 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:58.434699 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 267/541] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:39:58.454889 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee89ea-daad-4959-aedc-fdea9a57338b None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:58.455131 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee89ea-daad-4959-aedc-fdea9a57338b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:58.455361 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee89ea-daad-4959-aedc-fdea9a57338b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:58.456536 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94890953-b9a2-40f5-bb11-6ed48bc950d0 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:58.498252 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19eda4-ed0c-45d9-90dc-45ee572de429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:58.499215 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19eda4-ed0c-45d9-90dc-45ee572de429 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:58.499674 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19eda4-ed0c-45d9-90dc-45ee572de429 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:58.500152 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19eda4-ed0c-45d9-90dc-45ee572de429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:58.501164 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19eda4-ed0c-45d9-90dc-45ee572de429 None admin] RBAC: Adding query filter params (role.id=0bb0d62bb4f84638888ceb6ecabda8b3, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=e3039ec7e613464c8a71f4440dfe8bc1) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:58.501757 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19eda4-ed0c-45d9-90dc-45ee572de429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:58.502381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-cdee89ea-daad-4959-aedc-fdea9a57338b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:58.503618 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-cdee89ea-daad-4959-aedc-fdea9a57338b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:58.503857 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19eda4-ed0c-45d9-90dc-45ee572de429 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:58.506956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:58.519883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 275/542] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:39:58 2022] GET /identity/v3/role_assignments?user.id=e3039ec7e613464c8a71f4440dfe8bc1&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=0bb0d62bb4f84638888ceb6ecabda8b3 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:58.643099 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 268/543] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:39:58.682090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19eda4-ed0c-45d9-90dc-45ee572de429 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:58.816299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19eda4-ed0c-45d9-90dc-45ee572de429 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:58.850798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6a572-587e-41ac-8664-f1f4d70c5abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:58.851600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6a572-587e-41ac-8664-f1f4d70c5abf None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:58.851881 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6a572-587e-41ac-8664-f1f4d70c5abf None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:58.852157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6a572-587e-41ac-8664-f1f4d70c5abf None admin] PATH_INFO: `/v3/roles/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:58.862416 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6a572-587e-41ac-8664-f1f4d70c5abf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:58.870873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-4db6a572-587e-41ac-8664-f1f4d70c5abf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:39:58.870873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:58.870873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:58.870873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:58.870873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:58.870873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:58.870873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:58.870873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:58.870873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:58.870873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:58.870873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:58.870873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:58.870873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:58.870873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:58.870873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:58.870873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:58.871762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:58.871762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:58.871762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:58.871762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:58.871762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:58.871762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:58.871762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:58.871762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:58.871762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:58.871762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:58.871762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:58.871762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:58.871762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:58.871762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:58.871762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:58.871762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:58.872550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:58.872550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:58.872550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:58.872550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:58.872550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:58.872550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:58.872550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:58.872550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:58.872550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:58.872550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:58.872550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:39:58.872550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:58.872550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 276/544] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:39:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:58.877826 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee89ea-daad-4959-aedc-fdea9a57338b None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:58.960633 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0be93-80bf-4b36-aa01-bc2a1fab4867 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:58.960953 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0be93-80bf-4b36-aa01-bc2a1fab4867 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:58.961198 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0be93-80bf-4b36-aa01-bc2a1fab4867 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:58.962740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 277/545] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:39:58.968417 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e596a-2546-41ff-9663-47abb326fb12 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:58.968724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e596a-2546-41ff-9663-47abb326fb12 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:58.968933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e596a-2546-41ff-9663-47abb326fb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:58.983129 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:59.006884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-0e0e596a-2546-41ff-9663-47abb326fb12 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:59.008102 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0e0e596a-2546-41ff-9663-47abb326fb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:59.024952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee89ea-daad-4959-aedc-fdea9a57338b None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:59.071714 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401b7da-7126-47bd-b93b-7ca895d3e2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:59.072335 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401b7da-7126-47bd-b93b-7ca895d3e2a9 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:59.072618 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401b7da-7126-47bd-b93b-7ca895d3e2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:59.072892 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401b7da-7126-47bd-b93b-7ca895d3e2a9 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:59.073680 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401b7da-7126-47bd-b93b-7ca895d3e2a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:59.073988 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401b7da-7126-47bd-b93b-7ca895d3e2a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:59.075367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401b7da-7126-47bd-b93b-7ca895d3e2a9 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:59.085553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 269/546] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:39:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:59.091677 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401b7da-7126-47bd-b93b-7ca895d3e2a9 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:59.123730 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:59.158232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 278/547] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:39:59.223894 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e596a-2546-41ff-9663-47abb326fb12 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:59.230923 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401b7da-7126-47bd-b93b-7ca895d3e2a9 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:59.263645 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:59.276786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee503a0-26b2-47e7-88c4-58f0cfc8e0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:59.277696 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee503a0-26b2-47e7-88c4-58f0cfc8e0b4 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:59.278101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee503a0-26b2-47e7-88c4-58f0cfc8e0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:59.278449 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee503a0-26b2-47e7-88c4-58f0cfc8e0b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:59.290457 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee503a0-26b2-47e7-88c4-58f0cfc8e0b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:59.292004 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee503a0-26b2-47e7-88c4-58f0cfc8e0b4 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:59.310692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-5ee503a0-26b2-47e7-88c4-58f0cfc8e0b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:59.310692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:59.310692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:59.310692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:59.310692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:59.310692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:59.310692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:59.310692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:59.310692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:59.310692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:59.310692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:59.310692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:59.310692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:39:59.310692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:39:59.310692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:39:59.311551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:39:59.311551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:59.311551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:59.311551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:59.311551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:59.311551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:59.311551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:59.311551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:59.311551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:59.311551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:59.311551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:59.311551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:59.311551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:59.311551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:59.311551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:59.311551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:59.311551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:59.312507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:39:59.312507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:39:59.312507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:39:59.312507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:59.314797 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 270/548] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:59.320316 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee503a0-26b2-47e7-88c4-58f0cfc8e0b4 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:59.432789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee503a0-26b2-47e7-88c4-58f0cfc8e0b4 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:59.470905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712a5b2-0c6e-48ed-93ca-5c4bf73eac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:59.472155 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712a5b2-0c6e-48ed-93ca-5c4bf73eac78 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:59.472679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712a5b2-0c6e-48ed-93ca-5c4bf73eac78 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:59.473056 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712a5b2-0c6e-48ed-93ca-5c4bf73eac78 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:59.473922 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712a5b2-0c6e-48ed-93ca-5c4bf73eac78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:59.474854 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712a5b2-0c6e-48ed-93ca-5c4bf73eac78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:59.476317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712a5b2-0c6e-48ed-93ca-5c4bf73eac78 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:59.490729 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 271/549] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:39:59.496353 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712a5b2-0c6e-48ed-93ca-5c4bf73eac78 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:59.546424 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:59.575192 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e596a-2546-41ff-9663-47abb326fb12 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:59.608642 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712a5b2-0c6e-48ed-93ca-5c4bf73eac78 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:59.644837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f931e4-7365-4688-80f9-549be1573c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:59.648532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f931e4-7365-4688-80f9-549be1573c65 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:59.648828 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f931e4-7365-4688-80f9-549be1573c65 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:59.649111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f931e4-7365-4688-80f9-549be1573c65 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:59.664491 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f931e4-7365-4688-80f9-549be1573c65 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:59.665975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f931e4-7365-4688-80f9-549be1573c65 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:59.671846 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62623e-af02-4a85-9ff1-7053b6ddf806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:59.672640 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62623e-af02-4a85-9ff1-7053b6ddf806 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:59.672919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62623e-af02-4a85-9ff1-7053b6ddf806 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:59.673190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62623e-af02-4a85-9ff1-7053b6ddf806 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:59.695188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-f2f931e4-7365-4688-80f9-549be1573c65 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 13:39:59.695188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:59.695188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:59.695188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:59.695188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:59.695188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:59.695188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:59.695188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:59.695188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:59.695188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:59.695188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:59.695188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:59.695188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:39:59.695188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:39:59.695188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:39:59.695188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:39:59.696166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:59.696166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:59.696166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:39:59.696166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:39:59.696166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:39:59.696166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:39:59.696166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:59.696166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:59.696166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:59.696166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:59.696166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:59.696166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:39:59.696166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:59.696166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:59.696166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:59.696166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:59.696166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:59.696166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:59.697183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:59.697183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:59.697183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:39:59.697183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:39:59.697183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:39:59.697183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:39:59.697183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:39:59.697183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:39:59.697183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 13:39:59.697183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:39:59.697737 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62623e-af02-4a85-9ff1-7053b6ddf806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:39:59.709969 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 272/550] 10.222.0.45 () {56 vars in 1093 bytes} [Thu May 26 13:39:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:39:59.710781 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f931e4-7365-4688-80f9-549be1573c65 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:59.719722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-9f62623e-af02-4a85-9ff1-7053b6ddf806 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:39:59.719722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:39:59.719722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:39:59.719722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:39:59.719722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:39:59.719722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:39:59.719722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:39:59.719722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:39:59.719722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:39:59.719722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:39:59.719722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:39:59.719722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:39:59.719722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:39:59.719722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:39:59.719722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:39:59.719722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:39:59.721863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:39:59.721863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:39:59.721863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:39:59.721863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:39:59.721863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:39:59.721863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:39:59.721863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:39:59.721863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:39:59.721863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:39:59.721863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:39:59.721863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:39:59.721863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:39:59.721863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:39:59.721863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:39:59.721863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:39:59.721863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:39:59.724029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:39:59.724029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:39:59.724029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:39:59.724029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:39:59.724029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:39:59.724029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:39:59.724029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:39:59.724029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:39:59.724029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:39:59.724029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:39:59.724029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:39:59.724029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:39:59.724029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 279/551] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:39:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 498 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:39:59.729291 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62623e-af02-4a85-9ff1-7053b6ddf806 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:59.821650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:59.886372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:59.890518 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f931e4-7365-4688-80f9-549be1573c65 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:59.917074 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62623e-af02-4a85-9ff1-7053b6ddf806 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:59.931187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351482c3-3cae-4035-bf46-d78ed26e10e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:59.931862 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351482c3-3cae-4035-bf46-d78ed26e10e0 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:59.932144 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351482c3-3cae-4035-bf46-d78ed26e10e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:59.932421 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351482c3-3cae-4035-bf46-d78ed26e10e0 None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:59.933328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351482c3-3cae-4035-bf46-d78ed26e10e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:59.933592 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351482c3-3cae-4035-bf46-d78ed26e10e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:59.936829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351482c3-3cae-4035-bf46-d78ed26e10e0 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:59.955842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 273/552] 10.222.0.45 () {56 vars in 1133 bytes} [Thu May 26 13:39:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:39:59.962126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351482c3-3cae-4035-bf46-d78ed26e10e0 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:59.990815 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8204e-8290-42f6-8e5b-007e1ddd8091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:59.991814 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8204e-8290-42f6-8e5b-007e1ddd8091 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:59.992292 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8204e-8290-42f6-8e5b-007e1ddd8091 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:59.992901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8204e-8290-42f6-8e5b-007e1ddd8091 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:59.994034 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8204e-8290-42f6-8e5b-007e1ddd8091 None admin] RBAC: Adding query filter params (name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:39:59.994548 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8204e-8290-42f6-8e5b-007e1ddd8091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:59.996806 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8204e-8290-42f6-8e5b-007e1ddd8091 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:00.013307 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 280/553] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:39:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:00.014727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8204e-8290-42f6-8e5b-007e1ddd8091 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:00.112165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351482c3-3cae-4035-bf46-d78ed26e10e0 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:00.150763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf67fc-ed7b-4105-b272-d4c62c4ba302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:00.151551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf67fc-ed7b-4105-b272-d4c62c4ba302 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:00.151836 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf67fc-ed7b-4105-b272-d4c62c4ba302 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:00.152258 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf67fc-ed7b-4105-b272-d4c62c4ba302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:00.169081 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf67fc-ed7b-4105-b272-d4c62c4ba302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:00.170587 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf67fc-ed7b-4105-b272-d4c62c4ba302 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:00.200976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-03cf67fc-ed7b-4105-b272-d4c62c4ba302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:00.200976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:00.200976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:00.200976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:00.200976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:00.200976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:00.200976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:00.200976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:00.200976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:00.200976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:00.200976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:00.200976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:00.200976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:00.200976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:00.200976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:00.202012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:00.202012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:00.202012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:00.202012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:00.202012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:00.202012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:00.202012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:00.202012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:00.202012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:00.202012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:00.202012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:00.202012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:00.202012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:00.202012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:00.202012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:00.202012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:00.202012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:00.202895 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:00.202895 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:00.202895 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:00.202895 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:00.217788 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 274/554] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:00.218670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf67fc-ed7b-4105-b272-d4c62c4ba302 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:00.228849 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8204e-8290-42f6-8e5b-007e1ddd8091 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:00.245579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:00.246226 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:00.272967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ce950-06e8-4af4-a9bf-651a000f1b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:00.273952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ce950-06e8-4af4-a9bf-651a000f1b47 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:00.274764 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ce950-06e8-4af4-a9bf-651a000f1b47 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:00.275119 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ce950-06e8-4af4-a9bf-651a000f1b47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:00.287479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ce950-06e8-4af4-a9bf-651a000f1b47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:00.289226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ce950-06e8-4af4-a9bf-651a000f1b47 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:00.307860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-324ce950-06e8-4af4-a9bf-651a000f1b47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:00.307860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:00.307860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:00.307860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:00.307860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:00.307860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:00.307860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:00.307860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:00.307860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:00.307860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:00.307860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:00.307860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:00.307860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:00.307860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:00.307860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:00.308945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:00.308945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:00.308945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:00.308945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:00.308945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:00.308945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:00.308945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:00.308945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:00.308945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:00.308945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:00.308945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:00.308945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:00.308945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:00.308945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:00.308945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:00.308945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:00.308945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:00.310376 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:00.310376 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:00.310376 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:00.310376 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:00.310680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 281/555] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:00.318409 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ce950-06e8-4af4-a9bf-651a000f1b47 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:00.415617 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf67fc-ed7b-4105-b272-d4c62c4ba302 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:00.489383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a539da8-be64-4f9d-bb05-d26ae4ac326c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:00.490017 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a539da8-be64-4f9d-bb05-d26ae4ac326c None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:00.490298 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a539da8-be64-4f9d-bb05-d26ae4ac326c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:00.490574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a539da8-be64-4f9d-bb05-d26ae4ac326c None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:00.491303 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a539da8-be64-4f9d-bb05-d26ae4ac326c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:00.491609 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a539da8-be64-4f9d-bb05-d26ae4ac326c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:00.492971 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a539da8-be64-4f9d-bb05-d26ae4ac326c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:00.515128 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 275/556] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:00.524790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a539da8-be64-4f9d-bb05-d26ae4ac326c None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:00.558696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ce950-06e8-4af4-a9bf-651a000f1b47 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:00.629846 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284416f-4ae9-4867-9201-6b2cca52658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:00.630545 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284416f-4ae9-4867-9201-6b2cca52658d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:00.630829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284416f-4ae9-4867-9201-6b2cca52658d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:00.631103 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284416f-4ae9-4867-9201-6b2cca52658d None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:00.631831 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284416f-4ae9-4867-9201-6b2cca52658d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:00.632137 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284416f-4ae9-4867-9201-6b2cca52658d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:00.633529 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284416f-4ae9-4867-9201-6b2cca52658d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:00.635340 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:00.654160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 282/557] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:00.659739 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284416f-4ae9-4867-9201-6b2cca52658d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:00.690319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:00.699920 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a539da8-be64-4f9d-bb05-d26ae4ac326c None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:00.742825 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3dbb3-9934-4001-9d25-5912d2686ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:00.744146 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3dbb3-9934-4001-9d25-5912d2686ea6 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:00.744615 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3dbb3-9934-4001-9d25-5912d2686ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:00.745065 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3dbb3-9934-4001-9d25-5912d2686ea6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:00.756865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3dbb3-9934-4001-9d25-5912d2686ea6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:00.760308 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3dbb3-9934-4001-9d25-5912d2686ea6 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:00.782291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-f8f3dbb3-9934-4001-9d25-5912d2686ea6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:00.782291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:00.782291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:00.782291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:00.782291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:00.782291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:00.782291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:00.782291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:00.782291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:00.782291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:00.782291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:00.782291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:00.782291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:00.782291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:00.782291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:00.783332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:00.783332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:00.783332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:00.783332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:00.783332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:00.783332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:00.783332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:00.783332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:00.783332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:00.783332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:00.783332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:00.783332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:00.783332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:00.783332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:00.783332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:00.783332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:00.783332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:00.784446 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:00.784446 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:00.784446 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:00.784446 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:00.784446 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:00.784446 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:00.784446 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:00.784446 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:00.787715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 276/558] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:00.789292 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25613fcf-ec1c-49d6-8575-7cc55adb670f None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:00.789710 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25613fcf-ec1c-49d6-8575-7cc55adb670f None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:00.790114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25613fcf-ec1c-49d6-8575-7cc55adb670f None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:00.791547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 277/559] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:00.793094 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25613fcf-ec1c-49d6-8575-7cc55adb670f None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:00.798669 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284416f-4ae9-4867-9201-6b2cca52658d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:00.848298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae166560-8e4f-44d2-abde-af8109cd038a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:00.850401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae166560-8e4f-44d2-abde-af8109cd038a None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:00.851003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae166560-8e4f-44d2-abde-af8109cd038a None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:00.851436 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae166560-8e4f-44d2-abde-af8109cd038a None admin] PATH_INFO: `/v3/users/swift` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:00.861460 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae166560-8e4f-44d2-abde-af8109cd038a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:00.863856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae166560-8e4f-44d2-abde-af8109cd038a None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:00.883524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-ae166560-8e4f-44d2-abde-af8109cd038a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 13:40:00.883524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:00.883524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:00.883524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:00.883524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:00.883524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:00.883524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:00.883524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:00.883524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:00.883524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:00.883524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:00.883524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:00.883524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:00.883524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:00.883524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:00.883524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:00.884735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:00.884735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:00.884735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:00.884735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:00.884735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:00.884735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:00.884735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:00.884735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:00.884735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:00.884735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:00.884735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:00.884735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:00.884735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:00.884735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:00.884735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:00.884735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:00.884735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:00.884735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:00.886258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:00.886258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:00.886258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:00.886258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:00.886258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:00.886258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:00.886258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:00.886258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:00.886258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 13:40:00.886258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:00.889232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 283/560] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:40:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:00.891378 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea7677-4f22-4a7c-8e2b-c185c6479d95 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:00.891817 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea7677-4f22-4a7c-8e2b-c185c6479d95 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:00.892240 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea7677-4f22-4a7c-8e2b-c185c6479d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:00.911800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25613fcf-ec1c-49d6-8575-7cc55adb670f None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:00.915671 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-97ea7677-4f22-4a7c-8e2b-c185c6479d95 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:00.917011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-97ea7677-4f22-4a7c-8e2b-c185c6479d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:00.937444 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:00.955214 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f30967-b5d4-4b03-bb7d-4a39464f4b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:00.955876 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f30967-b5d4-4b03-bb7d-4a39464f4b0a None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:00.956155 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f30967-b5d4-4b03-bb7d-4a39464f4b0a None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:00.956430 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f30967-b5d4-4b03-bb7d-4a39464f4b0a None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:00.957207 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f30967-b5d4-4b03-bb7d-4a39464f4b0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:00.957542 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f30967-b5d4-4b03-bb7d-4a39464f4b0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:00.959594 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f30967-b5d4-4b03-bb7d-4a39464f4b0a None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:00.971925 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 278/561] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:00.972746 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f30967-b5d4-4b03-bb7d-4a39464f4b0a None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:01.005852 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 284/562] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:40:01.005852 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11826b-2115-4b49-ad27-b458b402a959 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:01.005852 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11826b-2115-4b49-ad27-b458b402a959 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:01.005852 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11826b-2115-4b49-ad27-b458b402a959 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:01.005852 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 285/563] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:01.005852 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11826b-2115-4b49-ad27-b458b402a959 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:01.027063 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:01.089900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f30967-b5d4-4b03-bb7d-4a39464f4b0a None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:01.123729 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11826b-2115-4b49-ad27-b458b402a959 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:01.128995 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620b38b-8452-42bc-9de9-5e4816879cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:01.129690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620b38b-8452-42bc-9de9-5e4816879cbf None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:01.129972 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620b38b-8452-42bc-9de9-5e4816879cbf None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:01.130300 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620b38b-8452-42bc-9de9-5e4816879cbf None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:01.131690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620b38b-8452-42bc-9de9-5e4816879cbf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:01.131997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620b38b-8452-42bc-9de9-5e4816879cbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:01.133487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620b38b-8452-42bc-9de9-5e4816879cbf None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:01.155533 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 279/564] 10.222.0.45 () {56 vars in 1135 bytes} [Thu May 26 13:40:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:01.155533 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea7da1-b429-46f4-8bde-894be71d630e None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:01.155533 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea7da1-b429-46f4-8bde-894be71d630e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:01.155533 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea7da1-b429-46f4-8bde-894be71d630e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:01.166996 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170fee8-df45-43f1-ac05-9c9903a286e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:01.167885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170fee8-df45-43f1-ac05-9c9903a286e3 None admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:01.168204 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170fee8-df45-43f1-ac05-9c9903a286e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:01.168434 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170fee8-df45-43f1-ac05-9c9903a286e3 None admin] PATH_INFO: `/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/1994043a81bb454297c208839794a479/roles/0bb0d62bb4f84638888ceb6ecabda8b3` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:01.169058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-29ea7da1-b429-46f4-8bde-894be71d630e None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:01.170262 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-29ea7da1-b429-46f4-8bde-894be71d630e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:01.183799 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170fee8-df45-43f1-ac05-9c9903a286e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=095d02b8a79c4915ac8d3c5b81e195a4, user_id=1994043a81bb454297c208839794a479, role_id=0bb0d62bb4f84638888ceb6ecabda8b3)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:01.185236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170fee8-df45-43f1-ac05-9c9903a286e3 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:01.197967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 286/565] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:40:01 2022] PUT /identity/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/1994043a81bb454297c208839794a479/roles/0bb0d62bb4f84638888ceb6ecabda8b3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:40:01.198772 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170fee8-df45-43f1-ac05-9c9903a286e3 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:01.206706 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:01.242530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 280/566] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:40:01.243313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea7da1-b429-46f4-8bde-894be71d630e None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:01.292021 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:01.339380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170fee8-df45-43f1-ac05-9c9903a286e3 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:01.361174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea7da1-b429-46f4-8bde-894be71d630e None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:01.376017 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72274bbb-8251-4149-93f2-49d6b27bdac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:01.376822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72274bbb-8251-4149-93f2-49d6b27bdac8 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:01.377102 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72274bbb-8251-4149-93f2-49d6b27bdac8 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:01.378089 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72274bbb-8251-4149-93f2-49d6b27bdac8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:01.395619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72274bbb-8251-4149-93f2-49d6b27bdac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:01.400842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e591901-460b-4944-b9dc-006aeca285a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:01.401588 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e591901-460b-4944-b9dc-006aeca285a4 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:01.401879 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e591901-460b-4944-b9dc-006aeca285a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:01.402159 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e591901-460b-4944-b9dc-006aeca285a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:01.403874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-72274bbb-8251-4149-93f2-49d6b27bdac8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:01.403874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:01.403874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:01.403874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:01.403874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:01.403874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:01.403874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:01.403874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:01.403874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:01.403874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:01.403874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:01.403874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:01.403874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:01.403874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:01.403874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:01.403874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:01.404791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:01.404791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:01.404791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:01.404791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:01.404791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:01.404791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:01.404791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:01.404791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:01.404791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:01.404791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:01.404791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:01.404791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:01.404791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:01.404791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:01.404791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:01.404791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:01.405680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:01.405680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:01.405680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:01.405680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:01.405680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:01.405680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:01.405680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:01.405680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:01.405680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:01.405680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:01.405680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:01.405680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:01.405680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 287/567] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:40:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:01.406867 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd220266-51e9-4cca-8594-0c858901588a None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:01.406867 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd220266-51e9-4cca-8594-0c858901588a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:01.407035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd220266-51e9-4cca-8594-0c858901588a None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:01.408334 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 288/568] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:01.408880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd220266-51e9-4cca-8594-0c858901588a None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:01.453537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:01.486094 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e591901-460b-4944-b9dc-006aeca285a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:01.487570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e591901-460b-4944-b9dc-006aeca285a4 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:01.516829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd220266-51e9-4cca-8594-0c858901588a None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:01.541434 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:01.554988 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3f553-d021-4eb5-89a8-2e0f64e3edf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:01.555715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3f553-d021-4eb5-89a8-2e0f64e3edf4 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:01.555995 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3f553-d021-4eb5-89a8-2e0f64e3edf4 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:01.556266 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3f553-d021-4eb5-89a8-2e0f64e3edf4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:01.567490 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3f553-d021-4eb5-89a8-2e0f64e3edf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:01.575295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-aed3f553-d021-4eb5-89a8-2e0f64e3edf4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:01.575295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:01.575295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:01.575295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:01.575295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:01.575295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:01.575295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:01.575295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:01.575295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:01.575295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:01.575295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:01.575295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:01.575295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:01.575295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:01.575295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:01.575295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:01.576267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:01.576267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:01.576267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:01.576267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:01.576267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:01.576267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:01.576267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:01.576267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:01.576267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:01.576267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:01.576267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:01.576267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:01.576267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:01.576267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:01.576267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:01.576267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:01.577130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:01.577130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:01.577130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:01.577130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:01.577130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:01.577130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:01.577130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:01.577130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:01.577130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:01.577130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:01.577130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:01.577130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:01.577130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 289/569] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:40:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:01.577887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3f553-d021-4eb5-89a8-2e0f64e3edf4 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:01.607068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 281/570] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:40:01.608679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6f5fa-b502-4c6b-9ac8-5d3cdc8d9304 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:01.608970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6f5fa-b502-4c6b-9ac8-5d3cdc8d9304 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:01.609252 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6f5fa-b502-4c6b-9ac8-5d3cdc8d9304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:01.626091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-33d6f5fa-b502-4c6b-9ac8-5d3cdc8d9304 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:01.627273 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-33d6f5fa-b502-4c6b-9ac8-5d3cdc8d9304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:01.704050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 282/571] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:40:01.704395 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3f553-d021-4eb5-89a8-2e0f64e3edf4 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:01.705121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6f5fa-b502-4c6b-9ac8-5d3cdc8d9304 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:01.707610 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:01.751215 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258c1f8-575c-4e61-a192-b589871e7fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:01.751881 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258c1f8-575c-4e61-a192-b589871e7fea None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:01.752161 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258c1f8-575c-4e61-a192-b589871e7fea None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:01.752439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258c1f8-575c-4e61-a192-b589871e7fea None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:01.753174 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258c1f8-575c-4e61-a192-b589871e7fea None admin] RBAC: Adding query filter params (name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:01.753511 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258c1f8-575c-4e61-a192-b589871e7fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:01.754943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258c1f8-575c-4e61-a192-b589871e7fea None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:01.763399 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 290/572] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:40:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:01.764017 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258c1f8-575c-4e61-a192-b589871e7fea None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:01.812716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:01.817203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6f5fa-b502-4c6b-9ac8-5d3cdc8d9304 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:01.852587 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39f1e9-5624-4017-92bc-d6f19fa8104d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:01.853382 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39f1e9-5624-4017-92bc-d6f19fa8104d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:01.853667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39f1e9-5624-4017-92bc-d6f19fa8104d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:01.853942 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39f1e9-5624-4017-92bc-d6f19fa8104d None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:01.854840 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39f1e9-5624-4017-92bc-d6f19fa8104d None admin] RBAC: Adding query filter params (name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:01.855155 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39f1e9-5624-4017-92bc-d6f19fa8104d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:01.856536 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39f1e9-5624-4017-92bc-d6f19fa8104d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:01.865177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 283/573] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:40:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:01.866120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39f1e9-5624-4017-92bc-d6f19fa8104d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:01.876416 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258c1f8-575c-4e61-a192-b589871e7fea None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:01.913763 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57173266-e32d-41f7-a003-d539e3f63ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:01.914642 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57173266-e32d-41f7-a003-d539e3f63ba9 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:01.915295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57173266-e32d-41f7-a003-d539e3f63ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:01.915295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57173266-e32d-41f7-a003-d539e3f63ba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:01.926113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57173266-e32d-41f7-a003-d539e3f63ba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:01.927609 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57173266-e32d-41f7-a003-d539e3f63ba9 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:01.932601 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:01.945552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-57173266-e32d-41f7-a003-d539e3f63ba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:01.945552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:01.945552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:01.945552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:01.945552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:01.945552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:01.945552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:01.945552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:01.945552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:01.945552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:01.945552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:01.945552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:01.945552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:01.945552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:01.945552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:01.946471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:01.946471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:01.946471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:01.946471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:01.946471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:01.946471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:01.946471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:01.946471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:01.946471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:01.946471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:01.946471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:01.946471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:01.946471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:01.946471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:01.946471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:01.946471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:01.946471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:01.947374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:01.947374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:01.947374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:01.947374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:01.947374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 291/574] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:01.948146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57173266-e32d-41f7-a003-d539e3f63ba9 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:01.979157 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39f1e9-5624-4017-92bc-d6f19fa8104d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:02.015047 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6ac21-b9e2-44f5-b9ce-d8aada9337a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:02.015934 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6ac21-b9e2-44f5-b9ce-d8aada9337a5 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:02.016212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6ac21-b9e2-44f5-b9ce-d8aada9337a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:02.016598 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6ac21-b9e2-44f5-b9ce-d8aada9337a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:02.028324 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6ac21-b9e2-44f5-b9ce-d8aada9337a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:02.037201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-0ff6ac21-b9e2-44f5-b9ce-d8aada9337a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:02.037201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:02.037201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:02.037201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:02.037201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:02.037201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:02.037201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:02.037201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:02.037201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:02.037201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:02.037201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:02.037201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:02.037201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:02.037201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:02.037201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:02.037201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:02.038259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:02.038259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:02.038259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:02.038259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:02.038259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:02.038259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:02.038259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:02.038259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:02.038259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:02.038259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:02.038259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:02.038259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:02.038259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:02.038259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:02.038259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:02.038259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:02.039122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:02.039122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:02.039122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:02.039122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:02.039122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:02.039122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:02.039122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:02.039122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:02.039122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:02.039122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:02.039122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:02.039122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:02.041586 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 284/575] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:40:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:02.042722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6ac21-b9e2-44f5-b9ce-d8aada9337a5 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:02.048439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:02.054879 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57173266-e32d-41f7-a003-d539e3f63ba9 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:02.091335 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799de5b-76d0-42ad-b05f-33dabe268a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:02.092050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799de5b-76d0-42ad-b05f-33dabe268a1b None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:02.092328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799de5b-76d0-42ad-b05f-33dabe268a1b None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:02.092602 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799de5b-76d0-42ad-b05f-33dabe268a1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:02.104238 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799de5b-76d0-42ad-b05f-33dabe268a1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:02.105688 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799de5b-76d0-42ad-b05f-33dabe268a1b None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:02.122973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-c799de5b-76d0-42ad-b05f-33dabe268a1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:02.122973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:02.122973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:02.122973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:02.122973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:02.122973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:02.122973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:02.122973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:02.122973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:02.122973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:02.122973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:02.122973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:02.122973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:02.122973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:02.122973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:02.123901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:02.123901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:02.123901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:02.123901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:02.123901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:02.123901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:02.123901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:02.123901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:02.123901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:02.123901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:02.123901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:02.123901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:02.123901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:02.123901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:02.123901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:02.123901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:02.123901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:02.124820 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:02.124820 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:02.124820 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:02.124820 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:02.124820 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 292/576] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:02.125114 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799de5b-76d0-42ad-b05f-33dabe268a1b None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:02.156055 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6ac21-b9e2-44f5-b9ce-d8aada9337a5 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:02.179927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:02.191492 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95406501-6d18-4cdf-87cb-ae34a7c681ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:02.192269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95406501-6d18-4cdf-87cb-ae34a7c681ef None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:02.192545 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95406501-6d18-4cdf-87cb-ae34a7c681ef None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:02.193380 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95406501-6d18-4cdf-87cb-ae34a7c681ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:02.203599 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95406501-6d18-4cdf-87cb-ae34a7c681ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:02.205039 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95406501-6d18-4cdf-87cb-ae34a7c681ef None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:02.222265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-95406501-6d18-4cdf-87cb-ae34a7c681ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:02.222265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:02.222265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:02.222265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:02.222265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:02.222265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:02.222265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:02.222265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:02.222265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:02.222265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:02.222265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:02.222265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:02.222265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:02.222265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:02.222265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:02.223227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:02.223227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:02.223227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:02.223227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:02.223227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:02.223227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:02.223227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:02.223227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:02.223227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:02.223227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:02.223227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:02.223227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:02.223227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:02.223227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:02.223227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:02.223227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:02.223227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:02.224212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:02.224212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:02.224212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:02.224212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:02.224212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 285/577] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:02.224212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95406501-6d18-4cdf-87cb-ae34a7c681ef None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:02.245659 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799de5b-76d0-42ad-b05f-33dabe268a1b None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:02.282407 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce049a-a943-428e-ad60-fc5ad47a4122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:02.283063 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce049a-a943-428e-ad60-fc5ad47a4122 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:02.283339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce049a-a943-428e-ad60-fc5ad47a4122 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:02.283609 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce049a-a943-428e-ad60-fc5ad47a4122 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:02.284325 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce049a-a943-428e-ad60-fc5ad47a4122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:02.284624 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce049a-a943-428e-ad60-fc5ad47a4122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:02.285984 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce049a-a943-428e-ad60-fc5ad47a4122 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:02.298146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 293/578] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:02.303102 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce049a-a943-428e-ad60-fc5ad47a4122 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:02.315654 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:02.332478 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95406501-6d18-4cdf-87cb-ae34a7c681ef None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:02.367251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fa309-c173-4220-848a-453dd69aea61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:02.368205 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fa309-c173-4220-848a-453dd69aea61 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:02.368654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fa309-c173-4220-848a-453dd69aea61 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:02.368933 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fa309-c173-4220-848a-453dd69aea61 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:02.369709 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2fa309-c173-4220-848a-453dd69aea61 None admin] RBAC: Adding query filter params (name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:02.370015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2fa309-c173-4220-848a-453dd69aea61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:02.371384 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2fa309-c173-4220-848a-453dd69aea61 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:02.379502 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 286/579] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:40:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:02.380121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fa309-c173-4220-848a-453dd69aea61 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:02.416360 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce049a-a943-428e-ad60-fc5ad47a4122 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:02.423951 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:02.455045 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20a495-5459-4a00-8501-b8788d1f8554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:02.455989 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20a495-5459-4a00-8501-b8788d1f8554 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:02.456275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20a495-5459-4a00-8501-b8788d1f8554 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:02.456549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20a495-5459-4a00-8501-b8788d1f8554 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:02.457458 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20a495-5459-4a00-8501-b8788d1f8554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:02.459262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20a495-5459-4a00-8501-b8788d1f8554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:02.460621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20a495-5459-4a00-8501-b8788d1f8554 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:02.472125 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 294/580] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:02.472932 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20a495-5459-4a00-8501-b8788d1f8554 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:02.493831 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fa309-c173-4220-848a-453dd69aea61 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:02.529587 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d5e56-8c02-4b49-be7d-63a4a2fd893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:02.530224 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d5e56-8c02-4b49-be7d-63a4a2fd893f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:02.530506 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d5e56-8c02-4b49-be7d-63a4a2fd893f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:02.530782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d5e56-8c02-4b49-be7d-63a4a2fd893f None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:02.531487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d5e56-8c02-4b49-be7d-63a4a2fd893f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:02.531791 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d5e56-8c02-4b49-be7d-63a4a2fd893f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:02.533149 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d5e56-8c02-4b49-be7d-63a4a2fd893f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:02.544168 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:02.549309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 287/581] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:02.549309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d5e56-8c02-4b49-be7d-63a4a2fd893f None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:02.584339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20a495-5459-4a00-8501-b8788d1f8554 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:02.618564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec1f05-374b-4df6-8832-1d35bb9f8dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:02.619411 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec1f05-374b-4df6-8832-1d35bb9f8dd9 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:02.619806 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec1f05-374b-4df6-8832-1d35bb9f8dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:02.620190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec1f05-374b-4df6-8832-1d35bb9f8dd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:02.627191 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec1f05-374b-4df6-8832-1d35bb9f8dd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:02.628864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec1f05-374b-4df6-8832-1d35bb9f8dd9 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:02.645259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-b8ec1f05-374b-4df6-8832-1d35bb9f8dd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:02.645259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:02.645259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:02.645259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:02.645259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:02.645259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:02.645259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:02.645259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:02.645259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:02.645259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:02.645259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:02.645259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:02.645259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:02.645259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:02.645259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:02.646406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:02.646406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:02.646406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:02.646406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:02.646406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:02.646406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:02.646406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:02.646406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:02.646406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:02.646406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:02.646406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:02.646406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:02.646406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:02.646406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:02.646406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:02.646406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:02.646406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:02.647464 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:02.647464 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:02.647464 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:02.647464 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:02.647464 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:02.647464 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:02.647464 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:02.647464 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:02.647464 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 295/582] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:02.648265 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec1f05-374b-4df6-8832-1d35bb9f8dd9 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:02.654858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:02.658863 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d5e56-8c02-4b49-be7d-63a4a2fd893f None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:02.700964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffcedd-a0c6-43e8-843c-92c92174051d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:02.702096 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffcedd-a0c6-43e8-843c-92c92174051d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:02.702390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffcedd-a0c6-43e8-843c-92c92174051d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:02.702881 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffcedd-a0c6-43e8-843c-92c92174051d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:02.713425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffcedd-a0c6-43e8-843c-92c92174051d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:02.714976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffcedd-a0c6-43e8-843c-92c92174051d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:02.733405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-9dffcedd-a0c6-43e8-843c-92c92174051d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:02.733405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:02.733405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:02.733405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:02.733405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:02.733405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:02.733405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:02.733405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:02.733405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:02.733405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:02.733405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:02.733405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:02.733405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:02.733405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:02.733405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:02.734323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:02.734323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:02.734323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:02.734323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:02.734323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:02.734323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:02.734323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:02.734323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:02.734323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:02.734323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:02.734323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:02.734323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:02.734323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:02.734323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:02.734323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:02.734323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:02.734323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:02.740649 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:02.740649 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:02.740649 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:02.740649 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:02.740649 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 288/583] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:02.740649 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffcedd-a0c6-43e8-843c-92c92174051d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:02.768694 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec1f05-374b-4df6-8832-1d35bb9f8dd9 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:02.796301 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:02.805864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127c85e-3337-4be5-b56a-f317858cf0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:02.806653 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127c85e-3337-4be5-b56a-f317858cf0c8 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:02.806930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127c85e-3337-4be5-b56a-f317858cf0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:02.807200 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127c85e-3337-4be5-b56a-f317858cf0c8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:02.815317 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127c85e-3337-4be5-b56a-f317858cf0c8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:02.816773 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127c85e-3337-4be5-b56a-f317858cf0c8 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:02.834413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-8127c85e-3337-4be5-b56a-f317858cf0c8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 13:40:02.834413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:02.834413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:02.834413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:02.834413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:02.834413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:02.834413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:02.834413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:02.834413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:02.834413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:02.834413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:02.834413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:02.834413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:02.834413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:02.834413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:02.834413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:02.835397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:02.835397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:02.835397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:02.835397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:02.835397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:02.835397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:02.835397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:02.835397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:02.835397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:02.835397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:02.835397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:02.835397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:02.835397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:02.835397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:02.835397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:02.835397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:02.835397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:02.835397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:02.836380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:02.836380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:02.836380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:02.836380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:02.836380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:02.836380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:02.836380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:02.836380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:02.836380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 13:40:02.836380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:02.836380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 296/584] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:40:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:02.836380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127c85e-3337-4be5-b56a-f317858cf0c8 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:02.849941 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffcedd-a0c6-43e8-843c-92c92174051d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:02.887922 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480f3f4-e408-40f6-aa6f-77ca50d01176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:02.888641 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480f3f4-e408-40f6-aa6f-77ca50d01176 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:02.889051 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480f3f4-e408-40f6-aa6f-77ca50d01176 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:02.889330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480f3f4-e408-40f6-aa6f-77ca50d01176 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:02.897112 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480f3f4-e408-40f6-aa6f-77ca50d01176 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:02.898699 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480f3f4-e408-40f6-aa6f-77ca50d01176 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:02.913983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-7480f3f4-e408-40f6-aa6f-77ca50d01176 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 13:40:02.913983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:02.913983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:02.913983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:02.913983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:02.913983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:02.913983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:02.913983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:02.913983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:02.913983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:02.913983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:02.913983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:02.913983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:02.913983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:02.913983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:02.913983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:02.914932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:02.914932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:02.914932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:02.914932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:02.914932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:02.914932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:02.914932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:02.914932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:02.914932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:02.914932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:02.914932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:02.914932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:02.914932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:02.914932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:02.914932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:02.914932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:02.914932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:02.914932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:02.915903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:02.915903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:02.915903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:02.915903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:02.915903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:02.915903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:02.915903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:02.915903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:02.915903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 13:40:02.915903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:02.915903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 289/585] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:40:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:02.916512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480f3f4-e408-40f6-aa6f-77ca50d01176 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:02.930323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:02.946456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127c85e-3337-4be5-b56a-f317858cf0c8 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:02.984238 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac33e4-c252-4055-a82f-966b22f8667a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:02.984910 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac33e4-c252-4055-a82f-966b22f8667a None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:02.985192 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac33e4-c252-4055-a82f-966b22f8667a None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:02.985524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac33e4-c252-4055-a82f-966b22f8667a None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:02.986302 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac33e4-c252-4055-a82f-966b22f8667a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:02.986613 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac33e4-c252-4055-a82f-966b22f8667a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:02.988026 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac33e4-c252-4055-a82f-966b22f8667a None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:03.004962 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 297/586] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:03.004962 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac33e4-c252-4055-a82f-966b22f8667a None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:03.038180 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480f3f4-e408-40f6-aa6f-77ca50d01176 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:03.055337 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:03.076007 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144e8ed-4cca-4413-84aa-32cdeefd355a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:03.076676 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144e8ed-4cca-4413-84aa-32cdeefd355a None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:03.076959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144e8ed-4cca-4413-84aa-32cdeefd355a None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:03.077238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144e8ed-4cca-4413-84aa-32cdeefd355a None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:03.077982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144e8ed-4cca-4413-84aa-32cdeefd355a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:03.078451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144e8ed-4cca-4413-84aa-32cdeefd355a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:03.079822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144e8ed-4cca-4413-84aa-32cdeefd355a None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:03.093917 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 290/587] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:03.094751 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144e8ed-4cca-4413-84aa-32cdeefd355a None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:03.115893 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac33e4-c252-4055-a82f-966b22f8667a None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:03.150134 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b01cac-8194-4450-a5ef-4c839fcc49bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:03.150717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b01cac-8194-4450-a5ef-4c839fcc49bf None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:03.150996 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b01cac-8194-4450-a5ef-4c839fcc49bf None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:03.151270 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b01cac-8194-4450-a5ef-4c839fcc49bf None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:03.152097 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b01cac-8194-4450-a5ef-4c839fcc49bf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:03.152406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b01cac-8194-4450-a5ef-4c839fcc49bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:03.153871 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b01cac-8194-4450-a5ef-4c839fcc49bf None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:03.172062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:03.176823 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 298/588] 10.222.0.45 () {56 vars in 1137 bytes} [Thu May 26 13:40:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:03.176823 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b01cac-8194-4450-a5ef-4c839fcc49bf None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:03.216088 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144e8ed-4cca-4413-84aa-32cdeefd355a None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:03.255135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44b0cf-a227-49d3-a580-09e3457cd66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:03.255827 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44b0cf-a227-49d3-a580-09e3457cd66a None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:03.256107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44b0cf-a227-49d3-a580-09e3457cd66a None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:03.256382 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44b0cf-a227-49d3-a580-09e3457cd66a None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:03.257918 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44b0cf-a227-49d3-a580-09e3457cd66a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:03.258229 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44b0cf-a227-49d3-a580-09e3457cd66a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:03.260407 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44b0cf-a227-49d3-a580-09e3457cd66a None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:03.283155 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 291/589] 10.222.0.45 () {56 vars in 1139 bytes} [Thu May 26 13:40:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:03.283155 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44b0cf-a227-49d3-a580-09e3457cd66a None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:03.290849 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b01cac-8194-4450-a5ef-4c839fcc49bf None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:03.299904 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:03.330645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da129b97-9944-47ca-9970-0e54420e2c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:03.331318 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da129b97-9944-47ca-9970-0e54420e2c06 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:03.331644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da129b97-9944-47ca-9970-0e54420e2c06 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:03.331924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da129b97-9944-47ca-9970-0e54420e2c06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:03.332743 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da129b97-9944-47ca-9970-0e54420e2c06 None admin] RBAC: Adding query filter params (role.id=0bb0d62bb4f84638888ceb6ecabda8b3, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=e517dc43cc6d401e820c65ad4c941386) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:03.333052 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da129b97-9944-47ca-9970-0e54420e2c06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:03.335005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da129b97-9944-47ca-9970-0e54420e2c06 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:03.340622 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 299/590] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:40:03 2022] GET /identity/v3/role_assignments?user.id=e517dc43cc6d401e820c65ad4c941386&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=0bb0d62bb4f84638888ceb6ecabda8b3 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:03.350617 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da129b97-9944-47ca-9970-0e54420e2c06 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:03.402026 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44b0cf-a227-49d3-a580-09e3457cd66a None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:03.435473 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:03.443774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e68761-0d98-420a-8d00-b2ec739dae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:03.444755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e68761-0d98-420a-8d00-b2ec739dae2b None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:03.445559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e68761-0d98-420a-8d00-b2ec739dae2b None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:03.445907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e68761-0d98-420a-8d00-b2ec739dae2b None admin] PATH_INFO: `/v3/users/glance` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:03.455102 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e68761-0d98-420a-8d00-b2ec739dae2b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:03.456832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e68761-0d98-420a-8d00-b2ec739dae2b None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:03.474497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-31e68761-0d98-420a-8d00-b2ec739dae2b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 13:40:03.474497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:03.474497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:03.474497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:03.474497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:03.474497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:03.474497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:03.474497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:03.474497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:03.474497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:03.474497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:03.474497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:03.474497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:03.474497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:03.474497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:03.474497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:03.475754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:03.475754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:03.475754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:03.475754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:03.475754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:03.475754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:03.475754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:03.475754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:03.475754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:03.475754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:03.475754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:03.475754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:03.475754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:03.475754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:03.475754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:03.475754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:03.475754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:03.475754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:03.476955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:03.476955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:03.476955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:03.476955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:03.476955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:03.476955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:03.476955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:03.476955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:03.476955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 13:40:03.476955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:03.476955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 292/591] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:40:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:03.477727 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e68761-0d98-420a-8d00-b2ec739dae2b None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:03.496747 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da129b97-9944-47ca-9970-0e54420e2c06 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:03.540154 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d317f69-183a-469b-8f50-346ffda2788b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:03.540939 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d317f69-183a-469b-8f50-346ffda2788b None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:03.541599 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d317f69-183a-469b-8f50-346ffda2788b None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:03.541599 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d317f69-183a-469b-8f50-346ffda2788b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:03.559865 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d317f69-183a-469b-8f50-346ffda2788b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:03.561302 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d317f69-183a-469b-8f50-346ffda2788b None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:03.579319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-1d317f69-183a-469b-8f50-346ffda2788b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:03.579319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:03.579319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:03.579319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:03.579319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:03.579319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:03.579319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:03.579319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:03.579319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:03.579319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:03.579319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:03.579319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:03.579319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:03.579319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:03.579319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:03.580461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:03.580461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:03.580461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:03.580461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:03.580461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:03.580461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:03.580461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:03.580461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:03.580461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:03.580461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:03.580461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:03.580461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:03.580461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:03.580461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:03.580461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:03.580461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:03.580461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:03.581599 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:03.581599 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:03.581599 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:03.581599 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:03.585537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 300/592] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:03.586834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6509be-d3e4-45b0-a197-3407bf1fcc21 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:03.587123 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6509be-d3e4-45b0-a197-3407bf1fcc21 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:03.587397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6509be-d3e4-45b0-a197-3407bf1fcc21 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:03.588660 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 301/593] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:03.589366 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6509be-d3e4-45b0-a197-3407bf1fcc21 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:03.598125 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e68761-0d98-420a-8d00-b2ec739dae2b None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:03.615138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:03.637993 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b424f-081b-4aa8-be7d-9af623f9688e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:03.638788 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b424f-081b-4aa8-be7d-9af623f9688e None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:03.639078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b424f-081b-4aa8-be7d-9af623f9688e None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:03.639358 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b424f-081b-4aa8-be7d-9af623f9688e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:03.649905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b424f-081b-4aa8-be7d-9af623f9688e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:03.651360 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b424f-081b-4aa8-be7d-9af623f9688e None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:03.672905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-a59b424f-081b-4aa8-be7d-9af623f9688e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:03.672905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:03.672905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:03.672905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:03.672905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:03.672905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:03.672905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:03.672905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:03.672905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:03.672905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:03.672905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:03.672905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:03.672905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:03.672905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:03.672905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:03.674033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:03.674033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:03.674033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:03.674033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:03.674033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:03.674033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:03.674033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:03.674033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:03.674033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:03.674033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:03.674033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:03.674033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:03.674033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:03.674033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:03.674033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:03.674033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:03.674033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:03.675187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:03.675187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:03.675187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:03.675187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:03.676164 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 293/594] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:03.680196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b424f-081b-4aa8-be7d-9af623f9688e None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:03.706807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6509be-d3e4-45b0-a197-3407bf1fcc21 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:03.724496 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:03.748405 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e30ab-3c29-40ef-8f15-b41a9d421084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:03.749022 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e30ab-3c29-40ef-8f15-b41a9d421084 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:03.749339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e30ab-3c29-40ef-8f15-b41a9d421084 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:03.749626 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e30ab-3c29-40ef-8f15-b41a9d421084 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:03.750466 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e30ab-3c29-40ef-8f15-b41a9d421084 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:03.750778 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e30ab-3c29-40ef-8f15-b41a9d421084 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:03.752199 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e30ab-3c29-40ef-8f15-b41a9d421084 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:03.770091 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 302/595] 10.222.0.45 () {56 vars in 1137 bytes} [Thu May 26 13:40:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:03.771378 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f9501-49be-4272-8d54-0d869074a751 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:03.771675 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f9501-49be-4272-8d54-0d869074a751 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:03.771952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f9501-49be-4272-8d54-0d869074a751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:03.788696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-c49f9501-49be-4272-8d54-0d869074a751 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:03.789955 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-c49f9501-49be-4272-8d54-0d869074a751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:03.791973 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b424f-081b-4aa8-be7d-9af623f9688e None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:03.828267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac545427-682e-4bbd-a049-6fa393096ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:03.828928 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac545427-682e-4bbd-a049-6fa393096ab5 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:03.829200 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac545427-682e-4bbd-a049-6fa393096ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:03.829505 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac545427-682e-4bbd-a049-6fa393096ab5 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:03.830217 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac545427-682e-4bbd-a049-6fa393096ab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:03.830518 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac545427-682e-4bbd-a049-6fa393096ab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:03.831880 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac545427-682e-4bbd-a049-6fa393096ab5 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:03.849912 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 294/596] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:03.850757 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac545427-682e-4bbd-a049-6fa393096ab5 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:03.860290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 303/597] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:40:03.861370 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f9501-49be-4272-8d54-0d869074a751 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:03.889855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:03.961366 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:03.964613 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac545427-682e-4bbd-a049-6fa393096ab5 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:03.982692 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f9501-49be-4272-8d54-0d869074a751 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:04.001207 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826060f-e63c-4893-b030-06a804a3c9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:04.001898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826060f-e63c-4893-b030-06a804a3c9af None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:04.002183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826060f-e63c-4893-b030-06a804a3c9af None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:04.002460 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826060f-e63c-4893-b030-06a804a3c9af None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:04.003176 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826060f-e63c-4893-b030-06a804a3c9af None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:04.003784 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826060f-e63c-4893-b030-06a804a3c9af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:04.004852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826060f-e63c-4893-b030-06a804a3c9af None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:04.021740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 295/598] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:04.021929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef8032-ea75-47c7-97e1-cc6cc622ca4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:04.022059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826060f-e63c-4893-b030-06a804a3c9af None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:04.022159 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef8032-ea75-47c7-97e1-cc6cc622ca4a None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:04.022159 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef8032-ea75-47c7-97e1-cc6cc622ca4a None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:04.022159 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef8032-ea75-47c7-97e1-cc6cc622ca4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:04.032906 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef8032-ea75-47c7-97e1-cc6cc622ca4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:04.034357 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef8032-ea75-47c7-97e1-cc6cc622ca4a None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:04.053537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-e5ef8032-ea75-47c7-97e1-cc6cc622ca4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:04.053537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:04.053537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:04.053537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:04.053537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:04.053537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:04.053537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:04.053537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:04.053537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:04.053537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:04.053537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:04.053537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:04.053537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:04.053537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:04.053537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:04.054518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:04.054518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:04.054518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:04.054518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:04.054518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:04.054518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:04.054518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:04.054518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:04.054518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:04.054518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:04.054518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:04.054518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:04.054518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:04.054518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:04.054518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:04.054518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:04.054518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:04.055533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:04.055533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:04.055533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:04.055533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:04.059296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 304/599] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:04.059924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef8032-ea75-47c7-97e1-cc6cc622ca4a None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:04.123381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:04.130491 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826060f-e63c-4893-b030-06a804a3c9af None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:04.167058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef8032-ea75-47c7-97e1-cc6cc622ca4a None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:04.168303 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d63815-3ac0-4ee1-a036-d0e0cb3fd502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:04.169100 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d63815-3ac0-4ee1-a036-d0e0cb3fd502 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:04.170078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d63815-3ac0-4ee1-a036-d0e0cb3fd502 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:04.170078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d63815-3ac0-4ee1-a036-d0e0cb3fd502 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:04.179101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d63815-3ac0-4ee1-a036-d0e0cb3fd502 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:04.180569 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d63815-3ac0-4ee1-a036-d0e0cb3fd502 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:04.194520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-f9d63815-3ac0-4ee1-a036-d0e0cb3fd502 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:04.194520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:04.194520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:04.194520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:04.194520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:04.194520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:04.194520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:04.194520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:04.194520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:04.194520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:04.194520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:04.194520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:04.194520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:04.194520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:04.194520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:04.195568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:04.195568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:04.195568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:04.195568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:04.195568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:04.195568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:04.195568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:04.195568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:04.195568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:04.195568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:04.195568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:04.195568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:04.195568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:04.195568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:04.195568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:04.195568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:04.195568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:04.196498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:04.196498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:04.196498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:04.196498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:04.196498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:04.196498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:04.196498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:04.196498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:04.196498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 296/600] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:04.196498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d63815-3ac0-4ee1-a036-d0e0cb3fd502 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:04.213119 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29f273-c93a-49c0-beb6-9cd551ad5b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:04.214374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29f273-c93a-49c0-beb6-9cd551ad5b1d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:04.214964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29f273-c93a-49c0-beb6-9cd551ad5b1d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:04.215411 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29f273-c93a-49c0-beb6-9cd551ad5b1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:04.218472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:04.229092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29f273-c93a-49c0-beb6-9cd551ad5b1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:04.238667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-7b29f273-c93a-49c0-beb6-9cd551ad5b1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:04.238667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:04.238667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:04.238667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:04.238667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:04.238667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:04.238667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:04.238667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:04.238667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:04.238667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:04.238667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:04.238667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:04.238667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:04.238667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:04.238667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:04.238667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:04.239882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:04.239882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:04.239882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:04.239882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:04.239882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:04.239882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:04.239882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:04.239882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:04.239882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:04.239882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:04.239882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:04.239882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:04.239882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:04.239882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:04.239882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:04.239882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:04.248441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:04.248441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:04.248441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:04.248441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:04.248441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:04.248441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:04.248441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:04.248441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:04.248441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:04.248441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:04.248441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:04.248441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:04.248441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 305/601] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:40:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:04.248441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29f273-c93a-49c0-beb6-9cd551ad5b1d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:04.303809 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d63815-3ac0-4ee1-a036-d0e0cb3fd502 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:04.338916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e1176-e26f-4bfd-95c7-584e9b12bf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:04.339784 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e1176-e26f-4bfd-95c7-584e9b12bf94 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:04.340140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e1176-e26f-4bfd-95c7-584e9b12bf94 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:04.340484 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e1176-e26f-4bfd-95c7-584e9b12bf94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:04.347956 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e1176-e26f-4bfd-95c7-584e9b12bf94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:04.350078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e1176-e26f-4bfd-95c7-584e9b12bf94 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:04.355244 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29f273-c93a-49c0-beb6-9cd551ad5b1d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:04.366737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-408e1176-e26f-4bfd-95c7-584e9b12bf94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:04.366737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:04.366737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:04.366737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:04.366737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:04.366737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:04.366737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:04.366737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:04.366737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:04.366737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:04.366737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:04.366737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:04.366737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:04.366737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:04.366737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:04.367834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:04.367834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:04.367834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:04.367834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:04.367834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:04.367834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:04.367834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:04.367834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:04.367834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:04.367834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:04.367834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:04.367834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:04.367834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:04.367834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:04.367834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:04.367834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:04.367834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:04.368968 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:04.368968 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:04.368968 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:04.368968 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:04.368968 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:04.368968 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:04.368968 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:04.368968 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:04.373321 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 297/602] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:04.374159 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e1176-e26f-4bfd-95c7-584e9b12bf94 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:04.380973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:04.394539 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bf4f3-5ae8-4571-8334-6729dc5e9d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:04.395202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bf4f3-5ae8-4571-8334-6729dc5e9d99 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:04.395488 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bf4f3-5ae8-4571-8334-6729dc5e9d99 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:04.396301 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bf4f3-5ae8-4571-8334-6729dc5e9d99 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:04.397023 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bf4f3-5ae8-4571-8334-6729dc5e9d99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:04.397555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bf4f3-5ae8-4571-8334-6729dc5e9d99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:04.398703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bf4f3-5ae8-4571-8334-6729dc5e9d99 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:04.410952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 306/603] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:04.411874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bf4f3-5ae8-4571-8334-6729dc5e9d99 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:04.468264 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:04.492217 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e1176-e26f-4bfd-95c7-584e9b12bf94 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:04.522936 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bf4f3-5ae8-4571-8334-6729dc5e9d99 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:04.532572 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e188fe0-6dbc-4794-93ce-d6045f1e4ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:04.533238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e188fe0-6dbc-4794-93ce-d6045f1e4ebc None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:04.533856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e188fe0-6dbc-4794-93ce-d6045f1e4ebc None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:04.534134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e188fe0-6dbc-4794-93ce-d6045f1e4ebc None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:04.535063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e188fe0-6dbc-4794-93ce-d6045f1e4ebc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:04.535370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e188fe0-6dbc-4794-93ce-d6045f1e4ebc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:04.536843 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e188fe0-6dbc-4794-93ce-d6045f1e4ebc None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:04.549903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 298/604] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:04.550780 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e188fe0-6dbc-4794-93ce-d6045f1e4ebc None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:04.562462 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ae261-99ee-4f6b-bbee-4643398524f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:04.563450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ae261-99ee-4f6b-bbee-4643398524f1 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:04.563903 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ae261-99ee-4f6b-bbee-4643398524f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:04.564330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ae261-99ee-4f6b-bbee-4643398524f1 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:04.565256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ae261-99ee-4f6b-bbee-4643398524f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:04.565722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ae261-99ee-4f6b-bbee-4643398524f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:04.567361 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ae261-99ee-4f6b-bbee-4643398524f1 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:04.576669 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 307/605] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:40:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:04.577708 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ae261-99ee-4f6b-bbee-4643398524f1 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:04.624905 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:04.660417 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e188fe0-6dbc-4794-93ce-d6045f1e4ebc None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:04.691952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ae261-99ee-4f6b-bbee-4643398524f1 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:04.705099 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2757e7-6218-4c56-83ff-e2c9cd000e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:04.706069 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2757e7-6218-4c56-83ff-e2c9cd000e66 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:04.706868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2757e7-6218-4c56-83ff-e2c9cd000e66 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:04.707220 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2757e7-6218-4c56-83ff-e2c9cd000e66 None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:04.708894 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2757e7-6218-4c56-83ff-e2c9cd000e66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:04.709302 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2757e7-6218-4c56-83ff-e2c9cd000e66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:04.711417 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2757e7-6218-4c56-83ff-e2c9cd000e66 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:04.723714 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:04.727871 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316dc2f-9820-4a71-9c40-c4727b51e714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:04.728027 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 299/606] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:04.733293 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316dc2f-9820-4a71-9c40-c4727b51e714 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:04.733433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2757e7-6218-4c56-83ff-e2c9cd000e66 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:04.733515 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316dc2f-9820-4a71-9c40-c4727b51e714 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:04.733515 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316dc2f-9820-4a71-9c40-c4727b51e714 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:04.740288 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316dc2f-9820-4a71-9c40-c4727b51e714 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:04.741841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316dc2f-9820-4a71-9c40-c4727b51e714 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:04.756755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-a316dc2f-9820-4a71-9c40-c4727b51e714 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:04.756755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:04.756755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:04.756755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:04.756755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:04.756755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:04.756755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:04.756755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:04.756755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:04.756755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:04.756755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:04.756755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:04.756755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:04.756755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:04.756755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:04.757662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:04.757662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:04.757662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:04.757662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:04.757662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:04.757662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:04.757662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:04.757662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:04.757662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:04.757662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:04.757662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:04.757662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:04.757662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:04.757662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:04.757662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:04.757662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:04.757662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:04.763696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:04.763696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:04.763696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:04.763696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:04.763696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:04.763696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:04.763696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:04.763696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:04.763696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 308/607] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:04.763696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316dc2f-9820-4a71-9c40-c4727b51e714 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:04.852907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2757e7-6218-4c56-83ff-e2c9cd000e66 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:04.867410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316dc2f-9820-4a71-9c40-c4727b51e714 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:04.870542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:04.890935 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d426a1-0393-4d89-97ef-b4d400be4369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:04.891826 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d426a1-0393-4d89-97ef-b4d400be4369 None admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:04.892111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d426a1-0393-4d89-97ef-b4d400be4369 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:04.892413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d426a1-0393-4d89-97ef-b4d400be4369 None admin] PATH_INFO: `/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/c8aed4c31eb14a3bbba08bef799ee450/roles/0bb0d62bb4f84638888ceb6ecabda8b3` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:04.906848 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a9a29-1654-48c7-bdd4-5317b87532ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:04.907672 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a9a29-1654-48c7-bdd4-5317b87532ee None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:04.907956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a9a29-1654-48c7-bdd4-5317b87532ee None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:04.908235 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a9a29-1654-48c7-bdd4-5317b87532ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:04.908793 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d426a1-0393-4d89-97ef-b4d400be4369 None admin] RBAC: Authorizing `identity:create_grant(project_id=095d02b8a79c4915ac8d3c5b81e195a4, user_id=c8aed4c31eb14a3bbba08bef799ee450, role_id=0bb0d62bb4f84638888ceb6ecabda8b3)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:04.910495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d426a1-0393-4d89-97ef-b4d400be4369 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:04.919397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a9a29-1654-48c7-bdd4-5317b87532ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:04.920880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a9a29-1654-48c7-bdd4-5317b87532ee None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:04.924505 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 300/608] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:40:04 2022] PUT /identity/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/c8aed4c31eb14a3bbba08bef799ee450/roles/0bb0d62bb4f84638888ceb6ecabda8b3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:40:04.925537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d426a1-0393-4d89-97ef-b4d400be4369 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:04.946537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-e81a9a29-1654-48c7-bdd4-5317b87532ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:04.946537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:04.946537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:04.946537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:04.946537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:04.946537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:04.946537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:04.946537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:04.946537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:04.946537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:04.946537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:04.946537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:04.946537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:04.946537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:04.946537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:04.947553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:04.947553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:04.947553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:04.947553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:04.947553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:04.947553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:04.947553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:04.947553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:04.947553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:04.947553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:04.947553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:04.947553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:04.947553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:04.947553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:04.947553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:04.947553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:04.947553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:04.948539 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:04.948539 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:04.948539 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:04.948539 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:04.952619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 309/609] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:04.953780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a9a29-1654-48c7-bdd4-5317b87532ee None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:05.014472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:05.079054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d426a1-0393-4d89-97ef-b4d400be4369 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:05.106914 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a9a29-1654-48c7-bdd4-5317b87532ee None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:05.120402 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26133907-1e0e-432f-a4b7-46811370bd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:05.121499 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26133907-1e0e-432f-a4b7-46811370bd22 None admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:05.121855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26133907-1e0e-432f-a4b7-46811370bd22 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:05.122238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26133907-1e0e-432f-a4b7-46811370bd22 None admin] PATH_INFO: `/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/45105360300a4cae802fdbda91b9d5cb/roles/0bb0d62bb4f84638888ceb6ecabda8b3` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:05.141421 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26133907-1e0e-432f-a4b7-46811370bd22 None admin] RBAC: Authorizing `identity:create_grant(project_id=095d02b8a79c4915ac8d3c5b81e195a4, user_id=45105360300a4cae802fdbda91b9d5cb, role_id=0bb0d62bb4f84638888ceb6ecabda8b3)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:05.142974 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26133907-1e0e-432f-a4b7-46811370bd22 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:05.158096 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e3625-720c-4a99-90bb-93cb0b6d3c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:05.158861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e3625-720c-4a99-90bb-93cb0b6d3c7e None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:05.159221 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e3625-720c-4a99-90bb-93cb0b6d3c7e None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:05.159572 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e3625-720c-4a99-90bb-93cb0b6d3c7e None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:05.160677 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e3625-720c-4a99-90bb-93cb0b6d3c7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:05.160803 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 301/610] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:40:04 2022] PUT /identity/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/45105360300a4cae802fdbda91b9d5cb/roles/0bb0d62bb4f84638888ceb6ecabda8b3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:40:05.161260 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e3625-720c-4a99-90bb-93cb0b6d3c7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:05.161604 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26133907-1e0e-432f-a4b7-46811370bd22 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:05.162689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e3625-720c-4a99-90bb-93cb0b6d3c7e None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:05.179948 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 310/611] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:05.185778 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e3625-720c-4a99-90bb-93cb0b6d3c7e None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:05.216126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:05.290351 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:05.296377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26133907-1e0e-432f-a4b7-46811370bd22 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:05.328752 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e3625-720c-4a99-90bb-93cb0b6d3c7e None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:05.343010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b944e2-4ae5-4a2e-82b3-24c6bf27a60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:05.343956 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b944e2-4ae5-4a2e-82b3-24c6bf27a60e None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:05.344442 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b944e2-4ae5-4a2e-82b3-24c6bf27a60e None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:05.344878 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b944e2-4ae5-4a2e-82b3-24c6bf27a60e None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:05.346362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b944e2-4ae5-4a2e-82b3-24c6bf27a60e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:05.346859 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b944e2-4ae5-4a2e-82b3-24c6bf27a60e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:05.349382 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b944e2-4ae5-4a2e-82b3-24c6bf27a60e None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:05.365400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 302/612] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:05.375070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b944e2-4ae5-4a2e-82b3-24c6bf27a60e None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:05.403527 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe744a-2414-4f75-9b1d-559d2a7f7634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:05.404600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe744a-2414-4f75-9b1d-559d2a7f7634 None admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:05.404994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe744a-2414-4f75-9b1d-559d2a7f7634 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:05.405417 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe744a-2414-4f75-9b1d-559d2a7f7634 None admin] PATH_INFO: `/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/e3039ec7e613464c8a71f4440dfe8bc1/roles/0bb0d62bb4f84638888ceb6ecabda8b3` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:05.429147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe744a-2414-4f75-9b1d-559d2a7f7634 None admin] RBAC: Authorizing `identity:create_grant(project_id=095d02b8a79c4915ac8d3c5b81e195a4, user_id=e3039ec7e613464c8a71f4440dfe8bc1, role_id=0bb0d62bb4f84638888ceb6ecabda8b3)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:05.430888 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe744a-2414-4f75-9b1d-559d2a7f7634 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:05.451600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 311/613] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:40:05 2022] PUT /identity/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/e3039ec7e613464c8a71f4440dfe8bc1/roles/0bb0d62bb4f84638888ceb6ecabda8b3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:40:05.517623 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b944e2-4ae5-4a2e-82b3-24c6bf27a60e None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:05.559407 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf255a5-e948-4154-b0bf-edd4b03d9cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:05.560476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf255a5-e948-4154-b0bf-edd4b03d9cba None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:05.560903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf255a5-e948-4154-b0bf-edd4b03d9cba None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:05.561466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf255a5-e948-4154-b0bf-edd4b03d9cba None admin] PATH_INFO: `/v3/users/nova` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:05.570739 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf255a5-e948-4154-b0bf-edd4b03d9cba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:05.572539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf255a5-e948-4154-b0bf-edd4b03d9cba None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:05.589191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-1cf255a5-e948-4154-b0bf-edd4b03d9cba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 13:40:05.589191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:05.589191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:05.589191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:05.589191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:05.589191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:05.589191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:05.589191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:05.589191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:05.589191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:05.589191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:05.589191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:05.589191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:05.589191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:05.589191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:05.589191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:05.590462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:05.590462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:05.590462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:05.590462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:05.590462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:05.590462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:05.590462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:05.590462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:05.590462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:05.590462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:05.590462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:05.590462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:05.590462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:05.590462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:05.590462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:05.590462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:05.590462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:05.590462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:05.591646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:05.591646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:05.591646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:05.591646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:05.591646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:05.591646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:05.591646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:05.591646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:05.591646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 13:40:05.591646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:05.594139 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 303/614] 10.222.0.45 () {56 vars in 1093 bytes} [Thu May 26 13:40:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:05.600201 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe744a-2414-4f75-9b1d-559d2a7f7634 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:05.688244 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4267968-8c8b-4cf9-9302-c00ce3ecf8c2 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:05.688807 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4267968-8c8b-4cf9-9302-c00ce3ecf8c2 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:05.689232 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4267968-8c8b-4cf9-9302-c00ce3ecf8c2 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:05.691228 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 304/615] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:05.698229 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf312c-823b-4733-ae37-e9a24b5982d4 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:05.698761 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf312c-823b-4733-ae37-e9a24b5982d4 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:05.699190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf312c-823b-4733-ae37-e9a24b5982d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:05.711654 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:05.723104 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-9caf312c-823b-4733-ae37-e9a24b5982d4 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:05.725333 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9caf312c-823b-4733-ae37-e9a24b5982d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:05.743427 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:05.754221 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe744a-2414-4f75-9b1d-559d2a7f7634 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:05.798534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fd82a-f05b-4390-8dd6-cd4f88d83946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:05.799257 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fd82a-f05b-4390-8dd6-cd4f88d83946 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:05.799796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fd82a-f05b-4390-8dd6-cd4f88d83946 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:05.800080 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fd82a-f05b-4390-8dd6-cd4f88d83946 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:05.800935 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fd82a-f05b-4390-8dd6-cd4f88d83946 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:05.801251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fd82a-f05b-4390-8dd6-cd4f88d83946 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:05.803284 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fd82a-f05b-4390-8dd6-cd4f88d83946 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:05.807676 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 305/616] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:40:05.837229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 312/617] 10.222.0.45 () {56 vars in 1133 bytes} [Thu May 26 13:40:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:05.842799 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf312c-823b-4733-ae37-e9a24b5982d4 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:05.851538 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fd82a-f05b-4390-8dd6-cd4f88d83946 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:05.979548 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fd82a-f05b-4390-8dd6-cd4f88d83946 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:06.005643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:06.017136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8cad9-f4d8-4205-a0a0-d1cf8735737d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:06.018398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8cad9-f4d8-4205-a0a0-d1cf8735737d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:06.018883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8cad9-f4d8-4205-a0a0-d1cf8735737d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:06.019436 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8cad9-f4d8-4205-a0a0-d1cf8735737d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:06.031764 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8cad9-f4d8-4205-a0a0-d1cf8735737d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:06.040701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-d1c8cad9-f4d8-4205-a0a0-d1cf8735737d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:06.040701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:06.040701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:06.040701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:06.040701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:06.040701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:06.040701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:06.040701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:06.040701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:06.040701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:06.040701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:06.040701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:06.040701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:06.040701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:06.040701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:06.040701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:06.041696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:06.041696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:06.041696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:06.041696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:06.041696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:06.041696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:06.041696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:06.041696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:06.041696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:06.041696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:06.041696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:06.041696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:06.041696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:06.041696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:06.041696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:06.041696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:06.042639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:06.042639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:06.042639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:06.042639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:06.042639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:06.042639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:06.042639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:06.042639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:06.042639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:06.042639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:06.042639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:06.042639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:06.045389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 313/618] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:40:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:06.057236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8cad9-f4d8-4205-a0a0-d1cf8735737d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:06.077014 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf312c-823b-4733-ae37-e9a24b5982d4 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:06.142283 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef894e0-7328-4f9f-be45-73bd9d8e9756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:06.143046 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef894e0-7328-4f9f-be45-73bd9d8e9756 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:06.143130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef894e0-7328-4f9f-be45-73bd9d8e9756 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:06.143393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef894e0-7328-4f9f-be45-73bd9d8e9756 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:06.174177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:06.228167 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef894e0-7328-4f9f-be45-73bd9d8e9756 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:06.229733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef894e0-7328-4f9f-be45-73bd9d8e9756 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:06.275503 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8cad9-f4d8-4205-a0a0-d1cf8735737d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:06.340600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 306/619] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:40:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:40:06.341876 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef894e0-7328-4f9f-be45-73bd9d8e9756 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:06.402245 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:06.413977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99af87e-bad6-4893-8895-75adb0516213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:06.414689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99af87e-bad6-4893-8895-75adb0516213 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:06.414967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99af87e-bad6-4893-8895-75adb0516213 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:06.415239 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99af87e-bad6-4893-8895-75adb0516213 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:06.415995 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99af87e-bad6-4893-8895-75adb0516213 None admin] RBAC: Adding query filter params (name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:06.416299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99af87e-bad6-4893-8895-75adb0516213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:06.417678 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99af87e-bad6-4893-8895-75adb0516213 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:06.439475 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 314/620] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:40:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:06.449870 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef894e0-7328-4f9f-be45-73bd9d8e9756 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:06.462306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99af87e-bad6-4893-8895-75adb0516213 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:06.491083 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39d129-863e-4f6a-abe6-10f8f585986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:06.492514 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39d129-863e-4f6a-abe6-10f8f585986f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:06.492799 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39d129-863e-4f6a-abe6-10f8f585986f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:06.493074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39d129-863e-4f6a-abe6-10f8f585986f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:06.513393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39d129-863e-4f6a-abe6-10f8f585986f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:06.516010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39d129-863e-4f6a-abe6-10f8f585986f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:06.548165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-3f39d129-863e-4f6a-abe6-10f8f585986f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:06.548165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:06.548165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:06.548165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:06.548165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:06.548165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:06.548165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:06.548165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:06.548165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:06.548165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:06.548165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:06.548165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:06.548165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:06.548165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:06.548165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:06.549116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:06.549116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:06.549116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:06.549116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:06.549116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:06.549116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:06.549116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:06.549116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:06.549116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:06.549116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:06.549116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:06.549116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:06.549116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:06.549116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:06.549116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:06.549116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:06.549116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:06.550048 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:06.550048 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:06.550048 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:06.550048 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:06.550048 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 307/621] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:06.555450 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39d129-863e-4f6a-abe6-10f8f585986f None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:06.559081 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:06.687235 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99af87e-bad6-4893-8895-75adb0516213 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:06.704380 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39d129-863e-4f6a-abe6-10f8f585986f None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:06.729634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:06.741594 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bcd47-e531-47eb-9cfc-39d008add3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:06.742264 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bcd47-e531-47eb-9cfc-39d008add3b2 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:06.742576 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bcd47-e531-47eb-9cfc-39d008add3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:06.742822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bcd47-e531-47eb-9cfc-39d008add3b2 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:06.743541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bcd47-e531-47eb-9cfc-39d008add3b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:06.743851 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bcd47-e531-47eb-9cfc-39d008add3b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:06.745580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bcd47-e531-47eb-9cfc-39d008add3b2 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:06.746483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f600b8-a731-4417-a0f7-66f2db9d895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:06.747628 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f600b8-a731-4417-a0f7-66f2db9d895c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:06.748108 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f600b8-a731-4417-a0f7-66f2db9d895c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:06.748708 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f600b8-a731-4417-a0f7-66f2db9d895c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:06.765301 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 308/622] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:06.765471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f600b8-a731-4417-a0f7-66f2db9d895c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:06.765471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f600b8-a731-4417-a0f7-66f2db9d895c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:06.767380 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bcd47-e531-47eb-9cfc-39d008add3b2 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:06.807461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-15f600b8-a731-4417-a0f7-66f2db9d895c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:06.807461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:06.807461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:06.807461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:06.807461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:06.807461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:06.807461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:06.807461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:06.807461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:06.807461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:06.807461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:06.807461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:06.807461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:06.807461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:06.807461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:06.808427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:06.808427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:06.808427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:06.808427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:06.808427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:06.808427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:06.808427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:06.808427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:06.808427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:06.808427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:06.808427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:06.808427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:06.808427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:06.808427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:06.808427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:06.808427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:06.808427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:06.809374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:06.809374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:06.809374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:06.809374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:06.809374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 315/623] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:06.815737 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f600b8-a731-4417-a0f7-66f2db9d895c None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:06.946482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bcd47-e531-47eb-9cfc-39d008add3b2 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:06.991251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3fcaa-98f3-4611-a3f6-3448565274ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:06.992053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3fcaa-98f3-4611-a3f6-3448565274ca None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:06.992333 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3fcaa-98f3-4611-a3f6-3448565274ca None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:06.992610 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3fcaa-98f3-4611-a3f6-3448565274ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:07.000989 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3fcaa-98f3-4611-a3f6-3448565274ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:07.002697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3fcaa-98f3-4611-a3f6-3448565274ca None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:07.018198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-2cc3fcaa-98f3-4611-a3f6-3448565274ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:07.018198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:07.018198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:07.018198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:07.018198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:07.018198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:07.018198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:07.018198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:07.018198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:07.018198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:07.018198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:07.018198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:07.018198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:07.018198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:07.018198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:07.019134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:07.019134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:07.019134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:07.019134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:07.019134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:07.019134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:07.019134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:07.019134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:07.019134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:07.019134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:07.019134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:07.019134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:07.019134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:07.019134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:07.019134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:07.019134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:07.019134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:07.020036 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:07.020036 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:07.020036 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:07.020036 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:07.020036 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:07.020036 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:07.020036 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:07.020036 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:07.024376 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:07.024610 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 309/624] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:07.026372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3fcaa-98f3-4611-a3f6-3448565274ca None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:07.029043 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f600b8-a731-4417-a0f7-66f2db9d895c None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:07.089718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:07.147295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3fcaa-98f3-4611-a3f6-3448565274ca None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:07.158726 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f5ed7-9794-4b16-a2f3-569252a1ca50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:07.159195 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f5ed7-9794-4b16-a2f3-569252a1ca50 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:07.159476 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f5ed7-9794-4b16-a2f3-569252a1ca50 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:07.159763 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f5ed7-9794-4b16-a2f3-569252a1ca50 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:07.160480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f5ed7-9794-4b16-a2f3-569252a1ca50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:07.160786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f5ed7-9794-4b16-a2f3-569252a1ca50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:07.162782 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f5ed7-9794-4b16-a2f3-569252a1ca50 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:07.175366 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 316/625] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:07.180716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f5ed7-9794-4b16-a2f3-569252a1ca50 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:07.189030 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dd0b2-2e27-496c-856b-fdd119f38fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:07.190005 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dd0b2-2e27-496c-856b-fdd119f38fea None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:07.190495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dd0b2-2e27-496c-856b-fdd119f38fea None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:07.191075 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dd0b2-2e27-496c-856b-fdd119f38fea None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:07.192077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564dd0b2-2e27-496c-856b-fdd119f38fea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:07.192750 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564dd0b2-2e27-496c-856b-fdd119f38fea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:07.194415 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564dd0b2-2e27-496c-856b-fdd119f38fea None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:07.213431 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 310/626] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:07.215184 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dd0b2-2e27-496c-856b-fdd119f38fea None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:07.285902 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f5ed7-9794-4b16-a2f3-569252a1ca50 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:07.321182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1dfb5-4176-4e24-b2bd-104a0221c246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:07.322004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1dfb5-4176-4e24-b2bd-104a0221c246 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:07.322287 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1dfb5-4176-4e24-b2bd-104a0221c246 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:07.322643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1dfb5-4176-4e24-b2bd-104a0221c246 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:07.332829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1dfb5-4176-4e24-b2bd-104a0221c246 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:07.332829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1dfb5-4176-4e24-b2bd-104a0221c246 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:07.347907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-04c1dfb5-4176-4e24-b2bd-104a0221c246 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 13:40:07.347907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:07.347907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:07.347907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:07.347907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:07.347907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:07.347907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:07.347907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:07.347907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:07.347907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:07.347907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:07.347907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:07.347907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:07.347907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:07.347907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:07.347907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:07.353225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:07.353225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:07.353225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:07.353225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:07.353225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:07.353225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:07.353225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:07.353225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:07.353225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:07.353225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:07.353225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:07.353225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:07.353225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:07.353225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:07.353225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:07.353225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:07.353225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:07.353225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:07.354990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:07.354990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:07.354990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:07.354990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:07.354990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:07.354990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:07.354990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:07.354990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:07.354990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 13:40:07.354990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:07.354990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 317/627] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:40:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:07.354990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1dfb5-4176-4e24-b2bd-104a0221c246 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:07.375465 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:07.392827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:07.408818 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dd0b2-2e27-496c-856b-fdd119f38fea None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:07.458608 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ead6c5-f08e-476c-80d3-726a917aa426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:07.459746 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ead6c5-f08e-476c-80d3-726a917aa426 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:07.460177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ead6c5-f08e-476c-80d3-726a917aa426 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:07.460585 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ead6c5-f08e-476c-80d3-726a917aa426 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:07.461667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ead6c5-f08e-476c-80d3-726a917aa426 None admin] RBAC: Adding query filter params (role.id=0bb0d62bb4f84638888ceb6ecabda8b3, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=1994043a81bb454297c208839794a479) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:07.461984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ead6c5-f08e-476c-80d3-726a917aa426 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:07.464264 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ead6c5-f08e-476c-80d3-726a917aa426 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:07.472066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 311/628] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:40:07 2022] GET /identity/v3/role_assignments?user.id=1994043a81bb454297c208839794a479&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=0bb0d62bb4f84638888ceb6ecabda8b3 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:07.474579 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfb19f-edbe-467b-9161-fb25d5b0098c None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:07.474871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfb19f-edbe-467b-9161-fb25d5b0098c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:07.475428 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfb19f-edbe-467b-9161-fb25d5b0098c None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:07.481625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 312/629] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:07.483188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004b502-5628-4271-9aa4-6ba1d1b5e529 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:07.483522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004b502-5628-4271-9aa4-6ba1d1b5e529 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:07.483809 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004b502-5628-4271-9aa4-6ba1d1b5e529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:07.503797 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-b004b502-5628-4271-9aa4-6ba1d1b5e529 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:07.505072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-b004b502-5628-4271-9aa4-6ba1d1b5e529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:07.527310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1dfb5-4176-4e24-b2bd-104a0221c246 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:07.604681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2a668-18ac-43ae-9320-1403f91739db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:07.605394 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2a668-18ac-43ae-9320-1403f91739db None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:07.605676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2a668-18ac-43ae-9320-1403f91739db None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:07.605953 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2a668-18ac-43ae-9320-1403f91739db None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:07.606801 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2a668-18ac-43ae-9320-1403f91739db None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:07.607109 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2a668-18ac-43ae-9320-1403f91739db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:07.608550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2a668-18ac-43ae-9320-1403f91739db None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:07.618965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 313/630] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:40:07.635177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 318/631] 10.222.0.45 () {56 vars in 1135 bytes} [Thu May 26 13:40:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:07.640570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004b502-5628-4271-9aa4-6ba1d1b5e529 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:07.664599 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2a668-18ac-43ae-9320-1403f91739db None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:07.759217 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:07.783798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004b502-5628-4271-9aa4-6ba1d1b5e529 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:07.787183 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:07.807614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2a668-18ac-43ae-9320-1403f91739db None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:07.822525 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ac254-072e-446a-9d6d-9877ca665673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:07.823386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ac254-072e-446a-9d6d-9877ca665673 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:07.823673 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ac254-072e-446a-9d6d-9877ca665673 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:07.823948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ac254-072e-446a-9d6d-9877ca665673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:07.837613 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ac254-072e-446a-9d6d-9877ca665673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:07.839228 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ac254-072e-446a-9d6d-9877ca665673 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:07.852832 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c64cf-31b5-4361-9140-7f190ec70b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:07.854035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c64cf-31b5-4361-9140-7f190ec70b82 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:07.854683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c64cf-31b5-4361-9140-7f190ec70b82 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:07.855190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c64cf-31b5-4361-9140-7f190ec70b82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:07.862010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-2f3ac254-072e-446a-9d6d-9877ca665673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:07.862010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:07.862010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:07.862010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:07.862010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:07.862010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:07.862010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:07.862010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:07.862010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:07.862010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:07.862010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:07.862010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:07.862010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:07.862010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:07.862010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:07.862962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:07.862962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:07.862962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:07.862962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:07.862962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:07.862962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:07.862962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:07.862962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:07.862962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:07.862962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:07.862962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:07.862962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:07.862962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:07.862962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:07.862962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:07.862962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:07.862962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:07.864575 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:07.864575 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:07.864575 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:07.864575 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:07.864575 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 314/632] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:07.868688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ac254-072e-446a-9d6d-9877ca665673 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:07.870577 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c64cf-31b5-4361-9140-7f190ec70b82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:07.879029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-771c64cf-31b5-4361-9140-7f190ec70b82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:07.879029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:07.879029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:07.879029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:07.879029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:07.879029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:07.879029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:07.879029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:07.879029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:07.879029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:07.879029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:07.879029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:07.879029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:07.879029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:07.879029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:07.879029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:07.880035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:07.880035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:07.880035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:07.880035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:07.880035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:07.880035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:07.880035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:07.880035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:07.880035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:07.880035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:07.880035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:07.880035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:07.880035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:07.880035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:07.880035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:07.880035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:07.880899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:07.880899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:07.880899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:07.880899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:07.880899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:07.880899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:07.880899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:07.880899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:07.880899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:07.880899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:07.880899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:07.880899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:07.888564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 319/633] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:40:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:07.890067 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c64cf-31b5-4361-9140-7f190ec70b82 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:07.976741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ac254-072e-446a-9d6d-9877ca665673 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:08.002984 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c64cf-31b5-4361-9140-7f190ec70b82 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:08.004973 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:08.016642 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d4470-0337-4c73-aeef-67c9cea9bc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:08.016987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d4470-0337-4c73-aeef-67c9cea9bc93 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:08.017233 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d4470-0337-4c73-aeef-67c9cea9bc93 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:08.019088 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d4470-0337-4c73-aeef-67c9cea9bc93 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:08.019867 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d4470-0337-4c73-aeef-67c9cea9bc93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:08.020181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d4470-0337-4c73-aeef-67c9cea9bc93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:08.022324 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d4470-0337-4c73-aeef-67c9cea9bc93 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:08.037091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 315/634] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:08.038585 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf2490-c856-434f-bab5-13f01e9365fc None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:08.038794 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf2490-c856-434f-bab5-13f01e9365fc None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:08.039056 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf2490-c856-434f-bab5-13f01e9365fc None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:08.040613 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 316/635] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:08.044661 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf2490-c856-434f-bab5-13f01e9365fc None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:08.060718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a0797-0bba-4fb4-8de7-4e3786e6c3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:08.061492 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a0797-0bba-4fb4-8de7-4e3786e6c3b2 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:08.061775 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a0797-0bba-4fb4-8de7-4e3786e6c3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:08.062101 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a0797-0bba-4fb4-8de7-4e3786e6c3b2 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:08.062903 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a0797-0bba-4fb4-8de7-4e3786e6c3b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:08.063210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a0797-0bba-4fb4-8de7-4e3786e6c3b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:08.064592 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a0797-0bba-4fb4-8de7-4e3786e6c3b2 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:08.073208 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 320/636] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:40:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:08.074690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d907e01-278c-4267-89e4-9eca043ef33a None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:08.074894 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d907e01-278c-4267-89e4-9eca043ef33a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:08.075244 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d907e01-278c-4267-89e4-9eca043ef33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:08.089846 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:08.094674 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-7d907e01-278c-4267-89e4-9eca043ef33a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:08.097392 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7d907e01-278c-4267-89e4-9eca043ef33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:08.172782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf2490-c856-434f-bab5-13f01e9365fc None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:08.194778 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 321/637] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:40:08.194778 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d907e01-278c-4267-89e4-9eca043ef33a None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:08.222277 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff9a8d-4fd3-49ef-b9af-d80ef6ecb6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:08.223066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff9a8d-4fd3-49ef-b9af-d80ef6ecb6bb None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:08.223348 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff9a8d-4fd3-49ef-b9af-d80ef6ecb6bb None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:08.223654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff9a8d-4fd3-49ef-b9af-d80ef6ecb6bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:08.230979 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff9a8d-4fd3-49ef-b9af-d80ef6ecb6bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:08.232415 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff9a8d-4fd3-49ef-b9af-d80ef6ecb6bb None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:08.246715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-65ff9a8d-4fd3-49ef-b9af-d80ef6ecb6bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:08.246715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:08.246715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:08.246715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:08.246715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:08.246715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:08.246715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:08.246715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:08.246715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:08.246715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:08.246715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:08.246715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:08.246715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:08.246715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:08.246715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:08.247689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:08.247689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:08.247689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:08.247689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:08.247689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:08.247689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:08.247689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:08.247689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:08.247689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:08.247689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:08.247689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:08.247689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:08.247689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:08.247689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:08.247689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:08.247689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:08.247689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:08.248701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:08.248701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:08.248701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:08.248701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:08.248701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:08.248701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:08.248701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:08.248701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:08.248701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 317/638] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:08.249754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b24f49-e365-463a-be34-b8a9d9c45cb6 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:08.249754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b24f49-e365-463a-be34-b8a9d9c45cb6 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:08.249754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b24f49-e365-463a-be34-b8a9d9c45cb6 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:08.252305 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 318/639] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:08.253477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b24f49-e365-463a-be34-b8a9d9c45cb6 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:08.307600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:08.319759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d907e01-278c-4267-89e4-9eca043ef33a None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:08.349619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:08.360495 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6966c2f-c0c8-43a7-aab9-af01d64fc4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:08.361998 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6966c2f-c0c8-43a7-aab9-af01d64fc4b9 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:08.362289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6966c2f-c0c8-43a7-aab9-af01d64fc4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:08.362569 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6966c2f-c0c8-43a7-aab9-af01d64fc4b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:08.367410 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b24f49-e365-463a-be34-b8a9d9c45cb6 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:08.375716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6966c2f-c0c8-43a7-aab9-af01d64fc4b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:08.377645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6966c2f-c0c8-43a7-aab9-af01d64fc4b9 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:08.402059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-a6966c2f-c0c8-43a7-aab9-af01d64fc4b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:08.402059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:08.402059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:08.402059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:08.402059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:08.402059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:08.402059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:08.402059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:08.402059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:08.402059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:08.402059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:08.402059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:08.402059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:08.402059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:08.402059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:08.403020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:08.403020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:08.403020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:08.403020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:08.403020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:08.403020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:08.403020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:08.403020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:08.403020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:08.403020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:08.403020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:08.403020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:08.403020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:08.403020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:08.403020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:08.403020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:08.403020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:08.403932 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:08.403932 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:08.403932 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:08.403932 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:08.403932 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 322/640] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:08.404223 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6966c2f-c0c8-43a7-aab9-af01d64fc4b9 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:08.405563 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dd3aa-4c36-48ae-9b13-eb2782f1ce63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:08.406431 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dd3aa-4c36-48ae-9b13-eb2782f1ce63 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:08.406783 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dd3aa-4c36-48ae-9b13-eb2782f1ce63 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:08.407127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dd3aa-4c36-48ae-9b13-eb2782f1ce63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:08.417976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dd3aa-4c36-48ae-9b13-eb2782f1ce63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:08.427058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-342dd3aa-4c36-48ae-9b13-eb2782f1ce63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:08.427058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:08.427058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:08.427058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:08.427058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:08.427058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:08.427058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:08.427058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:08.427058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:08.427058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:08.427058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:08.427058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:08.427058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:08.427058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:08.427058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:08.427058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:08.428072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:08.428072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:08.428072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:08.428072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:08.428072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:08.428072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:08.428072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:08.428072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:08.428072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:08.428072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:08.428072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:08.428072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:08.428072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:08.428072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:08.428072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:08.428072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:08.428946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:08.428946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:08.428946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:08.428946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:08.428946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:08.428946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:08.428946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:08.428946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:08.428946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:08.428946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:08.428946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:08.428946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:08.428946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 319/641] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:40:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:08.429694 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba3fe0-8d71-47bf-b522-b83fe3f9c060 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:08.429942 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba3fe0-8d71-47bf-b522-b83fe3f9c060 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:08.430782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba3fe0-8d71-47bf-b522-b83fe3f9c060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:08.448063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-56ba3fe0-8d71-47bf-b522-b83fe3f9c060 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:08.449372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-56ba3fe0-8d71-47bf-b522-b83fe3f9c060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:08.518325 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6966c2f-c0c8-43a7-aab9-af01d64fc4b9 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:08.521320 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 320/642] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:40:08.521459 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba3fe0-8d71-47bf-b522-b83fe3f9c060 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:08.559046 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af967088-6add-4d96-bf32-066556c5e9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:08.559686 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af967088-6add-4d96-bf32-066556c5e9d7 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:08.559968 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af967088-6add-4d96-bf32-066556c5e9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:08.560245 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af967088-6add-4d96-bf32-066556c5e9d7 None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:08.561079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af967088-6add-4d96-bf32-066556c5e9d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:08.561443 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af967088-6add-4d96-bf32-066556c5e9d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:08.562855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af967088-6add-4d96-bf32-066556c5e9d7 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:08.571094 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:08.576820 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 323/643] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:08.577700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af967088-6add-4d96-bf32-066556c5e9d7 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:08.624371 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:08.639842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba3fe0-8d71-47bf-b522-b83fe3f9c060 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:08.682499 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285a3bf-ab07-4c8c-994b-c3923ecf4376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:08.683468 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285a3bf-ab07-4c8c-994b-c3923ecf4376 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:08.683764 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285a3bf-ab07-4c8c-994b-c3923ecf4376 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:08.684047 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285a3bf-ab07-4c8c-994b-c3923ecf4376 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:08.684771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285a3bf-ab07-4c8c-994b-c3923ecf4376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:08.685081 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285a3bf-ab07-4c8c-994b-c3923ecf4376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:08.685553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af967088-6add-4d96-bf32-066556c5e9d7 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:08.686477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285a3bf-ab07-4c8c-994b-c3923ecf4376 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:08.699811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 321/644] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:08.704746 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285a3bf-ab07-4c8c-994b-c3923ecf4376 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:08.720910 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337896cf-2bbd-4c93-b0f3-f6063cad202d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:08.721607 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337896cf-2bbd-4c93-b0f3-f6063cad202d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:08.721891 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337896cf-2bbd-4c93-b0f3-f6063cad202d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:08.722168 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337896cf-2bbd-4c93-b0f3-f6063cad202d None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:08.722908 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337896cf-2bbd-4c93-b0f3-f6063cad202d None admin] RBAC: Adding query filter params (name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:08.723215 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337896cf-2bbd-4c93-b0f3-f6063cad202d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:08.724598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337896cf-2bbd-4c93-b0f3-f6063cad202d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:08.732836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 324/645] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:40:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:08.733471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337896cf-2bbd-4c93-b0f3-f6063cad202d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:08.810495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:08.814430 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285a3bf-ab07-4c8c-994b-c3923ecf4376 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:08.852010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337896cf-2bbd-4c93-b0f3-f6063cad202d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:08.853781 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:08.855204 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baa756-550f-4b25-a0cb-1647382f19d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:08.855412 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baa756-550f-4b25-a0cb-1647382f19d5 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:08.855684 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baa756-550f-4b25-a0cb-1647382f19d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:08.855960 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baa756-550f-4b25-a0cb-1647382f19d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:08.867859 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8baa756-550f-4b25-a0cb-1647382f19d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:08.875597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-f8baa756-550f-4b25-a0cb-1647382f19d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:08.875597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:08.875597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:08.875597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:08.875597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:08.875597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:08.875597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:08.875597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:08.875597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:08.875597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:08.875597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:08.875597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:08.875597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:08.875597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:08.875597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:08.875597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:08.876529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:08.876529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:08.876529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:08.876529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:08.876529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:08.876529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:08.876529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:08.876529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:08.876529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:08.876529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:08.876529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:08.876529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:08.876529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:08.876529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:08.876529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:08.876529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:08.877560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:08.877560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:08.877560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:08.877560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:08.877560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:08.877560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:08.877560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:08.877560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:08.877560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:08.877560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:08.877560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:08.877560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:08.877560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 322/646] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:40:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:08.877560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baa756-550f-4b25-a0cb-1647382f19d5 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:08.894166 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511055e-83b2-4db3-99cd-4d746321ea83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:08.895048 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511055e-83b2-4db3-99cd-4d746321ea83 None admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:08.895334 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511055e-83b2-4db3-99cd-4d746321ea83 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:08.895604 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511055e-83b2-4db3-99cd-4d746321ea83 None admin] PATH_INFO: `/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/e517dc43cc6d401e820c65ad4c941386/roles/0bb0d62bb4f84638888ceb6ecabda8b3` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:08.909952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511055e-83b2-4db3-99cd-4d746321ea83 None admin] RBAC: Authorizing `identity:create_grant(project_id=095d02b8a79c4915ac8d3c5b81e195a4, user_id=e517dc43cc6d401e820c65ad4c941386, role_id=0bb0d62bb4f84638888ceb6ecabda8b3)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:08.911426 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511055e-83b2-4db3-99cd-4d746321ea83 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:08.929309 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 325/647] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:40:08 2022] PUT /identity/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/e517dc43cc6d401e820c65ad4c941386/roles/0bb0d62bb4f84638888ceb6ecabda8b3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:40:08.929309 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511055e-83b2-4db3-99cd-4d746321ea83 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:09.009035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baa756-550f-4b25-a0cb-1647382f19d5 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:09.048375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dabba-8f52-4052-8d6e-513ae96db3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:09.049402 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dabba-8f52-4052-8d6e-513ae96db3f2 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:09.049978 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dabba-8f52-4052-8d6e-513ae96db3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:09.050629 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dabba-8f52-4052-8d6e-513ae96db3f2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:09.060716 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92dabba-8f52-4052-8d6e-513ae96db3f2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:09.062172 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92dabba-8f52-4052-8d6e-513ae96db3f2 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:09.078700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511055e-83b2-4db3-99cd-4d746321ea83 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:09.078900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-e92dabba-8f52-4052-8d6e-513ae96db3f2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 13:40:09.078900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:09.078900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:09.078900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:09.078900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:09.078900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:09.078900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:09.078900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:09.078900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:09.078900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:09.078900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:09.078900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:09.078900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:09.078900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:09.078900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:09.078900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:09.079802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:09.079802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:09.079802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:09.079802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:09.079802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:09.079802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:09.079802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:09.079802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:09.079802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:09.079802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:09.079802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:09.079802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:09.079802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:09.079802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:09.079802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:09.079802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:09.079802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:09.079802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:09.080766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:09.080766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:09.080766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:09.080766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:09.080766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:09.080766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:09.080766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:09.080766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:09.080766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 13:40:09.080766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:09.080766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 323/648] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:40:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:09.081413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dabba-8f52-4052-8d6e-513ae96db3f2 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:09.111821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:09.132809 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd643e5f-5f18-41ff-b1ee-c05f9670b9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:09.133643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd643e5f-5f18-41ff-b1ee-c05f9670b9eb None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:09.134042 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd643e5f-5f18-41ff-b1ee-c05f9670b9eb None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:09.134335 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd643e5f-5f18-41ff-b1ee-c05f9670b9eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:09.149134 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd643e5f-5f18-41ff-b1ee-c05f9670b9eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:09.150726 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd643e5f-5f18-41ff-b1ee-c05f9670b9eb None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:09.170975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-bd643e5f-5f18-41ff-b1ee-c05f9670b9eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:09.170975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:09.170975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:09.170975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:09.170975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:09.170975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:09.170975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:09.170975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:09.170975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:09.170975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:09.170975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:09.170975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:09.170975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:09.170975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:09.170975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:09.171929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:09.171929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:09.171929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:09.171929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:09.171929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:09.171929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:09.171929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:09.171929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:09.171929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:09.171929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:09.171929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:09.171929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:09.171929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:09.171929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:09.171929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:09.171929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:09.171929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:09.172829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:09.172829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:09.172829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:09.172829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:09.172829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 326/649] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:09.173106 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd643e5f-5f18-41ff-b1ee-c05f9670b9eb None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:09.178140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:09.204705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dabba-8f52-4052-8d6e-513ae96db3f2 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:09.242473 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1625d0-8758-4f8b-b214-3e970767323d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:09.243458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1625d0-8758-4f8b-b214-3e970767323d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:09.243936 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1625d0-8758-4f8b-b214-3e970767323d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:09.244358 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1625d0-8758-4f8b-b214-3e970767323d None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:09.245254 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1625d0-8758-4f8b-b214-3e970767323d None admin] RBAC: Adding query filter params (name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:09.245842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1625d0-8758-4f8b-b214-3e970767323d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:09.247532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1625d0-8758-4f8b-b214-3e970767323d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:09.256655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 324/650] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:40:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:09.257757 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1625d0-8758-4f8b-b214-3e970767323d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:09.297554 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd643e5f-5f18-41ff-b1ee-c05f9670b9eb None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:09.339836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5167e-0c06-4213-b937-afb0b6d4df73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:09.341233 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5167e-0c06-4213-b937-afb0b6d4df73 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:09.341680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5167e-0c06-4213-b937-afb0b6d4df73 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:09.342173 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5167e-0c06-4213-b937-afb0b6d4df73 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:09.343306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5167e-0c06-4213-b937-afb0b6d4df73 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:09.343752 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5167e-0c06-4213-b937-afb0b6d4df73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:09.345490 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5167e-0c06-4213-b937-afb0b6d4df73 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:09.347633 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:09.367320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 327/651] 10.222.0.45 () {56 vars in 1137 bytes} [Thu May 26 13:40:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:09.368545 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5167e-0c06-4213-b937-afb0b6d4df73 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:09.368846 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1625d0-8758-4f8b-b214-3e970767323d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:09.405148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8783cf-5eb4-4d6d-b630-608ade0b6346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:09.405995 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8783cf-5eb4-4d6d-b630-608ade0b6346 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:09.406345 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8783cf-5eb4-4d6d-b630-608ade0b6346 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:09.406737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8783cf-5eb4-4d6d-b630-608ade0b6346 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:09.407966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8783cf-5eb4-4d6d-b630-608ade0b6346 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:09.407966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8783cf-5eb4-4d6d-b630-608ade0b6346 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:09.409408 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8783cf-5eb4-4d6d-b630-608ade0b6346 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:09.426913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 325/652] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:09.426913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8783cf-5eb4-4d6d-b630-608ade0b6346 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:09.443093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:09.488105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5167e-0c06-4213-b937-afb0b6d4df73 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:09.526237 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afba136-11b8-4497-b921-782460b59a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:09.527300 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afba136-11b8-4497-b921-782460b59a57 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:09.527746 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afba136-11b8-4497-b921-782460b59a57 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:09.527896 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8783cf-5eb4-4d6d-b630-608ade0b6346 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:09.528362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afba136-11b8-4497-b921-782460b59a57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:09.541834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afba136-11b8-4497-b921-782460b59a57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:09.543876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afba136-11b8-4497-b921-782460b59a57 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:09.563726 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ce286-bc2c-4e15-9525-aa899be8068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:09.564503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ce286-bc2c-4e15-9525-aa899be8068b None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:09.564900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ce286-bc2c-4e15-9525-aa899be8068b None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:09.565280 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ce286-bc2c-4e15-9525-aa899be8068b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:09.567032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-6afba136-11b8-4497-b921-782460b59a57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:09.567032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:09.567032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:09.567032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:09.567032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:09.567032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:09.567032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:09.567032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:09.567032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:09.567032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:09.567032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:09.567032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:09.567032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:09.567032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:09.567032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:09.568236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:09.568236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:09.568236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:09.568236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:09.568236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:09.568236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:09.568236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:09.568236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:09.568236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:09.568236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:09.568236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:09.568236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:09.568236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:09.568236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:09.568236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:09.568236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:09.568236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:09.569397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:09.569397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:09.569397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:09.569397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:09.571490 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 328/653] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:09.572480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afba136-11b8-4497-b921-782460b59a57 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:09.578907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:09.639124 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ce286-bc2c-4e15-9525-aa899be8068b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:09.640676 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ce286-bc2c-4e15-9525-aa899be8068b None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:09.687056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afba136-11b8-4497-b921-782460b59a57 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:09.703336 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:09.727602 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6e778-f4bf-489d-abfa-92090ba4a807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:09.728678 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6e778-f4bf-489d-abfa-92090ba4a807 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:09.729205 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6e778-f4bf-489d-abfa-92090ba4a807 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:09.729655 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6e778-f4bf-489d-abfa-92090ba4a807 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:09.737893 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6e778-f4bf-489d-abfa-92090ba4a807 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:09.740318 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6e778-f4bf-489d-abfa-92090ba4a807 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:09.756314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-f0b6e778-f4bf-489d-abfa-92090ba4a807 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 13:40:09.756314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:09.756314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:09.756314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:09.756314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:09.756314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:09.756314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:09.756314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:09.756314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:09.756314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:09.756314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:09.756314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:09.756314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:09.756314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:09.756314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:09.756314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:09.757558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:09.757558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:09.757558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:09.757558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:09.757558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:09.757558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:09.757558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:09.757558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:09.757558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:09.757558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:09.757558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:09.757558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:09.757558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:09.757558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:09.757558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:09.757558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:09.757558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:09.757558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:09.758760 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:09.758760 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:09.758760 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:09.758760 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:09.758760 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:09.758760 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:09.758760 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:09.758760 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:09.758760 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 13:40:09.758760 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:09.759441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 326/654] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:40:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:40:09.760495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ce286-bc2c-4e15-9525-aa899be8068b None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:09.766073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 329/655] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:40:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:09.767154 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6e778-f4bf-489d-abfa-92090ba4a807 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:09.803746 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:09.862690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ce286-bc2c-4e15-9525-aa899be8068b None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:09.880382 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6e778-f4bf-489d-abfa-92090ba4a807 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:09.897776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c76ce-60fe-4878-96da-f8a92468c10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:09.898521 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c76ce-60fe-4878-96da-f8a92468c10f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:09.898899 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c76ce-60fe-4878-96da-f8a92468c10f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:09.899275 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c76ce-60fe-4878-96da-f8a92468c10f None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:09.900164 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c76ce-60fe-4878-96da-f8a92468c10f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:09.900474 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c76ce-60fe-4878-96da-f8a92468c10f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:09.901969 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c76ce-60fe-4878-96da-f8a92468c10f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:09.914128 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 327/656] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:09.915027 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c76ce-60fe-4878-96da-f8a92468c10f None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:09.919024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e9313-802a-4da7-bd77-2e84736a0d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:09.920053 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e9313-802a-4da7-bd77-2e84736a0d5c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:09.920480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e9313-802a-4da7-bd77-2e84736a0d5c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:09.920912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e9313-802a-4da7-bd77-2e84736a0d5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:09.933745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e9313-802a-4da7-bd77-2e84736a0d5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:09.935451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e9313-802a-4da7-bd77-2e84736a0d5c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:09.956275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-313e9313-802a-4da7-bd77-2e84736a0d5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:09.956275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:09.956275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:09.956275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:09.956275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:09.956275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:09.956275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:09.956275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:09.956275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:09.956275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:09.956275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:09.956275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:09.956275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:09.956275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:09.956275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:09.957449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:09.957449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:09.957449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:09.957449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:09.957449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:09.957449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:09.957449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:09.957449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:09.957449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:09.957449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:09.957449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:09.957449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:09.957449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:09.957449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:09.957449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:09.957449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:09.957449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:09.958421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:09.958421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:09.958421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:09.958421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:09.960849 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 330/657] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:09.962119 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e9313-802a-4da7-bd77-2e84736a0d5c None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:09.994263 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:10.021561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:10.024425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c76ce-60fe-4878-96da-f8a92468c10f None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:10.060310 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015bfa2-d28c-4acb-aa5d-c25ac3d4ae1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:10.061103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015bfa2-d28c-4acb-aa5d-c25ac3d4ae1b None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:10.061471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015bfa2-d28c-4acb-aa5d-c25ac3d4ae1b None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:10.061814 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015bfa2-d28c-4acb-aa5d-c25ac3d4ae1b None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:10.062703 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015bfa2-d28c-4acb-aa5d-c25ac3d4ae1b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:10.063080 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015bfa2-d28c-4acb-aa5d-c25ac3d4ae1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:10.064576 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015bfa2-d28c-4acb-aa5d-c25ac3d4ae1b None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:10.078723 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e9313-802a-4da7-bd77-2e84736a0d5c None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:10.086982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 328/658] 10.222.0.45 () {56 vars in 1139 bytes} [Thu May 26 13:40:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:10.087927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015bfa2-d28c-4acb-aa5d-c25ac3d4ae1b None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:10.119296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b6164-a23a-44c4-bfaa-8719c4edd556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:10.120405 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b6164-a23a-44c4-bfaa-8719c4edd556 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:10.120869 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b6164-a23a-44c4-bfaa-8719c4edd556 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:10.121502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b6164-a23a-44c4-bfaa-8719c4edd556 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:10.130452 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b6164-a23a-44c4-bfaa-8719c4edd556 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:10.132218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b6164-a23a-44c4-bfaa-8719c4edd556 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:10.149010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-042b6164-a23a-44c4-bfaa-8719c4edd556 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 13:40:10.149010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:10.149010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:10.149010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:10.149010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:10.149010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:10.149010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:10.149010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:10.149010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:10.149010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:10.149010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:10.149010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:10.149010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:10.149010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:10.149010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:10.149010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:10.150058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:10.150058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:10.150058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:10.150058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:10.150058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:10.150058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:10.150058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:10.150058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:10.150058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:10.150058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:10.150058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:10.150058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:10.150058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:10.150058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:10.150058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:10.150058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:10.150058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:10.150058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:10.151041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:10.151041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:10.151041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:10.151041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:10.151041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:10.151041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:10.151041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:10.151041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:10.151041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 13:40:10.151041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:10.151041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 331/659] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:40:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:10.151654 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b6164-a23a-44c4-bfaa-8719c4edd556 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:10.204512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015bfa2-d28c-4acb-aa5d-c25ac3d4ae1b None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:10.238123 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:10.243840 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c0646-f139-4f4b-87a3-a45142297444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:10.244499 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c0646-f139-4f4b-87a3-a45142297444 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:10.244775 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c0646-f139-4f4b-87a3-a45142297444 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:10.245048 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c0646-f139-4f4b-87a3-a45142297444 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:10.245789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c0646-f139-4f4b-87a3-a45142297444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:10.246093 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c0646-f139-4f4b-87a3-a45142297444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:10.247461 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c0646-f139-4f4b-87a3-a45142297444 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:10.254263 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b6164-a23a-44c4-bfaa-8719c4edd556 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:10.260730 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 329/660] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:10.261920 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b931877-4132-4b3f-9304-68c8ac14cc83 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:10.262277 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b931877-4132-4b3f-9304-68c8ac14cc83 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:10.262630 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b931877-4132-4b3f-9304-68c8ac14cc83 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:10.265535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 330/661] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:10.265535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b931877-4132-4b3f-9304-68c8ac14cc83 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:10.287163 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:10.297096 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ac9c1-6e54-40bf-8fb2-a1f5ebab36e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:10.297980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ac9c1-6e54-40bf-8fb2-a1f5ebab36e7 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:10.298421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ac9c1-6e54-40bf-8fb2-a1f5ebab36e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:10.298698 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ac9c1-6e54-40bf-8fb2-a1f5ebab36e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:10.367955 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ac9c1-6e54-40bf-8fb2-a1f5ebab36e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:10.369418 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ac9c1-6e54-40bf-8fb2-a1f5ebab36e7 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:10.387872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b931877-4132-4b3f-9304-68c8ac14cc83 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:10.432690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a0bee-147c-48bb-b70c-a0fc924e4b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:10.433317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a0bee-147c-48bb-b70c-a0fc924e4b25 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:10.433602 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a0bee-147c-48bb-b70c-a0fc924e4b25 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:10.433880 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a0bee-147c-48bb-b70c-a0fc924e4b25 None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:10.434704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a0bee-147c-48bb-b70c-a0fc924e4b25 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:10.435014 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a0bee-147c-48bb-b70c-a0fc924e4b25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:10.436509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a0bee-147c-48bb-b70c-a0fc924e4b25 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:10.454681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 331/662] 10.222.0.45 () {56 vars in 1137 bytes} [Thu May 26 13:40:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:10.455379 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a0bee-147c-48bb-b70c-a0fc924e4b25 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:10.463180 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:10.480156 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 332/663] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:40:10.481499 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be4657-e289-4908-a96d-03969fa0e94b None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:10.481730 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be4657-e289-4908-a96d-03969fa0e94b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:10.482007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be4657-e289-4908-a96d-03969fa0e94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:10.497963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-b2be4657-e289-4908-a96d-03969fa0e94b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:10.499151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-b2be4657-e289-4908-a96d-03969fa0e94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:10.543426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:10.568172 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a0bee-147c-48bb-b70c-a0fc924e4b25 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:10.569329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 333/664] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:40:10.569984 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be4657-e289-4908-a96d-03969fa0e94b None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:10.615310 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f4637-f186-4b35-93ea-225bdb2a2865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:10.616259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f4637-f186-4b35-93ea-225bdb2a2865 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:10.616635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f4637-f186-4b35-93ea-225bdb2a2865 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:10.617033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f4637-f186-4b35-93ea-225bdb2a2865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:10.624397 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f4637-f186-4b35-93ea-225bdb2a2865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:10.625989 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f4637-f186-4b35-93ea-225bdb2a2865 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:10.640600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-7e0f4637-f186-4b35-93ea-225bdb2a2865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:10.640600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:10.640600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:10.640600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:10.640600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:10.640600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:10.640600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:10.640600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:10.640600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:10.640600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:10.640600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:10.640600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:10.640600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:10.640600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:10.640600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:10.641767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:10.641767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:10.641767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:10.641767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:10.641767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:10.641767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:10.641767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:10.641767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:10.641767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:10.641767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:10.641767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:10.641767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:10.641767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:10.641767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:10.641767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:10.641767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:10.641767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:10.642898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:10.642898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:10.642898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:10.642898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:10.642898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:10.642898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:10.642898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:10.642898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:10.648403 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 332/665] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:10.649166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f4637-f186-4b35-93ea-225bdb2a2865 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:10.676710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be4657-e289-4908-a96d-03969fa0e94b None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:10.700347 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:10.721876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e8885-ba4a-42a7-88a5-5032e4d3e369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:10.722730 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e8885-ba4a-42a7-88a5-5032e4d3e369 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:10.723182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e8885-ba4a-42a7-88a5-5032e4d3e369 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:10.723631 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e8885-ba4a-42a7-88a5-5032e4d3e369 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:10.755964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f4637-f186-4b35-93ea-225bdb2a2865 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:10.791653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4b866-b47e-4a69-8ca7-9653651ea93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:10.792796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4b866-b47e-4a69-8ca7-9653651ea93d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:10.792796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4b866-b47e-4a69-8ca7-9653651ea93d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:10.793080 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4b866-b47e-4a69-8ca7-9653651ea93d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:10.795255 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e8885-ba4a-42a7-88a5-5032e4d3e369 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:10.796087 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:10.797205 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e8885-ba4a-42a7-88a5-5032e4d3e369 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:10.805506 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4b866-b47e-4a69-8ca7-9653651ea93d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:10.806950 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4b866-b47e-4a69-8ca7-9653651ea93d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:10.825021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-f9b4b866-b47e-4a69-8ca7-9653651ea93d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:10.825021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:10.825021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:10.825021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:10.825021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:10.825021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:10.825021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:10.825021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:10.825021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:10.825021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:10.825021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:10.825021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:10.825021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:10.825021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:10.825021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:10.826148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:10.826148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:10.826148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:10.826148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:10.826148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:10.826148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:10.826148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:10.826148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:10.826148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:10.826148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:10.826148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:10.826148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:10.826148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:10.826148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:10.826148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:10.826148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:10.826148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:10.831819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:10.831819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:10.831819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:10.831819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:10.831819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 333/666] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:10.831819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4b866-b47e-4a69-8ca7-9653651ea93d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:10.913416 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 334/667] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 13:40:10.913416 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e8885-ba4a-42a7-88a5-5032e4d3e369 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:10.929790 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:10.941774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4b866-b47e-4a69-8ca7-9653651ea93d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:10.978789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba52c7-08d5-4006-a914-587c180b0141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:10.979884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba52c7-08d5-4006-a914-587c180b0141 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:10.980405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba52c7-08d5-4006-a914-587c180b0141 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:10.980887 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba52c7-08d5-4006-a914-587c180b0141 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:10.992482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba52c7-08d5-4006-a914-587c180b0141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:11.001101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-a4ba52c7-08d5-4006-a914-587c180b0141 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:40:11.001101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:11.001101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:11.001101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:11.001101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:11.001101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:11.001101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:11.001101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:11.001101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:11.001101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:11.001101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:11.001101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:11.001101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:11.001101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:11.001101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:11.001101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:11.002246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:11.002246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:11.002246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:11.002246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:11.002246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:11.002246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:11.002246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:11.002246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:11.002246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:11.002246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:11.002246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:11.002246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:11.002246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:11.002246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:11.002246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:11.002246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:11.003306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:11.003306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:11.003306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:11.003306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:11.003306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:11.003306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:11.003306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:11.003306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:11.003306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:11.003306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:11.003306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:40:11.003306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:11.011044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 334/668] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:40:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:11.012079 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba52c7-08d5-4006-a914-587c180b0141 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:11.017435 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e8885-ba4a-42a7-88a5-5032e4d3e369 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:11.056962 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d47cb-9a14-4249-9b2d-ccf2d53a78a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:11.057653 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d47cb-9a14-4249-9b2d-ccf2d53a78a5 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:11.057935 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d47cb-9a14-4249-9b2d-ccf2d53a78a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:11.058209 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d47cb-9a14-4249-9b2d-ccf2d53a78a5 None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:11.058993 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d47cb-9a14-4249-9b2d-ccf2d53a78a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:11.059460 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d47cb-9a14-4249-9b2d-ccf2d53a78a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:11.060717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d47cb-9a14-4249-9b2d-ccf2d53a78a5 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:11.067674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:11.074083 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 335/669] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:11.074751 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d47cb-9a14-4249-9b2d-ccf2d53a78a5 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:11.128896 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba52c7-08d5-4006-a914-587c180b0141 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:11.158948 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:11.167821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068594b-d38f-4116-a6ef-66de7ec52653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:11.168490 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068594b-d38f-4116-a6ef-66de7ec52653 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:11.168773 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068594b-d38f-4116-a6ef-66de7ec52653 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:11.169046 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068594b-d38f-4116-a6ef-66de7ec52653 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:11.169799 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068594b-d38f-4116-a6ef-66de7ec52653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:11.170108 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068594b-d38f-4116-a6ef-66de7ec52653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:11.171472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068594b-d38f-4116-a6ef-66de7ec52653 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:11.187896 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 335/670] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:11.188068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d47cb-9a14-4249-9b2d-ccf2d53a78a5 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:11.188165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068594b-d38f-4116-a6ef-66de7ec52653 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:11.223040 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfdd6a-e1a7-471c-8a89-162356846308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:11.223752 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfdd6a-e1a7-471c-8a89-162356846308 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:11.224034 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfdd6a-e1a7-471c-8a89-162356846308 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:11.224310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfdd6a-e1a7-471c-8a89-162356846308 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:11.234727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfdd6a-e1a7-471c-8a89-162356846308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:11.236145 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfdd6a-e1a7-471c-8a89-162356846308 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:11.252715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-e7cfdd6a-e1a7-471c-8a89-162356846308 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:11.252715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:11.252715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:11.252715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:11.252715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:11.252715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:11.252715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:11.252715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:11.252715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:11.252715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:11.252715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:11.252715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:11.252715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:11.252715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:11.252715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:11.253618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:11.253618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:11.253618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:11.253618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:11.253618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:11.253618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:11.253618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:11.253618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:11.253618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:11.253618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:11.253618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:11.253618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:11.253618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:11.253618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:11.253618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:11.253618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:11.253618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:11.255073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:11.255073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:11.255073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:11.255073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:11.255073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 336/671] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:11.255653 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfdd6a-e1a7-471c-8a89-162356846308 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:11.288695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068594b-d38f-4116-a6ef-66de7ec52653 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:11.297893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:11.322651 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462b930-1ce3-4bd0-b98f-de02ada0ee69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:11.323325 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462b930-1ce3-4bd0-b98f-de02ada0ee69 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:11.323611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462b930-1ce3-4bd0-b98f-de02ada0ee69 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:11.323889 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462b930-1ce3-4bd0-b98f-de02ada0ee69 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:11.324632 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462b930-1ce3-4bd0-b98f-de02ada0ee69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:11.324943 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462b930-1ce3-4bd0-b98f-de02ada0ee69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:11.326353 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462b930-1ce3-4bd0-b98f-de02ada0ee69 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:11.334895 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 336/672] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:40:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:11.335857 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462b930-1ce3-4bd0-b98f-de02ada0ee69 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:11.357039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfdd6a-e1a7-471c-8a89-162356846308 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:11.382836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:11.391304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef7bf4-f115-4eb3-a795-f3d1a66772f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:11.391953 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef7bf4-f115-4eb3-a795-f3d1a66772f8 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:11.392229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef7bf4-f115-4eb3-a795-f3d1a66772f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:11.392503 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef7bf4-f115-4eb3-a795-f3d1a66772f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:11.393343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef7bf4-f115-4eb3-a795-f3d1a66772f8 None admin] RBAC: Adding query filter params (role.id=0bb0d62bb4f84638888ceb6ecabda8b3, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=c8aed4c31eb14a3bbba08bef799ee450) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:11.393651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef7bf4-f115-4eb3-a795-f3d1a66772f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:11.395076 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef7bf4-f115-4eb3-a795-f3d1a66772f8 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:11.401466 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 337/673] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:40:11 2022] GET /identity/v3/role_assignments?user.id=c8aed4c31eb14a3bbba08bef799ee450&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=0bb0d62bb4f84638888ceb6ecabda8b3 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:11.402501 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb7ef4-85a4-40e4-a496-bcb32e221103 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:11.402781 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb7ef4-85a4-40e4-a496-bcb32e221103 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:11.403053 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb7ef4-85a4-40e4-a496-bcb32e221103 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:11.404250 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 338/674] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:11.404947 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb7ef4-85a4-40e4-a496-bcb32e221103 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:11.449195 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462b930-1ce3-4bd0-b98f-de02ada0ee69 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:11.488580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb5592-7b55-4023-8e16-a35d30d2def0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:11.489422 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb5592-7b55-4023-8e16-a35d30d2def0 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:11.489765 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb5592-7b55-4023-8e16-a35d30d2def0 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:11.490150 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb5592-7b55-4023-8e16-a35d30d2def0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:11.498098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb5592-7b55-4023-8e16-a35d30d2def0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:11.499608 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb5592-7b55-4023-8e16-a35d30d2def0 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:11.515802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-17cb5592-7b55-4023-8e16-a35d30d2def0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:11.515802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:11.515802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:11.515802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:11.515802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:11.515802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:11.515802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:11.515802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:11.515802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:11.515802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:11.515802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:11.515802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:11.515802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:11.515802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:11.515802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:11.516798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:11.516798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:11.516798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:11.516798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:11.516798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:11.516798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:11.516798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:11.516798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:11.516798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:11.516798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:11.516798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:11.516798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:11.516798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:11.516798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:11.516798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:11.516798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:11.516798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:11.517752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:11.517752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:11.517752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:11.517752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:11.517752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:11.517752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:11.517752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:11.517752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:11.517752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 337/675] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:11.518241 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb5592-7b55-4023-8e16-a35d30d2def0 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:11.534687 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb7ef4-85a4-40e4-a496-bcb32e221103 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:11.553169 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:11.582843 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dd734-2cca-45a4-b822-a7d364e07a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:11.583448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dd734-2cca-45a4-b822-a7d364e07a8e None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:11.583906 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dd734-2cca-45a4-b822-a7d364e07a8e None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:11.584014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dd734-2cca-45a4-b822-a7d364e07a8e None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:11.584717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dd734-2cca-45a4-b822-a7d364e07a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:11.585024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dd734-2cca-45a4-b822-a7d364e07a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:11.586435 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dd734-2cca-45a4-b822-a7d364e07a8e None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:11.601558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 339/676] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:11.603148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a133014-af99-4673-87bd-f3b4bd750bc3 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:11.603657 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a133014-af99-4673-87bd-f3b4bd750bc3 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:11.604128 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a133014-af99-4673-87bd-f3b4bd750bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:11.621339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-1a133014-af99-4673-87bd-f3b4bd750bc3 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:11.622521 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-1a133014-af99-4673-87bd-f3b4bd750bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:11.636659 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb5592-7b55-4023-8e16-a35d30d2def0 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:11.674599 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61111809-a6ff-4ad5-b463-d823772e8012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:11.675508 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61111809-a6ff-4ad5-b463-d823772e8012 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:11.676155 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:11.676949 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61111809-a6ff-4ad5-b463-d823772e8012 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:11.677238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61111809-a6ff-4ad5-b463-d823772e8012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:11.689455 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61111809-a6ff-4ad5-b463-d823772e8012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:11.690911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61111809-a6ff-4ad5-b463-d823772e8012 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:11.713306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 340/677] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:40:11.713306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a133014-af99-4673-87bd-f3b4bd750bc3 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:11.713583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-61111809-a6ff-4ad5-b463-d823772e8012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:11.713583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:11.713583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:11.713583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:11.713583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:11.713583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:11.713583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:11.713583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:11.713583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:11.713583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:11.713583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:11.713583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:11.713583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:11.713583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:11.713583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:11.714426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:11.714426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:11.714426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:11.714426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:11.714426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:11.714426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:11.714426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:11.714426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:11.714426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:11.714426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:11.714426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:11.714426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:11.714426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:11.714426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:11.714426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:11.714426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:11.714426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:11.715868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:11.715868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:11.715868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:11.715868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:11.715868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 338/678] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:11.715868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61111809-a6ff-4ad5-b463-d823772e8012 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:11.811083 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:11.823922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a133014-af99-4673-87bd-f3b4bd750bc3 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:11.831875 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61111809-a6ff-4ad5-b463-d823772e8012 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:11.858151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5405afd-ae33-4684-b423-8c21bbb55b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:11.858811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5405afd-ae33-4684-b423-8c21bbb55b59 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:11.859094 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5405afd-ae33-4684-b423-8c21bbb55b59 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:11.859365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5405afd-ae33-4684-b423-8c21bbb55b59 None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:11.860141 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5405afd-ae33-4684-b423-8c21bbb55b59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:11.860447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5405afd-ae33-4684-b423-8c21bbb55b59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:11.861888 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5405afd-ae33-4684-b423-8c21bbb55b59 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:11.869172 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72865150-20f7-4ff4-8b9e-e587a5bccfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:11.870172 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72865150-20f7-4ff4-8b9e-e587a5bccfc6 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:11.870718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72865150-20f7-4ff4-8b9e-e587a5bccfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:11.870990 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72865150-20f7-4ff4-8b9e-e587a5bccfc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:11.873749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 341/679] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:11.874533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5405afd-ae33-4684-b423-8c21bbb55b59 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:11.883609 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72865150-20f7-4ff4-8b9e-e587a5bccfc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:11.885356 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72865150-20f7-4ff4-8b9e-e587a5bccfc6 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:11.899745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-72865150-20f7-4ff4-8b9e-e587a5bccfc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:11.899745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:11.899745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:11.899745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:11.899745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:11.899745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:11.899745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:11.899745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:11.899745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:11.899745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:11.899745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:11.899745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:11.899745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:11.899745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:11.899745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:11.900655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:11.900655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:11.900655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:11.900655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:11.900655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:11.900655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:11.900655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:11.900655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:11.900655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:11.900655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:11.900655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:11.900655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:11.900655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:11.900655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:11.900655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:11.900655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:11.900655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:11.902295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:11.902295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:11.902295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:11.902295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:11.902295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:11.902295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:11.902295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:11.902295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:11.902295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 339/680] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:11.902295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72865150-20f7-4ff4-8b9e-e587a5bccfc6 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:11.924485 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:11.986473 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5405afd-ae33-4684-b423-8c21bbb55b59 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:12.017211 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72865150-20f7-4ff4-8b9e-e587a5bccfc6 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:12.020810 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941f299-4082-4445-b17b-2916a4633035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:12.021496 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941f299-4082-4445-b17b-2916a4633035 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:12.021777 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941f299-4082-4445-b17b-2916a4633035 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:12.022051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941f299-4082-4445-b17b-2916a4633035 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:12.022758 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941f299-4082-4445-b17b-2916a4633035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:12.023060 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941f299-4082-4445-b17b-2916a4633035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:12.024403 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941f299-4082-4445-b17b-2916a4633035 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:12.036943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 342/681] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:12.037839 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941f299-4082-4445-b17b-2916a4633035 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:12.057713 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad033da7-6ccd-47ee-9cd5-bbd2dce5a02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:12.058667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad033da7-6ccd-47ee-9cd5-bbd2dce5a02e None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:12.059249 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad033da7-6ccd-47ee-9cd5-bbd2dce5a02e None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:12.059538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad033da7-6ccd-47ee-9cd5-bbd2dce5a02e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:12.070754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad033da7-6ccd-47ee-9cd5-bbd2dce5a02e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:12.080612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-ad033da7-6ccd-47ee-9cd5-bbd2dce5a02e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:12.080612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:12.080612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:12.080612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:12.080612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:12.080612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:12.080612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:12.080612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:12.080612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:12.080612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:12.080612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:12.080612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:12.080612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:12.080612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:12.080612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:12.080612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:12.082458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:12.082458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:12.082458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:12.082458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:12.082458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:12.082458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:12.082458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:12.082458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:12.082458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:12.082458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:12.082458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:12.082458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:12.082458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:12.082458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:12.082458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:12.082458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:12.083977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:12.083977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:12.083977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:12.083977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:12.083977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:12.083977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:12.083977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:12.083977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:12.083977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:12.083977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:12.083977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:12.083977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:12.086679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 340/682] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:40:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:12.087529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad033da7-6ccd-47ee-9cd5-bbd2dce5a02e None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:12.092935 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:12.150877 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941f299-4082-4445-b17b-2916a4633035 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:12.152585 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:12.188385 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f6a13-9404-4a9a-91b8-1193b0e2a7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:12.189034 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f6a13-9404-4a9a-91b8-1193b0e2a7f9 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:12.189327 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f6a13-9404-4a9a-91b8-1193b0e2a7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:12.189602 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f6a13-9404-4a9a-91b8-1193b0e2a7f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:12.190414 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f6a13-9404-4a9a-91b8-1193b0e2a7f9 None admin] RBAC: Adding query filter params (role.id=0bb0d62bb4f84638888ceb6ecabda8b3, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=45105360300a4cae802fdbda91b9d5cb) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:12.190720 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f6a13-9404-4a9a-91b8-1193b0e2a7f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:12.192127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f6a13-9404-4a9a-91b8-1193b0e2a7f9 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:12.197872 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 343/683] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:40:12 2022] GET /identity/v3/role_assignments?user.id=45105360300a4cae802fdbda91b9d5cb&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=0bb0d62bb4f84638888ceb6ecabda8b3 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:12.198641 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f6a13-9404-4a9a-91b8-1193b0e2a7f9 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:12.209810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad033da7-6ccd-47ee-9cd5-bbd2dce5a02e None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:12.250391 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea62cd-9808-41f6-8bab-e7025be9673f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:12.251759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea62cd-9808-41f6-8bab-e7025be9673f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:12.252193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea62cd-9808-41f6-8bab-e7025be9673f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:12.252884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea62cd-9808-41f6-8bab-e7025be9673f None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:12.253885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea62cd-9808-41f6-8bab-e7025be9673f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:12.254696 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea62cd-9808-41f6-8bab-e7025be9673f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:12.257204 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea62cd-9808-41f6-8bab-e7025be9673f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:12.275831 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 341/684] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:12.276939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea62cd-9808-41f6-8bab-e7025be9673f None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:12.322479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f6a13-9404-4a9a-91b8-1193b0e2a7f9 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:12.357769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:12.361507 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610e392-9455-4eed-93fb-af6bde12125b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:12.362567 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610e392-9455-4eed-93fb-af6bde12125b None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:12.363033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610e392-9455-4eed-93fb-af6bde12125b None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:12.363482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610e392-9455-4eed-93fb-af6bde12125b None admin] PATH_INFO: `/v3/users/nova` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:12.372608 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610e392-9455-4eed-93fb-af6bde12125b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:12.374387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610e392-9455-4eed-93fb-af6bde12125b None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:12.390919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-2610e392-9455-4eed-93fb-af6bde12125b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 13:40:12.390919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:12.390919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:12.390919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:12.390919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:12.390919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:12.390919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:12.390919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:12.390919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:12.390919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:12.390919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:12.390919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:12.390919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:12.390919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:12.390919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:12.390919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:12.392362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:12.392362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:12.392362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:12.392362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:12.392362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:12.392362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:12.392362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:12.392362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:12.392362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:12.392362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:12.392362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:12.392362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:12.392362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:12.392362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:12.392362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:12.392362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:12.392362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:12.392362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:12.393320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:12.393320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:12.393320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:12.393320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:12.393320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:12.393320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:12.393320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:12.393320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:12.393320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 13:40:12.393320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:12.396112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 344/685] 10.222.0.45 () {56 vars in 1093 bytes} [Thu May 26 13:40:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:12.397235 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610e392-9455-4eed-93fb-af6bde12125b None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:12.412785 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea62cd-9808-41f6-8bab-e7025be9673f None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:12.429322 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:12.474798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b88a7a-cd4d-464b-897a-615cafaf5ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:12.475543 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b88a7a-cd4d-464b-897a-615cafaf5ca5 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:12.475830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b88a7a-cd4d-464b-897a-615cafaf5ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:12.476181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b88a7a-cd4d-464b-897a-615cafaf5ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:12.477503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b88a7a-cd4d-464b-897a-615cafaf5ca5 None admin] RBAC: Adding query filter params (name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:12.477503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b88a7a-cd4d-464b-897a-615cafaf5ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:12.478647 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b88a7a-cd4d-464b-897a-615cafaf5ca5 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:12.489815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 342/686] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:40:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:12.495505 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b88a7a-cd4d-464b-897a-615cafaf5ca5 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:12.528805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610e392-9455-4eed-93fb-af6bde12125b None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:12.569619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc8d88-141f-47fd-a4a9-23c2185df272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:12.570288 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc8d88-141f-47fd-a4a9-23c2185df272 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:12.570573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc8d88-141f-47fd-a4a9-23c2185df272 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:12.570855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc8d88-141f-47fd-a4a9-23c2185df272 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:12.571691 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc8d88-141f-47fd-a4a9-23c2185df272 None admin] RBAC: Adding query filter params (role.id=0bb0d62bb4f84638888ceb6ecabda8b3, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=e3039ec7e613464c8a71f4440dfe8bc1) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:12.572007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc8d88-141f-47fd-a4a9-23c2185df272 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:12.573545 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc8d88-141f-47fd-a4a9-23c2185df272 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:12.580070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 345/687] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:40:12 2022] GET /identity/v3/role_assignments?user.id=e3039ec7e613464c8a71f4440dfe8bc1&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=0bb0d62bb4f84638888ceb6ecabda8b3 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:12.580967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc8d88-141f-47fd-a4a9-23c2185df272 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:12.627249 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b88a7a-cd4d-464b-897a-615cafaf5ca5 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:12.658458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:12.679547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ba982-8b3a-47f3-8306-47e147b53c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:12.680236 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ba982-8b3a-47f3-8306-47e147b53c75 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:12.680518 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ba982-8b3a-47f3-8306-47e147b53c75 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:12.680794 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ba982-8b3a-47f3-8306-47e147b53c75 None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:12.681667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ba982-8b3a-47f3-8306-47e147b53c75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:12.681975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ba982-8b3a-47f3-8306-47e147b53c75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:12.683452 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ba982-8b3a-47f3-8306-47e147b53c75 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:12.732912 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 343/688] 10.222.0.45 () {56 vars in 1133 bytes} [Thu May 26 13:40:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:12.738419 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ba982-8b3a-47f3-8306-47e147b53c75 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:12.775370 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:12.788134 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc8d88-141f-47fd-a4a9-23c2185df272 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:12.845899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf71a72-0235-45a4-ace8-e1b945dfe703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:12.846622 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf71a72-0235-45a4-ace8-e1b945dfe703 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:12.846897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf71a72-0235-45a4-ace8-e1b945dfe703 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:12.847170 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf71a72-0235-45a4-ace8-e1b945dfe703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:12.865098 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf71a72-0235-45a4-ace8-e1b945dfe703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:12.866571 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf71a72-0235-45a4-ace8-e1b945dfe703 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:12.888363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-3bf71a72-0235-45a4-ace8-e1b945dfe703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:12.888363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:12.888363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:12.888363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:12.888363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:12.888363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:12.888363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:12.888363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:12.888363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:12.888363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:12.888363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:12.888363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:12.888363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:12.888363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:12.888363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:12.889343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:12.889343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:12.889343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:12.889343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:12.889343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:12.889343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:12.889343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:12.889343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:12.889343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:12.889343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:12.889343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:12.889343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:12.889343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:12.889343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:12.889343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:12.889343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:12.889343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:12.890266 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:12.890266 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:12.890266 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:12.890266 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:12.893376 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 346/689] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:12.895599 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf71a72-0235-45a4-ace8-e1b945dfe703 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:12.921546 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ba982-8b3a-47f3-8306-47e147b53c75 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:12.959709 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a235a1-f990-49c0-874a-fc6762f7fbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:12.960838 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a235a1-f990-49c0-874a-fc6762f7fbc8 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:12.961369 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a235a1-f990-49c0-874a-fc6762f7fbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:12.961871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a235a1-f990-49c0-874a-fc6762f7fbc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:13.000794 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf71a72-0235-45a4-ace8-e1b945dfe703 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:13.018926 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:13.037160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72852d-99e2-484b-a9f9-e4e17dbc7e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:13.037855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72852d-99e2-484b-a9f9-e4e17dbc7e7f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:13.038139 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72852d-99e2-484b-a9f9-e4e17dbc7e7f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:13.038417 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72852d-99e2-484b-a9f9-e4e17dbc7e7f None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:13.039134 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72852d-99e2-484b-a9f9-e4e17dbc7e7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:13.039547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72852d-99e2-484b-a9f9-e4e17dbc7e7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:13.041116 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72852d-99e2-484b-a9f9-e4e17dbc7e7f None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:13.043565 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a235a1-f990-49c0-874a-fc6762f7fbc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:13.045375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a235a1-f990-49c0-874a-fc6762f7fbc8 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:13.058028 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 347/690] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:13.059278 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72852d-99e2-484b-a9f9-e4e17dbc7e7f None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:13.062172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:13.161766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 344/691] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:40:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 13:40:13.167735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a235a1-f990-49c0-874a-fc6762f7fbc8 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:13.169622 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72852d-99e2-484b-a9f9-e4e17dbc7e7f None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:13.221792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8d1d4-aeb6-4586-a075-eed7981bc2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:13.223936 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8d1d4-aeb6-4586-a075-eed7981bc2cc None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:13.224447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8d1d4-aeb6-4586-a075-eed7981bc2cc None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:13.225018 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8d1d4-aeb6-4586-a075-eed7981bc2cc None admin] PATH_INFO: `/v3/users/swift` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:13.236892 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8d1d4-aeb6-4586-a075-eed7981bc2cc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:13.238940 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8d1d4-aeb6-4586-a075-eed7981bc2cc None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:13.257948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:13.261828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-95f8d1d4-aeb6-4586-a075-eed7981bc2cc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 13:40:13.261828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:13.261828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:13.261828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:13.261828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:13.261828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:13.261828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:13.261828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:13.261828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:13.261828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:13.261828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:13.261828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:13.261828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:13.261828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:13.261828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:13.261828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:13.262786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:13.262786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:13.262786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:13.262786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:13.262786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:13.262786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:13.262786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:13.262786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:13.262786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:13.262786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:13.262786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:13.262786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:13.262786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:13.262786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:13.262786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:13.262786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:13.262786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:13.262786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:13.264638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:13.264638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:13.264638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:13.264638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:13.264638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:13.264638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:13.264638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:13.264638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:13.264638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 13:40:13.264638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:13.267464 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 348/692] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:40:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:13.272857 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8d1d4-aeb6-4586-a075-eed7981bc2cc None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:13.294442 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a235a1-f990-49c0-874a-fc6762f7fbc8 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:13.361202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:13.370070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5d4a7-ae91-48e3-917d-ce8ceb1d4a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:13.370936 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5d4a7-ae91-48e3-917d-ce8ceb1d4a5b None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:13.371249 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5d4a7-ae91-48e3-917d-ce8ceb1d4a5b None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:13.371527 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5d4a7-ae91-48e3-917d-ce8ceb1d4a5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:13.397334 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5d4a7-ae91-48e3-917d-ce8ceb1d4a5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:13.398798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5d4a7-ae91-48e3-917d-ce8ceb1d4a5b None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:13.409686 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8d1d4-aeb6-4586-a075-eed7981bc2cc None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:13.441738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-d5a5d4a7-ae91-48e3-917d-ce8ceb1d4a5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:13.441738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:13.441738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:13.441738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:13.441738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:13.441738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:13.441738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:13.441738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:13.441738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:13.441738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:13.441738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:13.441738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:13.441738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:13.441738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:13.441738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:13.443234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:13.443234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:13.443234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:13.443234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:13.443234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:13.443234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:13.443234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:13.443234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:13.443234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:13.443234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:13.443234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:13.443234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:13.443234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:13.443234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:13.443234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:13.443234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:13.443234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:13.444162 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:13.444162 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:13.444162 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:13.444162 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:13.444162 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 345/693] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:13.448818 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5d4a7-ae91-48e3-917d-ce8ceb1d4a5b None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:13.452619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a5d56-c31e-463a-8a02-e19cd1b977d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:13.453686 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a5d56-c31e-463a-8a02-e19cd1b977d2 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:13.454181 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a5d56-c31e-463a-8a02-e19cd1b977d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:13.454728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a5d56-c31e-463a-8a02-e19cd1b977d2 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:13.456075 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a5d56-c31e-463a-8a02-e19cd1b977d2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:13.456596 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a5d56-c31e-463a-8a02-e19cd1b977d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:13.459887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a5d56-c31e-463a-8a02-e19cd1b977d2 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:13.479903 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 349/694] 10.222.0.45 () {56 vars in 1135 bytes} [Thu May 26 13:40:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:13.485053 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a5d56-c31e-463a-8a02-e19cd1b977d2 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:13.661175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5d4a7-ae91-48e3-917d-ce8ceb1d4a5b None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:13.691441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a5d56-c31e-463a-8a02-e19cd1b977d2 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:13.721207 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:13.727679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28a982-d661-4823-bd08-84d2e6ddef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:13.728337 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28a982-d661-4823-bd08-84d2e6ddef62 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:13.728615 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28a982-d661-4823-bd08-84d2e6ddef62 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:13.728885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28a982-d661-4823-bd08-84d2e6ddef62 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:13.729627 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28a982-d661-4823-bd08-84d2e6ddef62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:13.729927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28a982-d661-4823-bd08-84d2e6ddef62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:13.731289 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28a982-d661-4823-bd08-84d2e6ddef62 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:13.733014 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:13.750183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 346/695] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:13.757061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28a982-d661-4823-bd08-84d2e6ddef62 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:13.758054 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc414ee-e6c3-429e-9d4a-b2ed0c39cc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:13.758719 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc414ee-e6c3-429e-9d4a-b2ed0c39cc40 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:13.758991 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc414ee-e6c3-429e-9d4a-b2ed0c39cc40 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:13.759263 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc414ee-e6c3-429e-9d4a-b2ed0c39cc40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:13.837034 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc414ee-e6c3-429e-9d4a-b2ed0c39cc40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:13.838973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc414ee-e6c3-429e-9d4a-b2ed0c39cc40 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:13.866902 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28a982-d661-4823-bd08-84d2e6ddef62 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:13.901698 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272a474-32fd-4e1b-8d64-5c79a04ea6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:13.902482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272a474-32fd-4e1b-8d64-5c79a04ea6da None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:13.902760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272a474-32fd-4e1b-8d64-5c79a04ea6da None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:13.903060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272a474-32fd-4e1b-8d64-5c79a04ea6da None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:13.909876 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272a474-32fd-4e1b-8d64-5c79a04ea6da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:13.911353 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272a474-32fd-4e1b-8d64-5c79a04ea6da None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:13.925815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-5272a474-32fd-4e1b-8d64-5c79a04ea6da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:13.925815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:13.925815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:13.925815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:13.925815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:13.925815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:13.925815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:13.925815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:13.925815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:13.925815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:13.925815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:13.925815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:13.925815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:13.925815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:13.925815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:13.927312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:13.927312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:13.927312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:13.927312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:13.927312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:13.927312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:13.927312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:13.927312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:13.927312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:13.927312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:13.927312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:13.927312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:13.927312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:13.927312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:13.927312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:13.927312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:13.927312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:13.928250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:13.928250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:13.928250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:13.928250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:13.928250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:13.928250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:13.928250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:13.928250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:13.932363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 347/696] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:13.933699 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421088c8-6e96-47f3-81f9-ca729c8bdc35 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:13.933981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421088c8-6e96-47f3-81f9-ca729c8bdc35 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:13.934251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421088c8-6e96-47f3-81f9-ca729c8bdc35 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:13.939723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 348/697] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:13.939723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421088c8-6e96-47f3-81f9-ca729c8bdc35 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:13.960987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 350/698] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:40:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 13:40:13.962740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd020-b852-4cd1-bfca-b0048264be09 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:13.963194 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd020-b852-4cd1-bfca-b0048264be09 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:13.963620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd020-b852-4cd1-bfca-b0048264be09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:13.981251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-3cffd020-b852-4cd1-bfca-b0048264be09 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:13.982647 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-3cffd020-b852-4cd1-bfca-b0048264be09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:13.998581 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:14.000003 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:14.047848 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421088c8-6e96-47f3-81f9-ca729c8bdc35 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:14.065506 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 351/699] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:40:14.066623 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffd020-b852-4cd1-bfca-b0048264be09 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:14.086245 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289586e-8397-40a0-9683-4bbe06ed4b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:14.086872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289586e-8397-40a0-9683-4bbe06ed4b10 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:14.087247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289586e-8397-40a0-9683-4bbe06ed4b10 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:14.087615 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289586e-8397-40a0-9683-4bbe06ed4b10 None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:14.088822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d289586e-8397-40a0-9683-4bbe06ed4b10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:14.089279 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d289586e-8397-40a0-9683-4bbe06ed4b10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:14.090846 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d289586e-8397-40a0-9683-4bbe06ed4b10 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:14.103946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 349/700] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:14.104872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289586e-8397-40a0-9683-4bbe06ed4b10 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:14.195119 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffd020-b852-4cd1-bfca-b0048264be09 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:14.235699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d93e3-6be2-4e2b-a27f-7c79c16ce17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:14.236753 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d93e3-6be2-4e2b-a27f-7c79c16ce17c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:14.237186 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d93e3-6be2-4e2b-a27f-7c79c16ce17c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:14.237651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d93e3-6be2-4e2b-a27f-7c79c16ce17c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:14.249808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d93e3-6be2-4e2b-a27f-7c79c16ce17c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:14.251506 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d93e3-6be2-4e2b-a27f-7c79c16ce17c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:14.270157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-7e7d93e3-6be2-4e2b-a27f-7c79c16ce17c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:14.270157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:14.270157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:14.270157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:14.270157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:14.270157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:14.270157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:14.270157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:14.270157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:14.270157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:14.270157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:14.270157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:14.270157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:14.270157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:14.270157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:14.271182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:14.271182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:14.271182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:14.271182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:14.271182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:14.271182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:14.271182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:14.271182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:14.271182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:14.271182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:14.271182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:14.271182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:14.271182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:14.271182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:14.271182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:14.271182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:14.271182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:14.272102 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:14.272102 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:14.272102 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:14.272102 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:14.274527 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 352/701] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:14.275532 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d93e3-6be2-4e2b-a27f-7c79c16ce17c None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:14.278505 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:14.360146 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289586e-8397-40a0-9683-4bbe06ed4b10 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:14.376466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:14.382243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d93e3-6be2-4e2b-a27f-7c79c16ce17c None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:14.399895 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752604a-2a4b-4cf6-b58a-76eddda63056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:14.400743 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752604a-2a4b-4cf6-b58a-76eddda63056 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:14.401069 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752604a-2a4b-4cf6-b58a-76eddda63056 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:14.401368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752604a-2a4b-4cf6-b58a-76eddda63056 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:14.402014 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752604a-2a4b-4cf6-b58a-76eddda63056 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:14.403480 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752604a-2a4b-4cf6-b58a-76eddda63056 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:14.418789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-7752604a-2a4b-4cf6-b58a-76eddda63056 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 13:40:14.418789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:14.418789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:14.418789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:14.418789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:14.418789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:14.418789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:14.418789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:14.418789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 13:40:14.418789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:14.418789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:14.418789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:14.418789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:14.418789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:14.418789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:14.418789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:14.421142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:14.421142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:14.421142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:14.421142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:14.421142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:14.421142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:14.421142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:14.421142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:14.421142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:14.421142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:14.421142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:14.421142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:14.421142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:14.421142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:14.421142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:14.421142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:14.423070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:14.423070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:14.423070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:14.423070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:14.423070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:14.423070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:14.423070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:14.423070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:14.423070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:14.423070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:14.423070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:14.423070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:14.423070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:14.423070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 13:40:14.423070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:14.424352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 350/702] 10.222.0.45 () {56 vars in 1129 bytes} [Thu May 26 13:40:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:14.427644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752604a-2a4b-4cf6-b58a-76eddda63056 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:14.428061 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9ac48-fecb-4880-99fe-716f79cb6294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:14.429490 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9ac48-fecb-4880-99fe-716f79cb6294 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:14.429922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9ac48-fecb-4880-99fe-716f79cb6294 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:14.430348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9ac48-fecb-4880-99fe-716f79cb6294 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:14.431380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9ac48-fecb-4880-99fe-716f79cb6294 None admin] RBAC: Adding query filter params (role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=1994043a81bb454297c208839794a479) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:14.432042 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9ac48-fecb-4880-99fe-716f79cb6294 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:14.433668 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9ac48-fecb-4880-99fe-716f79cb6294 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:14.440244 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 353/703] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:40:14 2022] GET /identity/v3/role_assignments?user.id=1994043a81bb454297c208839794a479&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:14.441253 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9ac48-fecb-4880-99fe-716f79cb6294 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:14.513971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:14.551217 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9ac48-fecb-4880-99fe-716f79cb6294 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:14.590537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be33a6-609c-4751-830a-2bbbf2cbe076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:14.591467 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be33a6-609c-4751-830a-2bbbf2cbe076 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:14.591887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be33a6-609c-4751-830a-2bbbf2cbe076 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:14.592298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be33a6-609c-4751-830a-2bbbf2cbe076 None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:14.593220 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be33a6-609c-4751-830a-2bbbf2cbe076 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:14.593781 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be33a6-609c-4751-830a-2bbbf2cbe076 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:14.595416 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be33a6-609c-4751-830a-2bbbf2cbe076 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:14.601989 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 354/704] 10.222.0.45 () {56 vars in 1124 bytes} [Thu May 26 13:40:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:14.616940 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be33a6-609c-4751-830a-2bbbf2cbe076 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:14.620300 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752604a-2a4b-4cf6-b58a-76eddda63056 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:14.665019 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f22631-2d69-4814-bb28-46989e2c28ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:14.665719 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f22631-2d69-4814-bb28-46989e2c28ca None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:14.665997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f22631-2d69-4814-bb28-46989e2c28ca None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:14.666269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f22631-2d69-4814-bb28-46989e2c28ca None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:14.666991 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f22631-2d69-4814-bb28-46989e2c28ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:14.667294 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f22631-2d69-4814-bb28-46989e2c28ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:14.669827 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f22631-2d69-4814-bb28-46989e2c28ca None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:14.693473 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 351/705] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:14.697692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f22631-2d69-4814-bb28-46989e2c28ca None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:14.741732 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:14.808231 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be33a6-609c-4751-830a-2bbbf2cbe076 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:14.809665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f22631-2d69-4814-bb28-46989e2c28ca None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:14.850884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:14.857506 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b2094-9065-431d-acdc-3ce667d9d1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:14.858305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b2094-9065-431d-acdc-3ce667d9d1c8 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:14.859121 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b2094-9065-431d-acdc-3ce667d9d1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:14.859763 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b2094-9065-431d-acdc-3ce667d9d1c8 None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:14.861033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b2094-9065-431d-acdc-3ce667d9d1c8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:14.861617 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b2094-9065-431d-acdc-3ce667d9d1c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:14.862240 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431a943-1d4c-4efc-a6c8-f2124d8de502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:14.863349 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b2094-9065-431d-acdc-3ce667d9d1c8 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:14.863881 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431a943-1d4c-4efc-a6c8-f2124d8de502 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:14.864389 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431a943-1d4c-4efc-a6c8-f2124d8de502 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:14.865131 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431a943-1d4c-4efc-a6c8-f2124d8de502 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:14.870016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 355/706] 10.222.0.45 () {56 vars in 1124 bytes} [Thu May 26 13:40:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:14.871406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d6116-aa5b-49cb-8695-2bb63899cb40 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:14.871693 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d6116-aa5b-49cb-8695-2bb63899cb40 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:14.871972 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d6116-aa5b-49cb-8695-2bb63899cb40 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:14.874666 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431a943-1d4c-4efc-a6c8-f2124d8de502 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:14.876463 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431a943-1d4c-4efc-a6c8-f2124d8de502 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:14.877539 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 356/707] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:14.879678 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e62e6-4b18-42de-9f6d-b7b488e16b4a None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:14.879969 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e62e6-4b18-42de-9f6d-b7b488e16b4a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:14.880252 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e62e6-4b18-42de-9f6d-b7b488e16b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:14.893564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-7431a943-1d4c-4efc-a6c8-f2124d8de502 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:14.893564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:14.893564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:14.893564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:14.893564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:14.893564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:14.893564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:14.893564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:14.893564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:14.893564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:14.893564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:14.893564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:14.893564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:14.893564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:14.893564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:14.894538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:14.894538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:14.894538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:14.894538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:14.894538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:14.894538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:14.894538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:14.894538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:14.894538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:14.894538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:14.894538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:14.894538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:14.894538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:14.894538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:14.894538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:14.894538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:14.894538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:14.896031 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:14.896031 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:14.896031 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:14.896031 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:14.896031 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:14.896031 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:14.896031 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:14.896031 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:14.898903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 352/708] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:14.907073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431a943-1d4c-4efc-a6c8-f2124d8de502 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:14.932814 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-8f4e62e6-4b18-42de-9f6d-b7b488e16b4a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:14.934467 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8f4e62e6-4b18-42de-9f6d-b7b488e16b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:15.080571 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 357/709] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:40:15.118410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e62e6-4b18-42de-9f6d-b7b488e16b4a None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:15.121236 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:15.126103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431a943-1d4c-4efc-a6c8-f2124d8de502 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:15.175387 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14080dd1-99ba-4706-b648-352c1011426f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:15.176068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14080dd1-99ba-4706-b648-352c1011426f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:15.176996 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14080dd1-99ba-4706-b648-352c1011426f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:15.177823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14080dd1-99ba-4706-b648-352c1011426f None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:15.178735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14080dd1-99ba-4706-b648-352c1011426f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:15.179052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14080dd1-99ba-4706-b648-352c1011426f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:15.180517 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14080dd1-99ba-4706-b648-352c1011426f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:15.200628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 353/710] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:15.206988 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14080dd1-99ba-4706-b648-352c1011426f None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:15.251032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e62e6-4b18-42de-9f6d-b7b488e16b4a None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:15.280515 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:15.293183 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76785e50-cdcd-46ab-8091-6eb158aa4716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:15.294008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76785e50-cdcd-46ab-8091-6eb158aa4716 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:15.294292 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76785e50-cdcd-46ab-8091-6eb158aa4716 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:15.294892 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76785e50-cdcd-46ab-8091-6eb158aa4716 None admin] PATH_INFO: `/v3/services/network` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:15.295706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76785e50-cdcd-46ab-8091-6eb158aa4716 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:15.297080 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76785e50-cdcd-46ab-8091-6eb158aa4716 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:15.312982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-76785e50-cdcd-46ab-8091-6eb158aa4716 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 13:40:15.312982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:15.312982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:15.312982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:15.312982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:15.312982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:15.312982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:15.312982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:15.312982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 13:40:15.312982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:15.312982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:15.312982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:15.312982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:15.312982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:15.312982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:15.312982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:15.312982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:15.314056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:15.314056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:15.314056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:15.314056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:15.314056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:15.314056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:15.314056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:15.314056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:15.314056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:15.314056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:15.314056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:15.314056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:15.314056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:15.314056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:15.314056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:15.314056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:15.314916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:15.314916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:15.314916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:15.314916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:15.314916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:15.314916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:15.314916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:15.314916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:15.314916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:15.314916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:15.314916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:15.314916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:15.314916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 13:40:15.314916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:15.315768 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 358/711] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:15 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:15.320834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76785e50-cdcd-46ab-8091-6eb158aa4716 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:15.436411 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76785e50-cdcd-46ab-8091-6eb158aa4716 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:15.453437 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14080dd1-99ba-4706-b648-352c1011426f None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:15.477409 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad41be-9c7a-4efe-b36d-25a47aa26e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:15.478494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad41be-9c7a-4efe-b36d-25a47aa26e02 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:15.478780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad41be-9c7a-4efe-b36d-25a47aa26e02 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:15.479333 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad41be-9c7a-4efe-b36d-25a47aa26e02 None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:15.480053 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad41be-9c7a-4efe-b36d-25a47aa26e02 None admin] RBAC: Adding query filter params (name=network) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:15.480522 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad41be-9c7a-4efe-b36d-25a47aa26e02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:15.482576 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad41be-9c7a-4efe-b36d-25a47aa26e02 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:15.489033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 359/712] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 13:40:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:15.490438 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d01612-93b0-4f3e-b96d-fb0672d685ee None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:15.490730 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d01612-93b0-4f3e-b96d-fb0672d685ee None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:15.491005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d01612-93b0-4f3e-b96d-fb0672d685ee None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:15.492476 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 360/713] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:15.493912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d01612-93b0-4f3e-b96d-fb0672d685ee None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:15.500217 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39347f78-af43-405c-8fe6-6f9255859c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:15.500883 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39347f78-af43-405c-8fe6-6f9255859c2c None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:15.501166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39347f78-af43-405c-8fe6-6f9255859c2c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:15.501477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39347f78-af43-405c-8fe6-6f9255859c2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:15.502316 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39347f78-af43-405c-8fe6-6f9255859c2c None admin] RBAC: Adding query filter params (role.id=0bb0d62bb4f84638888ceb6ecabda8b3, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=e517dc43cc6d401e820c65ad4c941386) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:15.502628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39347f78-af43-405c-8fe6-6f9255859c2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:15.504168 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39347f78-af43-405c-8fe6-6f9255859c2c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:15.511367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 354/714] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:40:15 2022] GET /identity/v3/role_assignments?user.id=e517dc43cc6d401e820c65ad4c941386&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=0bb0d62bb4f84638888ceb6ecabda8b3 => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:15.512733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d044d9b-7bdd-4a1a-912b-d566db12b6eb None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:15.513029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d044d9b-7bdd-4a1a-912b-d566db12b6eb None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:15.513347 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d044d9b-7bdd-4a1a-912b-d566db12b6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:15.532206 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-1d044d9b-7bdd-4a1a-912b-d566db12b6eb None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:15.533443 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1d044d9b-7bdd-4a1a-912b-d566db12b6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:15.565661 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:15.568269 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:15.649051 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 355/715] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:40:15.664408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d01612-93b0-4f3e-b96d-fb0672d685ee None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:15.705117 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff53bd-2664-4c55-8006-9860ea2cd9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:15.706157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff53bd-2664-4c55-8006-9860ea2cd9b4 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:15.706626 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff53bd-2664-4c55-8006-9860ea2cd9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:15.707057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff53bd-2664-4c55-8006-9860ea2cd9b4 None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:15.708510 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff53bd-2664-4c55-8006-9860ea2cd9b4 None admin] RBAC: Adding query filter params (type=network) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:15.708974 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff53bd-2664-4c55-8006-9860ea2cd9b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:15.710592 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff53bd-2664-4c55-8006-9860ea2cd9b4 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:15.716574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 361/716] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 13:40:15 2022] GET /identity/v3/services?type=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:15.722498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d044d9b-7bdd-4a1a-912b-d566db12b6eb None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:15.846113 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d044d9b-7bdd-4a1a-912b-d566db12b6eb None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:15.893225 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81f8d0-dd89-4192-a500-801a372223b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:15.894077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81f8d0-dd89-4192-a500-801a372223b6 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:15.894359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81f8d0-dd89-4192-a500-801a372223b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:15.894635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81f8d0-dd89-4192-a500-801a372223b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:15.908635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81f8d0-dd89-4192-a500-801a372223b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:15.910141 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81f8d0-dd89-4192-a500-801a372223b6 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:15.932390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-ed81f8d0-dd89-4192-a500-801a372223b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:15.932390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:15.932390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:15.932390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:15.932390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:15.932390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:15.932390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:15.932390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:15.932390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:15.932390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:15.932390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:15.932390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:15.932390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:15.932390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:15.932390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:15.933561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:15.933561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:15.933561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:15.933561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:15.933561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:15.933561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:15.933561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:15.933561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:15.933561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:15.933561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:15.933561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:15.933561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:15.933561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:15.933561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:15.933561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:15.933561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:15.933561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:15.934704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:15.934704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:15.934704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:15.934704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:15.934704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 356/717] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:15.939384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff53bd-2664-4c55-8006-9860ea2cd9b4 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:16.077581 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff53bd-2664-4c55-8006-9860ea2cd9b4 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:16.103071 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:16.128408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7286b2-03d3-42ee-8802-76e5e96b78f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:16.129080 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7286b2-03d3-42ee-8802-76e5e96b78f9 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:16.129448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7286b2-03d3-42ee-8802-76e5e96b78f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:16.129727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7286b2-03d3-42ee-8802-76e5e96b78f9 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:16.130455 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7286b2-03d3-42ee-8802-76e5e96b78f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:16.130763 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7286b2-03d3-42ee-8802-76e5e96b78f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:16.132113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7286b2-03d3-42ee-8802-76e5e96b78f9 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:16.154756 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 362/718] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:16.161690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81f8d0-dd89-4192-a500-801a372223b6 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:16.165581 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:16.340064 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81f8d0-dd89-4192-a500-801a372223b6 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:16.400824 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c52c7-f8dc-4e16-a838-5b260768be9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:16.401890 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c52c7-f8dc-4e16-a838-5b260768be9e None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:16.402330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c52c7-f8dc-4e16-a838-5b260768be9e None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:16.402765 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c52c7-f8dc-4e16-a838-5b260768be9e None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:16.403921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c52c7-f8dc-4e16-a838-5b260768be9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:16.406295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c52c7-f8dc-4e16-a838-5b260768be9e None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:16.438770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 357/719] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 13:40:16 2022] POST /identity/v3/users => generated 254 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:40:17.250436 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccb308-18b2-4694-bf32-d39a65cf0e2c None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:17.250982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccb308-18b2-4694-bf32-d39a65cf0e2c None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:17.250982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccb308-18b2-4694-bf32-d39a65cf0e2c None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:17.252513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 363/720] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:17.258338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e860c-bb2b-4234-a720-939e51358ce4 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:17.259236 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e860c-bb2b-4234-a720-939e51358ce4 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:17.260003 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e860c-bb2b-4234-a720-939e51358ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:17.277494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-852e860c-bb2b-4234-a720-939e51358ce4 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:17.278986 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-852e860c-bb2b-4234-a720-939e51358ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:17.347286 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:17.371674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 358/721] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:40:17.406354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccb308-18b2-4694-bf32-d39a65cf0e2c None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:17.530956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccb308-18b2-4694-bf32-d39a65cf0e2c None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:17.572727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99515abe-53c1-4707-a0e3-5cc43fa4b69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:17.573542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99515abe-53c1-4707-a0e3-5cc43fa4b69c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:17.573829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99515abe-53c1-4707-a0e3-5cc43fa4b69c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:17.574103 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99515abe-53c1-4707-a0e3-5cc43fa4b69c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:17.590538 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99515abe-53c1-4707-a0e3-5cc43fa4b69c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:17.599122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-99515abe-53c1-4707-a0e3-5cc43fa4b69c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:40:17.599122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:17.599122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:17.599122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:17.599122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:17.599122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:17.599122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:17.599122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:17.599122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:17.599122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:17.599122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:17.599122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:17.599122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:17.599122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:17.599122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:17.599122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:17.600079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:17.600079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:17.600079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:17.600079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:17.600079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:17.600079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:17.600079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:17.600079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:17.600079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:17.600079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:17.600079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:17.600079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:17.600079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:17.600079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:17.600079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:17.600079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:17.600971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:17.600971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:17.600971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:17.600971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:17.600971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:17.600971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:17.600971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:17.600971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:17.600971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:17.600971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:17.600971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:40:17.600971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:17.603743 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 364/722] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:40:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:17.610058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e860c-bb2b-4234-a720-939e51358ce4 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:17.764881 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e860c-bb2b-4234-a720-939e51358ce4 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:17.805050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc78b5e-0f93-44d8-9ab1-1dc163adfcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:17.805688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc78b5e-0f93-44d8-9ab1-1dc163adfcc0 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:17.805974 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc78b5e-0f93-44d8-9ab1-1dc163adfcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:17.806249 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc78b5e-0f93-44d8-9ab1-1dc163adfcc0 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:17.807003 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc78b5e-0f93-44d8-9ab1-1dc163adfcc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:17.807311 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc78b5e-0f93-44d8-9ab1-1dc163adfcc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:17.808686 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc78b5e-0f93-44d8-9ab1-1dc163adfcc0 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:17.818446 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 359/723] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:40:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:17.825523 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99515abe-53c1-4707-a0e3-5cc43fa4b69c None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:17.890428 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:17.978365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99515abe-53c1-4707-a0e3-5cc43fa4b69c None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:17.984596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370f61e-b1a4-43d2-b3b9-e2417abe6bd1 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:17.984885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370f61e-b1a4-43d2-b3b9-e2417abe6bd1 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:17.985160 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370f61e-b1a4-43d2-b3b9-e2417abe6bd1 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:17.986676 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 360/724] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:17.992484 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5082f5-127a-4438-94aa-e647a337a4b2 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:17.993028 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5082f5-127a-4438-94aa-e647a337a4b2 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:17.993560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5082f5-127a-4438-94aa-e647a337a4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:18.019629 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-7e5082f5-127a-4438-94aa-e647a337a4b2 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:18.020865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-7e5082f5-127a-4438-94aa-e647a337a4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:18.051695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ee206-dc36-47e2-9f61-f3c90f757bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:18.052495 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ee206-dc36-47e2-9f61-f3c90f757bdd None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:18.052777 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ee206-dc36-47e2-9f61-f3c90f757bdd None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:18.053051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ee206-dc36-47e2-9f61-f3c90f757bdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:18.077796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ee206-dc36-47e2-9f61-f3c90f757bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:18.079181 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ee206-dc36-47e2-9f61-f3c90f757bdd None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:18.099256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-5b8ee206-dc36-47e2-9f61-f3c90f757bdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:18.099256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:18.099256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:18.099256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:18.099256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:18.099256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:18.099256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:18.099256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:18.099256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:18.099256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:18.099256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:18.099256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:18.099256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:18.099256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:18.099256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:18.100246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:18.100246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:18.100246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:18.100246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:18.100246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:18.100246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:18.100246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:18.100246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:18.100246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:18.100246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:18.100246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:18.100246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:18.100246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:18.100246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:18.100246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:18.100246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:18.100246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:18.101192 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:18.101192 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:18.101192 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:18.101192 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:18.103516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 365/725] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:18.109341 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ee206-dc36-47e2-9f61-f3c90f757bdd None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:18.111349 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:18.135922 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 361/726] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 13:40:18.211499 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5082f5-127a-4438-94aa-e647a337a4b2 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:18.236842 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:18.252896 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ee206-dc36-47e2-9f61-f3c90f757bdd None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:18.298789 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a42eff-5baa-4450-a52d-f484a205846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:18.300099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a42eff-5baa-4450-a52d-f484a205846a None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:18.303549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a42eff-5baa-4450-a52d-f484a205846a None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:18.304132 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a42eff-5baa-4450-a52d-f484a205846a None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:18.305099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a42eff-5baa-4450-a52d-f484a205846a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:18.305601 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a42eff-5baa-4450-a52d-f484a205846a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:18.307245 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a42eff-5baa-4450-a52d-f484a205846a None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:18.337933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 366/727] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:18.343110 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a42eff-5baa-4450-a52d-f484a205846a None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:18.467196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a42eff-5baa-4450-a52d-f484a205846a None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:18.484152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5082f5-127a-4438-94aa-e647a337a4b2 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:18.513889 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde2c1f-1c6d-4513-ab7e-a0a296543348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:18.515907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde2c1f-1c6d-4513-ab7e-a0a296543348 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:18.516661 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde2c1f-1c6d-4513-ab7e-a0a296543348 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:18.517097 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde2c1f-1c6d-4513-ab7e-a0a296543348 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:18.530488 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde2c1f-1c6d-4513-ab7e-a0a296543348 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:18.532218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde2c1f-1c6d-4513-ab7e-a0a296543348 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:18.534014 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc886b8-9be8-4d74-9bb9-a8e6aa047d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:18.534920 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc886b8-9be8-4d74-9bb9-a8e6aa047d58 None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:18.535372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc886b8-9be8-4d74-9bb9-a8e6aa047d58 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:18.536268 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc886b8-9be8-4d74-9bb9-a8e6aa047d58 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:18.537307 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc886b8-9be8-4d74-9bb9-a8e6aa047d58 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:18.539256 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc886b8-9be8-4d74-9bb9-a8e6aa047d58 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:18.549549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-dfde2c1f-1c6d-4513-ab7e-a0a296543348 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 13:40:18.549549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:18.549549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:18.549549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:18.549549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:18.549549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:18.549549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:18.549549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:18.549549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:18.549549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:18.549549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:18.549549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:18.549549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:18.549549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:18.549549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:18.549549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:18.551710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:18.551710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:18.551710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:18.551710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:18.551710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:18.551710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:18.551710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:18.551710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:18.551710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:18.551710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:18.551710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:18.551710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:18.551710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:18.551710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:18.551710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:18.551710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:18.551710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:18.551710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:18.553401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:18.553401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:18.553401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:18.553401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:18.553401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:18.553401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:18.553401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:18.553401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:18.553401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 13:40:18.553401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:18.553401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 367/728] 10.222.0.45 () {56 vars in 1093 bytes} [Thu May 26 13:40:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:18.553401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b1499-6185-4964-8aba-798d52c9b424 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:18.553401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b1499-6185-4964-8aba-798d52c9b424 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:18.554668 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b1499-6185-4964-8aba-798d52c9b424 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:18.556175 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 368/729] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:18.557563 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8727c2-4ba9-4fc2-b8f8-16daa36eb66b None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:18.557793 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8727c2-4ba9-4fc2-b8f8-16daa36eb66b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:18.557976 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8727c2-4ba9-4fc2-b8f8-16daa36eb66b None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:18.559374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 369/730] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:18.560096 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8727c2-4ba9-4fc2-b8f8-16daa36eb66b None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:18.569678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 362/731] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 13:40:18 2022] POST /identity/v3/services => generated 251 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:40:18.570683 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7ee41-5305-4c5a-a057-450724952a73 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:18.570683 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7ee41-5305-4c5a-a057-450724952a73 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:18.572809 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7ee41-5305-4c5a-a057-450724952a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:18.575561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:18.603158 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-01c7ee41-5305-4c5a-a057-450724952a73 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:18.605752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-01c7ee41-5305-4c5a-a057-450724952a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:18.660567 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:18.718029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 363/732] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:40:18.718490 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8727c2-4ba9-4fc2-b8f8-16daa36eb66b None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:18.719647 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c61d3-0ec6-41f4-82be-146fa1eeda5d None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:18.720041 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c61d3-0ec6-41f4-82be-146fa1eeda5d None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:18.720425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c61d3-0ec6-41f4-82be-146fa1eeda5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:18.741663 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-fa9c61d3-0ec6-41f4-82be-146fa1eeda5d None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:18.743129 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-fa9c61d3-0ec6-41f4-82be-146fa1eeda5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:18.794665 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7cdee-8050-48e7-97f4-bd033e0c3959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:18.795552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7cdee-8050-48e7-97f4-bd033e0c3959 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:18.795711 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7cdee-8050-48e7-97f4-bd033e0c3959 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:18.795962 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7cdee-8050-48e7-97f4-bd033e0c3959 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:18.796734 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7cdee-8050-48e7-97f4-bd033e0c3959 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:18.797043 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7cdee-8050-48e7-97f4-bd033e0c3959 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:18.798515 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7cdee-8050-48e7-97f4-bd033e0c3959 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:18.824598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 370/733] 10.222.0.45 () {56 vars in 1133 bytes} [Thu May 26 13:40:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:18.825532 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7cdee-8050-48e7-97f4-bd033e0c3959 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:18.839526 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 364/734] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 13:40:18.841164 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c61d3-0ec6-41f4-82be-146fa1eeda5d None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:18.909547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:18.950384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7cdee-8050-48e7-97f4-bd033e0c3959 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:18.991731 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:18.994251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9f433-c896-48e2-92c5-b36e88dea153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:18.995047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9f433-c896-48e2-92c5-b36e88dea153 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:18.995328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9f433-c896-48e2-92c5-b36e88dea153 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:18.995596 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9f433-c896-48e2-92c5-b36e88dea153 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:18.998202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c61d3-0ec6-41f4-82be-146fa1eeda5d None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:19.012133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9f433-c896-48e2-92c5-b36e88dea153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:19.023047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-9bd9f433-c896-48e2-92c5-b36e88dea153 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:40:19.023047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:19.023047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:19.023047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:19.023047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:19.023047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:19.023047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:19.023047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:19.023047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:19.023047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:19.023047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:19.023047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:19.023047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:19.023047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:19.023047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:19.023047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:19.024957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:19.024957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:19.024957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:19.024957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:19.024957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:19.024957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:19.024957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:19.024957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:19.024957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:19.024957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:19.024957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:19.024957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:19.024957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:19.024957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:19.024957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:19.024957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:19.026516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:19.026516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:19.026516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:19.026516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:19.026516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:19.026516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:19.026516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:19.026516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:19.026516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:19.026516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:19.026516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:40:19.026516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:19.026516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 371/735] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:40:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:19.026516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9f433-c896-48e2-92c5-b36e88dea153 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:19.044456 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041bdae-5ce9-4725-b353-605824fbd5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:19.045257 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041bdae-5ce9-4725-b353-605824fbd5a9 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:19.045606 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041bdae-5ce9-4725-b353-605824fbd5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:19.046274 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041bdae-5ce9-4725-b353-605824fbd5a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:19.060858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041bdae-5ce9-4725-b353-605824fbd5a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:19.062849 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041bdae-5ce9-4725-b353-605824fbd5a9 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:19.087531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-e041bdae-5ce9-4725-b353-605824fbd5a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:19.087531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:19.087531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:19.087531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:19.087531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:19.087531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:19.087531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:19.087531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:19.087531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:19.087531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:19.087531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:19.087531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:19.087531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:19.087531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:19.087531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:19.090025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:19.090025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:19.090025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:19.090025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:19.090025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:19.090025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:19.090025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:19.090025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:19.090025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:19.090025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:19.090025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:19.090025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:19.090025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:19.090025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:19.090025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:19.090025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:19.090025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:19.092653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:19.092653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:19.092653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:19.092653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:19.092653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 365/736] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:19.092653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041bdae-5ce9-4725-b353-605824fbd5a9 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:19.153167 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9f433-c896-48e2-92c5-b36e88dea153 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:19.184694 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:19.198390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4307a26-37d7-430d-88c0-c35cf7469f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:19.200650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4307a26-37d7-430d-88c0-c35cf7469f7a None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:19.201201 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4307a26-37d7-430d-88c0-c35cf7469f7a None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:19.201725 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4307a26-37d7-430d-88c0-c35cf7469f7a None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:19.202657 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4307a26-37d7-430d-88c0-c35cf7469f7a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:19.204245 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4307a26-37d7-430d-88c0-c35cf7469f7a None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:19.220200 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041bdae-5ce9-4725-b353-605824fbd5a9 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:19.224419 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 372/737] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 13:40:19 2022] POST /identity/v3/services => generated 240 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:40:19.225498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4307a26-37d7-430d-88c0-c35cf7469f7a None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:19.321992 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45d769-8950-4e85-9dce-058fe0a201d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:19.322675 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45d769-8950-4e85-9dce-058fe0a201d0 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:19.322958 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45d769-8950-4e85-9dce-058fe0a201d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:19.323234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45d769-8950-4e85-9dce-058fe0a201d0 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:19.323985 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45d769-8950-4e85-9dce-058fe0a201d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:19.324290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45d769-8950-4e85-9dce-058fe0a201d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:19.325695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45d769-8950-4e85-9dce-058fe0a201d0 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:19.347647 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 366/738] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:40:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:19.353807 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45d769-8950-4e85-9dce-058fe0a201d0 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:19.359356 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4307a26-37d7-430d-88c0-c35cf7469f7a None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:19.375841 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:19.405231 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef48651-c58b-49f9-a1ec-64c77f4d7e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:19.406873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef48651-c58b-49f9-a1ec-64c77f4d7e22 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:19.407389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef48651-c58b-49f9-a1ec-64c77f4d7e22 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:19.407887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef48651-c58b-49f9-a1ec-64c77f4d7e22 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:19.408856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef48651-c58b-49f9-a1ec-64c77f4d7e22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:19.409397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef48651-c58b-49f9-a1ec-64c77f4d7e22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:19.411796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef48651-c58b-49f9-a1ec-64c77f4d7e22 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:19.429806 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 373/739] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:19.436177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef48651-c58b-49f9-a1ec-64c77f4d7e22 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:19.494607 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:19.559433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef48651-c58b-49f9-a1ec-64c77f4d7e22 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:19.595636 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45d769-8950-4e85-9dce-058fe0a201d0 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:19.605524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733ca3b-a3d3-412e-b858-64565d354329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:19.607038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733ca3b-a3d3-412e-b858-64565d354329 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:19.607551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733ca3b-a3d3-412e-b858-64565d354329 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:19.608029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733ca3b-a3d3-412e-b858-64565d354329 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:19.617862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733ca3b-a3d3-412e-b858-64565d354329 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:19.620138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733ca3b-a3d3-412e-b858-64565d354329 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:19.638512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c1280-2a1c-4aa7-b795-c2140d87ffa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:19.639372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c1280-2a1c-4aa7-b795-c2140d87ffa0 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:19.639593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-7733ca3b-a3d3-412e-b858-64565d354329 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:19.639593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:19.639593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:19.639593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:19.639593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:19.639593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:19.639593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:19.639593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:19.639593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:19.639593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:19.639593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:19.639593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:19.639593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:19.639593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:19.639593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:19.640447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:19.640447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:19.640447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:19.640447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:19.640447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:19.640447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:19.640447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:19.640447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:19.640447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:19.640447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:19.640447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:19.640447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:19.640447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:19.640447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:19.640447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:19.640447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:19.640447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:19.641433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:19.641433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:19.641433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:19.641433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:19.641433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:19.641433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:19.641433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:19.641433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:19.641876 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c1280-2a1c-4aa7-b795-c2140d87ffa0 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:19.641876 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c1280-2a1c-4aa7-b795-c2140d87ffa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:19.644108 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 374/740] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:19.649493 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733ca3b-a3d3-412e-b858-64565d354329 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:19.657500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c1280-2a1c-4aa7-b795-c2140d87ffa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:19.658967 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c1280-2a1c-4aa7-b795-c2140d87ffa0 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:19.681290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-6c9c1280-2a1c-4aa7-b795-c2140d87ffa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:19.681290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:19.681290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:19.681290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:19.681290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:19.681290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:19.681290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:19.681290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:19.681290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:19.681290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:19.681290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:19.681290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:19.681290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:19.681290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:19.681290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:19.682247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:19.682247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:19.682247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:19.682247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:19.682247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:19.682247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:19.682247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:19.682247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:19.682247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:19.682247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:19.682247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:19.682247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:19.682247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:19.682247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:19.682247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:19.682247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:19.682247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:19.683240 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:19.683240 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:19.683240 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:19.683240 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:19.687691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 367/741] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:19.688994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c1280-2a1c-4aa7-b795-c2140d87ffa0 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:19.763938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:19.800775 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733ca3b-a3d3-412e-b858-64565d354329 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:19.809620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:19.837066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c1280-2a1c-4aa7-b795-c2140d87ffa0 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:19.888643 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa6a0f-fc2a-4421-a288-45c7cd6a9138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:19.889344 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa6a0f-fc2a-4421-a288-45c7cd6a9138 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:19.889623 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa6a0f-fc2a-4421-a288-45c7cd6a9138 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:19.889898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa6a0f-fc2a-4421-a288-45c7cd6a9138 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:19.890623 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa6a0f-fc2a-4421-a288-45c7cd6a9138 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:19.890924 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa6a0f-fc2a-4421-a288-45c7cd6a9138 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:19.892311 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa6a0f-fc2a-4421-a288-45c7cd6a9138 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:19.894406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6d55b-042b-400e-a5fa-abaf596b97dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:19.895107 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6d55b-042b-400e-a5fa-abaf596b97dd None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:19.895385 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6d55b-042b-400e-a5fa-abaf596b97dd None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:19.895658 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6d55b-042b-400e-a5fa-abaf596b97dd None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:19.896452 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6d55b-042b-400e-a5fa-abaf596b97dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:19.896764 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6d55b-042b-400e-a5fa-abaf596b97dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:19.898230 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6d55b-042b-400e-a5fa-abaf596b97dd None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:19.917460 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 368/743] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:19.917983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 375/743] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:19.918092 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f3da9-966c-4084-8c45-2c9055e5e5b1 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:19.918341 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f3da9-966c-4084-8c45-2c9055e5e5b1 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:19.918616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f3da9-966c-4084-8c45-2c9055e5e5b1 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:19.919548 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6d55b-042b-400e-a5fa-abaf596b97dd None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:19.924032 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 369/744] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:19.924032 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f3da9-966c-4084-8c45-2c9055e5e5b1 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:20.044435 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6d55b-042b-400e-a5fa-abaf596b97dd None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:20.050459 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f3da9-966c-4084-8c45-2c9055e5e5b1 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:20.078705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:20.091811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c8389-9fa0-46b0-93f4-12b5b68be6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:20.093108 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c8389-9fa0-46b0-93f4-12b5b68be6e3 None admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:20.093628 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c8389-9fa0-46b0-93f4-12b5b68be6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:20.094111 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c8389-9fa0-46b0-93f4-12b5b68be6e3 None admin] PATH_INFO: `/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/1994043a81bb454297c208839794a479/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:20.094846 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38e3c3-f4e3-4f33-964f-57f8d26a8bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:20.095644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38e3c3-f4e3-4f33-964f-57f8d26a8bb3 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:20.095926 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38e3c3-f4e3-4f33-964f-57f8d26a8bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:20.096202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38e3c3-f4e3-4f33-964f-57f8d26a8bb3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:20.097301 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c8389-9fa0-46b0-93f4-12b5b68be6e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=095d02b8a79c4915ac8d3c5b81e195a4, user_id=1994043a81bb454297c208839794a479, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:20.099206 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c8389-9fa0-46b0-93f4-12b5b68be6e3 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:20.103925 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38e3c3-f4e3-4f33-964f-57f8d26a8bb3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:20.105675 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38e3c3-f4e3-4f33-964f-57f8d26a8bb3 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:20.121362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-5b38e3c3-f4e3-4f33-964f-57f8d26a8bb3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 13:40:20.121362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:20.121362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:20.121362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:20.121362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:20.121362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:20.121362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:20.121362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:20.121362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:20.121362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:20.121362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:20.121362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:20.121362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:20.121362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:20.121362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:20.121362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:20.122386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:20.122386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:20.122386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:20.122386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:20.122386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:20.122386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:20.122386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:20.122386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:20.122386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:20.122386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:20.122386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:20.122386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:20.122386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:20.122386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:20.122386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:20.122386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:20.122386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:20.122386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:20.123378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:20.123378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:20.123378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:20.123378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:20.123378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:20.123378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:20.123378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:20.123378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:20.123378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 13:40:20.123378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:20.123378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 370/746] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:40:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:20.124738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dd2f9-74d1-4801-a4b9-928e8e336ef2 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:20.124738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dd2f9-74d1-4801-a4b9-928e8e336ef2 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:20.124992 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dd2f9-74d1-4801-a4b9-928e8e336ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:20.125187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 376/746] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:40:19 2022] PUT /identity/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/1994043a81bb454297c208839794a479/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:40:20.128927 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c8389-9fa0-46b0-93f4-12b5b68be6e3 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:20.143354 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-6f8dd2f9-74d1-4801-a4b9-928e8e336ef2 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:20.144921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6f8dd2f9-74d1-4801-a4b9-928e8e336ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:20.179214 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:20.256291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 371/747] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:20.281126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dd2f9-74d1-4801-a4b9-928e8e336ef2 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:20.352172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c8389-9fa0-46b0-93f4-12b5b68be6e3 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:20.394177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961d642-4693-4edc-b800-2bebe062a07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:20.394970 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961d642-4693-4edc-b800-2bebe062a07a None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:20.395172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961d642-4693-4edc-b800-2bebe062a07a None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:20.395452 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961d642-4693-4edc-b800-2bebe062a07a None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:20.396588 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961d642-4693-4edc-b800-2bebe062a07a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:20.396904 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961d642-4693-4edc-b800-2bebe062a07a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:20.398541 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961d642-4693-4edc-b800-2bebe062a07a None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:20.425535 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 377/748] 10.222.0.45 () {56 vars in 1135 bytes} [Thu May 26 13:40:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:20.428730 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961d642-4693-4edc-b800-2bebe062a07a None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:20.439636 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dd2f9-74d1-4801-a4b9-928e8e336ef2 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:20.452592 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:20.483258 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43a85e-2ed4-40df-9c93-6a477bae4e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:20.484486 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43a85e-2ed4-40df-9c93-6a477bae4e0d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:20.484983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43a85e-2ed4-40df-9c93-6a477bae4e0d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:20.485645 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43a85e-2ed4-40df-9c93-6a477bae4e0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:20.508616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e43a85e-2ed4-40df-9c93-6a477bae4e0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:20.518483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-3e43a85e-2ed4-40df-9c93-6a477bae4e0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:20.518483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:20.518483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:20.518483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:20.518483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:20.518483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:20.518483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:20.518483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:20.518483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:20.518483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:20.518483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:20.518483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:20.518483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:20.518483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:20.518483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:20.518483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:20.519471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:20.519471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:20.519471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:20.519471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:20.519471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:20.519471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:20.519471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:20.519471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:20.519471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:20.519471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:20.519471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:20.519471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:20.519471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:20.519471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:20.519471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:20.519471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:20.520381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:20.520381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:20.520381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:20.520381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:20.520381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:20.520381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:20.520381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:20.520381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:20.520381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:20.520381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:20.520381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:20.520381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:20.524312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 372/749] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:40:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:20.530396 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43a85e-2ed4-40df-9c93-6a477bae4e0d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:20.576063 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:20.594014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961d642-4693-4edc-b800-2bebe062a07a None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:20.630329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cbb50-f789-4967-a05b-b6ec4bfde411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:20.631222 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cbb50-f789-4967-a05b-b6ec4bfde411 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:20.631577 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cbb50-f789-4967-a05b-b6ec4bfde411 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:20.631932 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cbb50-f789-4967-a05b-b6ec4bfde411 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:20.729896 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cbb50-f789-4967-a05b-b6ec4bfde411 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:20.731713 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cbb50-f789-4967-a05b-b6ec4bfde411 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:20.755523 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43a85e-2ed4-40df-9c93-6a477bae4e0d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:20.842244 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:20.854926 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bc9df-40dd-42c0-a516-f7e8b3199622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:20.855756 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc9df-40dd-42c0-a516-f7e8b3199622 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:20.855916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc9df-40dd-42c0-a516-f7e8b3199622 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:20.856152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc9df-40dd-42c0-a516-f7e8b3199622 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:20.856979 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bc9df-40dd-42c0-a516-f7e8b3199622 None admin] RBAC: Adding query filter params (name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:20.857305 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bc9df-40dd-42c0-a516-f7e8b3199622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:20.858695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bc9df-40dd-42c0-a516-f7e8b3199622 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:20.873534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 378/750] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:40:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 13:40:20.875465 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cbb50-f789-4967-a05b-b6ec4bfde411 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:20.885333 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 373/751] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:40:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:20.894256 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bc9df-40dd-42c0-a516-f7e8b3199622 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:20.973552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:20.984631 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cbb50-f789-4967-a05b-b6ec4bfde411 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:21.024462 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ab50e-40dc-4135-b60c-645e13e75212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:21.025668 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ab50e-40dc-4135-b60c-645e13e75212 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:21.026217 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ab50e-40dc-4135-b60c-645e13e75212 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:21.026707 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ab50e-40dc-4135-b60c-645e13e75212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:21.037967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ab50e-40dc-4135-b60c-645e13e75212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:21.039691 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ab50e-40dc-4135-b60c-645e13e75212 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:21.060197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-985ab50e-40dc-4135-b60c-645e13e75212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:21.060197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:21.060197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:21.060197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:21.060197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:21.060197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:21.060197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:21.060197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:21.060197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:21.060197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:21.060197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:21.060197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:21.060197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:21.060197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:21.060197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:21.061147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:21.061147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:21.061147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:21.061147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:21.061147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:21.061147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:21.061147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:21.061147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:21.061147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:21.061147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:21.061147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:21.061147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:21.061147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:21.061147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:21.061147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:21.061147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:21.061147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:21.062105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:21.062105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:21.062105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:21.062105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:21.069845 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 379/752] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:21.072045 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ab50e-40dc-4135-b60c-645e13e75212 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:21.110814 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:21.177580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bc9df-40dd-42c0-a516-f7e8b3199622 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:21.183505 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ab50e-40dc-4135-b60c-645e13e75212 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:21.226721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1f9ef-508d-4166-b683-27c37820ab75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:21.227510 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1f9ef-508d-4166-b683-27c37820ab75 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:21.227788 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1f9ef-508d-4166-b683-27c37820ab75 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:21.228061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1f9ef-508d-4166-b683-27c37820ab75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:21.230068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b33e96-d940-48e3-a37e-60ca7b381237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:21.231280 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b33e96-d940-48e3-a37e-60ca7b381237 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:21.231797 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b33e96-d940-48e3-a37e-60ca7b381237 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:21.232287 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b33e96-d940-48e3-a37e-60ca7b381237 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:21.233235 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b33e96-d940-48e3-a37e-60ca7b381237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:21.233789 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b33e96-d940-48e3-a37e-60ca7b381237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:21.235792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b33e96-d940-48e3-a37e-60ca7b381237 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:21.240153 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1f9ef-508d-4166-b683-27c37820ab75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:21.241614 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1f9ef-508d-4166-b683-27c37820ab75 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:21.255440 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 380/753] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:21.255440 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21de92-7aaa-44cb-b09f-ced7415ae2ff None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:21.255440 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21de92-7aaa-44cb-b09f-ced7415ae2ff None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:21.255440 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21de92-7aaa-44cb-b09f-ced7415ae2ff None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:21.256606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 381/754] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:21.257322 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21de92-7aaa-44cb-b09f-ced7415ae2ff None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:21.267578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-66b1f9ef-508d-4166-b683-27c37820ab75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:21.267578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:21.267578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:21.267578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:21.267578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:21.267578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:21.267578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:21.267578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:21.267578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:21.267578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:21.267578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:21.267578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:21.267578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:21.267578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:21.267578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:21.268512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:21.268512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:21.268512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:21.268512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:21.268512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:21.268512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:21.268512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:21.268512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:21.268512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:21.268512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:21.268512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:21.268512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:21.268512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:21.268512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:21.268512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:21.268512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:21.268512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:21.269503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:21.269503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:21.269503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:21.269503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:21.272629 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 374/755] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:21.274339 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265633d6-14ef-43bb-85ef-a92a4807af47 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:21.274868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265633d6-14ef-43bb-85ef-a92a4807af47 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:21.275358 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265633d6-14ef-43bb-85ef-a92a4807af47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:21.293050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-265633d6-14ef-43bb-85ef-a92a4807af47 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:21.294619 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-265633d6-14ef-43bb-85ef-a92a4807af47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:21.366567 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 375/756] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:21.367903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265633d6-14ef-43bb-85ef-a92a4807af47 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:21.379152 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:21.384811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:21.392382 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21de92-7aaa-44cb-b09f-ced7415ae2ff None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:21.442760 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4509e04-2f91-4e8b-9f69-b6f7abd59517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:21.443517 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4509e04-2f91-4e8b-9f69-b6f7abd59517 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:21.443754 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4509e04-2f91-4e8b-9f69-b6f7abd59517 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:21.444020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4509e04-2f91-4e8b-9f69-b6f7abd59517 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:21.453617 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4509e04-2f91-4e8b-9f69-b6f7abd59517 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:21.455046 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4509e04-2f91-4e8b-9f69-b6f7abd59517 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:21.473477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-f4509e04-2f91-4e8b-9f69-b6f7abd59517 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:21.473477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:21.473477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:21.473477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:21.473477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:21.473477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:21.473477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:21.473477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:21.473477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:21.473477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:21.473477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:21.473477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:21.473477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:21.473477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:21.473477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:21.474526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:21.474526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:21.474526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:21.474526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:21.474526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:21.474526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:21.474526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:21.474526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:21.474526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:21.474526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:21.474526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:21.474526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:21.474526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:21.474526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:21.474526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:21.474526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:21.474526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:21.475442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:21.475442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:21.475442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:21.475442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:21.475442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:21.475442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:21.475442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:21.475442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:21.483261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 382/757] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:21.483261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4509e04-2f91-4e8b-9f69-b6f7abd59517 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:21.489197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265633d6-14ef-43bb-85ef-a92a4807af47 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:21.529140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff65df0-3e56-45c0-b98e-c2e858033f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:21.530579 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff65df0-3e56-45c0-b98e-c2e858033f88 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:21.531083 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff65df0-3e56-45c0-b98e-c2e858033f88 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:21.531925 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff65df0-3e56-45c0-b98e-c2e858033f88 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:21.533154 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff65df0-3e56-45c0-b98e-c2e858033f88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:21.533699 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff65df0-3e56-45c0-b98e-c2e858033f88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:21.536614 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff65df0-3e56-45c0-b98e-c2e858033f88 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:21.552307 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 376/758] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:21.553618 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff65df0-3e56-45c0-b98e-c2e858033f88 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:21.606048 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4509e04-2f91-4e8b-9f69-b6f7abd59517 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:21.645372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cda9c4-51ee-4684-80aa-11ec963917be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:21.646549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cda9c4-51ee-4684-80aa-11ec963917be None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:21.647072 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cda9c4-51ee-4684-80aa-11ec963917be None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:21.647563 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cda9c4-51ee-4684-80aa-11ec963917be None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:21.647898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:21.648681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cda9c4-51ee-4684-80aa-11ec963917be None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:21.650274 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cda9c4-51ee-4684-80aa-11ec963917be None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:21.665502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-30cda9c4-51ee-4684-80aa-11ec963917be None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 13:40:21.665502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:21.665502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:21.665502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:21.665502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:21.665502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:21.665502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:21.665502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:21.665502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 13:40:21.665502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:21.665502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:21.665502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:21.665502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:21.665502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:21.665502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:21.665502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:21.666482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:21.666482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:21.666482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:21.666482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:21.666482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:21.666482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:21.666482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:21.666482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:21.666482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:21.666482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:21.666482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:21.666482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:21.666482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:21.666482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:21.666482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:21.666482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:21.667355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:21.667355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:21.667355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:21.667355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:21.667355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:21.667355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:21.667355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:21.667355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:21.667355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:21.667355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:21.667355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:21.667355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:21.667355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:21.667355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 13:40:21.667355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:21.671454 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 383/759] 10.222.0.45 () {56 vars in 1129 bytes} [Thu May 26 13:40:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:21.672451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cda9c4-51ee-4684-80aa-11ec963917be None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:21.683288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff65df0-3e56-45c0-b98e-c2e858033f88 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:21.697393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:21.724490 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338c21f-7fdd-4f69-a30a-90662ac0a57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:21.725496 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338c21f-7fdd-4f69-a30a-90662ac0a57d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:21.725996 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338c21f-7fdd-4f69-a30a-90662ac0a57d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:21.726486 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338c21f-7fdd-4f69-a30a-90662ac0a57d None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:21.727513 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338c21f-7fdd-4f69-a30a-90662ac0a57d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:21.727966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338c21f-7fdd-4f69-a30a-90662ac0a57d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:21.729621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338c21f-7fdd-4f69-a30a-90662ac0a57d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:21.744321 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 377/760] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:21.745381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338c21f-7fdd-4f69-a30a-90662ac0a57d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:21.789416 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cda9c4-51ee-4684-80aa-11ec963917be None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:21.826964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c4083-54ae-40cc-83b3-505480bbcd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:21.828241 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c4083-54ae-40cc-83b3-505480bbcd17 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:21.828638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c4083-54ae-40cc-83b3-505480bbcd17 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:21.829032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c4083-54ae-40cc-83b3-505480bbcd17 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:21.839374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c4083-54ae-40cc-83b3-505480bbcd17 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:21.841551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c4083-54ae-40cc-83b3-505480bbcd17 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:21.861854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-469c4083-54ae-40cc-83b3-505480bbcd17 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 13:40:21.861854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:21.861854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:21.861854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:21.861854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:21.861854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:21.861854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:21.861854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:21.861854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:21.861854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:21.861854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:21.861854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:21.861854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:21.861854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:21.861854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:21.861854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:21.862983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:21.862983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:21.862983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:21.862983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:21.862983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:21.862983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:21.862983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:21.862983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:21.862983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:21.862983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:21.862983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:21.862983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:21.862983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:21.862983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:21.862983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:21.862983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:21.862983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:21.862983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:21.864148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:21.864148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:21.864148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:21.864148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:21.864148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:21.864148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:21.864148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:21.864148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:21.864148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 13:40:21.864148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:21.865561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338c21f-7fdd-4f69-a30a-90662ac0a57d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:21.870856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 384/761] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 13:40:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:21.870856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c4083-54ae-40cc-83b3-505480bbcd17 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:21.909090 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feacf20-ece2-468e-938e-41e1daf2efe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:21.910140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feacf20-ece2-468e-938e-41e1daf2efe0 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:21.910687 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feacf20-ece2-468e-938e-41e1daf2efe0 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:21.911139 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feacf20-ece2-468e-938e-41e1daf2efe0 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:21.912111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feacf20-ece2-468e-938e-41e1daf2efe0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:21.912625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feacf20-ece2-468e-938e-41e1daf2efe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:21.914225 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feacf20-ece2-468e-938e-41e1daf2efe0 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:21.915575 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:21.925752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 378/762] 10.222.0.45 () {56 vars in 1124 bytes} [Thu May 26 13:40:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:21.927040 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feacf20-ece2-468e-938e-41e1daf2efe0 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:21.969818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:21.992930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c4083-54ae-40cc-83b3-505480bbcd17 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:22.037878 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93789c-4143-4be8-b0f4-3e2df37f43f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:22.038536 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93789c-4143-4be8-b0f4-3e2df37f43f5 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:22.038823 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93789c-4143-4be8-b0f4-3e2df37f43f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:22.039102 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93789c-4143-4be8-b0f4-3e2df37f43f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:22.039933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93789c-4143-4be8-b0f4-3e2df37f43f5 None admin] RBAC: Adding query filter params (role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=e517dc43cc6d401e820c65ad4c941386) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:22.040269 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93789c-4143-4be8-b0f4-3e2df37f43f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:22.041698 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93789c-4143-4be8-b0f4-3e2df37f43f5 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:22.047363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 385/763] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:40:21 2022] GET /identity/v3/role_assignments?user.id=e517dc43cc6d401e820c65ad4c941386&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:22.048144 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93789c-4143-4be8-b0f4-3e2df37f43f5 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:22.059350 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feacf20-ece2-468e-938e-41e1daf2efe0 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:22.111861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016313cb-755a-49d4-a9c9-0ac124b9e78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:22.112621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016313cb-755a-49d4-a9c9-0ac124b9e78e None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:22.112917 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016313cb-755a-49d4-a9c9-0ac124b9e78e None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:22.114264 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016313cb-755a-49d4-a9c9-0ac124b9e78e None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:22.115233 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016313cb-755a-49d4-a9c9-0ac124b9e78e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:22.115553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016313cb-755a-49d4-a9c9-0ac124b9e78e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:22.117048 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016313cb-755a-49d4-a9c9-0ac124b9e78e None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:22.149318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 379/764] 10.222.0.45 () {56 vars in 1149 bytes} [Thu May 26 13:40:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:22.149318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33952314-a1cf-4742-9917-8198612058df None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:22.149318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33952314-a1cf-4742-9917-8198612058df None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:22.149318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33952314-a1cf-4742-9917-8198612058df None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:22.150015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 380/765] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:22.154216 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33952314-a1cf-4742-9917-8198612058df None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:22.183926 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93789c-4143-4be8-b0f4-3e2df37f43f5 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:22.222778 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85369481-b235-4249-a47e-faa93b63447c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:22.223138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85369481-b235-4249-a47e-faa93b63447c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:22.223374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85369481-b235-4249-a47e-faa93b63447c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:22.223649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85369481-b235-4249-a47e-faa93b63447c None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:22.224368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85369481-b235-4249-a47e-faa93b63447c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:22.224675 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85369481-b235-4249-a47e-faa93b63447c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:22.226094 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85369481-b235-4249-a47e-faa93b63447c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:22.232035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 386/766] 10.222.0.45 () {56 vars in 1124 bytes} [Thu May 26 13:40:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:22.233664 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e9af1-9e47-442c-aa36-075b6f0d9bd4 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:22.233863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e9af1-9e47-442c-aa36-075b6f0d9bd4 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:22.234123 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e9af1-9e47-442c-aa36-075b6f0d9bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:22.248258 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:22.307868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33952314-a1cf-4742-9917-8198612058df None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:22.347092 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9fa4f-2e90-46c8-8eca-27f9cbeb8b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:22.347795 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9fa4f-2e90-46c8-8eca-27f9cbeb8b9c None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:22.348078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9fa4f-2e90-46c8-8eca-27f9cbeb8b9c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:22.348354 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9fa4f-2e90-46c8-8eca-27f9cbeb8b9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:22.377351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-839e9af1-9e47-442c-aa36-075b6f0d9bd4 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:22.378554 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-839e9af1-9e47-442c-aa36-075b6f0d9bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:22.381187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:22.433761 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9fa4f-2e90-46c8-8eca-27f9cbeb8b9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:22.435611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9fa4f-2e90-46c8-8eca-27f9cbeb8b9c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:22.457724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 387/767] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:22.458678 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e9af1-9e47-442c-aa36-075b6f0d9bd4 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:22.497302 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:22.549317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 381/768] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:40:22 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 13:40:22.550483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9fa4f-2e90-46c8-8eca-27f9cbeb8b9c None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:22.589097 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e9af1-9e47-442c-aa36-075b6f0d9bd4 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:22.637411 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474feb6-6c73-4a48-87a8-73bc93cc277d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:22.638747 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474feb6-6c73-4a48-87a8-73bc93cc277d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:22.638747 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474feb6-6c73-4a48-87a8-73bc93cc277d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:22.638747 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474feb6-6c73-4a48-87a8-73bc93cc277d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:22.639402 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474feb6-6c73-4a48-87a8-73bc93cc277d None admin] RBAC: Adding query filter params (interface=public, service_id=822964f533584448b0fa7208d47f3446, region_id=RegionOne) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:22.639713 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474feb6-6c73-4a48-87a8-73bc93cc277d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:22.641067 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474feb6-6c73-4a48-87a8-73bc93cc277d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:22.650754 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 388/769] 10.222.0.45 () {56 vars in 1251 bytes} [Thu May 26 13:40:22 2022] GET /identity/v3/endpoints?service_id=822964f533584448b0fa7208d47f3446&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:22.651669 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474feb6-6c73-4a48-87a8-73bc93cc277d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:22.654324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:22.679870 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9fa4f-2e90-46c8-8eca-27f9cbeb8b9c None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:22.720132 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012b952-7c08-42ee-8f98-e1812dc70f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:22.721163 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012b952-7c08-42ee-8f98-e1812dc70f9c None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:22.721620 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012b952-7c08-42ee-8f98-e1812dc70f9c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:22.722072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012b952-7c08-42ee-8f98-e1812dc70f9c None admin] PATH_INFO: `/v3/services/network` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:22.723926 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012b952-7c08-42ee-8f98-e1812dc70f9c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:22.726036 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012b952-7c08-42ee-8f98-e1812dc70f9c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:22.743363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-1012b952-7c08-42ee-8f98-e1812dc70f9c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 13:40:22.743363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:22.743363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:22.743363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:22.743363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:22.743363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:22.743363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:22.743363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:22.743363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 13:40:22.743363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:22.743363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:22.743363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:22.743363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:22.743363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:22.743363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:22.743363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:22.743363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:22.744625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:22.744625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:22.744625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:22.744625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:22.744625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:22.744625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:22.744625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:22.744625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:22.744625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:22.744625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:22.744625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:22.744625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:22.744625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:22.744625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:22.744625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:22.744625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:22.745733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:22.745733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:22.745733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:22.745733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:22.745733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:22.745733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:22.745733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:22.745733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:22.745733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:22.745733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:22.745733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:22.745733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:22.745733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 13:40:22.745733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:22.748337 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 382/770] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:22 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:22.749366 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012b952-7c08-42ee-8f98-e1812dc70f9c None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:22.777463 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:22.782983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474feb6-6c73-4a48-87a8-73bc93cc277d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:22.818588 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdfcfb-9abe-41aa-81f4-e0f42dff2b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:22.819382 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdfcfb-9abe-41aa-81f4-e0f42dff2b82 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:22.819663 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdfcfb-9abe-41aa-81f4-e0f42dff2b82 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:22.819940 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdfcfb-9abe-41aa-81f4-e0f42dff2b82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:22.830456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdfcfb-9abe-41aa-81f4-e0f42dff2b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:22.832428 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdfcfb-9abe-41aa-81f4-e0f42dff2b82 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:22.850229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-60bdfcfb-9abe-41aa-81f4-e0f42dff2b82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:22.850229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:22.850229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:22.850229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:22.850229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:22.850229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:22.850229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:22.850229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:22.850229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:22.850229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:22.850229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:22.850229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:22.850229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:22.850229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:22.850229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:22.851146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:22.851146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:22.851146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:22.851146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:22.851146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:22.851146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:22.851146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:22.851146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:22.851146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:22.851146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:22.851146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:22.851146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:22.851146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:22.851146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:22.851146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:22.851146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:22.851146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:22.852073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:22.852073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:22.852073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:22.852073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:22.852073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 389/771] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:22.852364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdfcfb-9abe-41aa-81f4-e0f42dff2b82 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:22.871966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012b952-7c08-42ee-8f98-e1812dc70f9c None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:22.914404 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa9004-fb71-44f9-b022-64e47b7a20e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:22.915328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa9004-fb71-44f9-b022-64e47b7a20e4 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:22.915790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa9004-fb71-44f9-b022-64e47b7a20e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:22.916320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:22.916729 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa9004-fb71-44f9-b022-64e47b7a20e4 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:22.917934 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa9004-fb71-44f9-b022-64e47b7a20e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:22.919546 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa9004-fb71-44f9-b022-64e47b7a20e4 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:22.925638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 383/772] 10.222.0.45 () {56 vars in 1087 bytes} [Thu May 26 13:40:22 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:22.927189 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a29e8b-ae0a-4e78-ace1-b8ff79a8567c None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:22.927645 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a29e8b-ae0a-4e78-ace1-b8ff79a8567c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:22.928078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a29e8b-ae0a-4e78-ace1-b8ff79a8567c None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:22.929903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 384/773] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:22.930838 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a29e8b-ae0a-4e78-ace1-b8ff79a8567c None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:22.976017 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdfcfb-9abe-41aa-81f4-e0f42dff2b82 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:23.021760 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8249e94-3f77-4c9b-9666-df0c9c5b0e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:23.022527 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8249e94-3f77-4c9b-9666-df0c9c5b0e8b None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:23.022944 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8249e94-3f77-4c9b-9666-df0c9c5b0e8b None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:23.023337 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8249e94-3f77-4c9b-9666-df0c9c5b0e8b None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:23.024306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8249e94-3f77-4c9b-9666-df0c9c5b0e8b None admin] RBAC: Adding query filter params (name=network) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:23.024711 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8249e94-3f77-4c9b-9666-df0c9c5b0e8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:23.026363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8249e94-3f77-4c9b-9666-df0c9c5b0e8b None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:23.037114 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 390/774] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 13:40:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:23.037114 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12732087-dd70-43c8-bbd7-8b1e6a308566 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:23.037114 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12732087-dd70-43c8-bbd7-8b1e6a308566 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:23.037114 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12732087-dd70-43c8-bbd7-8b1e6a308566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:23.038459 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:23.056627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-12732087-dd70-43c8-bbd7-8b1e6a308566 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:23.058343 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a29e8b-ae0a-4e78-ace1-b8ff79a8567c None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:23.058696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-12732087-dd70-43c8-bbd7-8b1e6a308566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:23.100680 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7afdf-45ef-4a31-a790-3cd2745b2bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:23.101493 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7afdf-45ef-4a31-a790-3cd2745b2bae None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:23.101850 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7afdf-45ef-4a31-a790-3cd2745b2bae None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:23.102207 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7afdf-45ef-4a31-a790-3cd2745b2bae None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:23.103691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7afdf-45ef-4a31-a790-3cd2745b2bae None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:23.103691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7afdf-45ef-4a31-a790-3cd2745b2bae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:23.104806 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7afdf-45ef-4a31-a790-3cd2745b2bae None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:23.118827 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 385/775] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:23.119928 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7afdf-45ef-4a31-a790-3cd2745b2bae None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:23.142974 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 391/776] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:23.144125 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12732087-dd70-43c8-bbd7-8b1e6a308566 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:23.206562 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:23.258427 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7afdf-45ef-4a31-a790-3cd2745b2bae None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:23.275492 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12732087-dd70-43c8-bbd7-8b1e6a308566 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:23.303189 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be7982-8f6b-41d2-86da-2462bafd7266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:23.304079 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be7982-8f6b-41d2-86da-2462bafd7266 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:23.304429 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be7982-8f6b-41d2-86da-2462bafd7266 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:23.304776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be7982-8f6b-41d2-86da-2462bafd7266 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:23.305677 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be7982-8f6b-41d2-86da-2462bafd7266 None admin] RBAC: Adding query filter params (type=network) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:23.306057 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be7982-8f6b-41d2-86da-2462bafd7266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:23.307570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be7982-8f6b-41d2-86da-2462bafd7266 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:23.311368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d773ab-2c83-406e-8997-0b94a648196c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:23.312155 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d773ab-2c83-406e-8997-0b94a648196c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:23.312434 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d773ab-2c83-406e-8997-0b94a648196c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:23.312706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d773ab-2c83-406e-8997-0b94a648196c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:23.314212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 386/777] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 13:40:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:23.314973 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be7982-8f6b-41d2-86da-2462bafd7266 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:23.320439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d773ab-2c83-406e-8997-0b94a648196c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:23.321894 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d773ab-2c83-406e-8997-0b94a648196c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:23.327033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:23.338012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-61d773ab-2c83-406e-8997-0b94a648196c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:23.338012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:23.338012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:23.338012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:23.338012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:23.338012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:23.338012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:23.338012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:23.338012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:23.338012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:23.338012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:23.338012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:23.338012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:23.338012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:23.338012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:23.339120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:23.339120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:23.339120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:23.339120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:23.339120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:23.339120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:23.339120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:23.339120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:23.339120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:23.339120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:23.339120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:23.339120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:23.339120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:23.339120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:23.339120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:23.339120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:23.339120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:23.340242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:23.340242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:23.340242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:23.340242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:23.340242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:23.340242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:23.340242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:23.340242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:23.342371 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 392/778] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:23.343306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d773ab-2c83-406e-8997-0b94a648196c None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:23.428744 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be7982-8f6b-41d2-86da-2462bafd7266 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:23.446050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d773ab-2c83-406e-8997-0b94a648196c None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:23.455147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:23.466603 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61540651-502a-4ff9-8f73-75e86d53bf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:23.467458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61540651-502a-4ff9-8f73-75e86d53bf8c None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:23.468063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61540651-502a-4ff9-8f73-75e86d53bf8c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:23.468063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61540651-502a-4ff9-8f73-75e86d53bf8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:23.479528 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61540651-502a-4ff9-8f73-75e86d53bf8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:23.482379 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ee406-98c0-455c-9c60-fcacc6d9cc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:23.483549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ee406-98c0-455c-9c60-fcacc6d9cc4b None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:23.483975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ee406-98c0-455c-9c60-fcacc6d9cc4b None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:23.484391 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ee406-98c0-455c-9c60-fcacc6d9cc4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:23.485652 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ee406-98c0-455c-9c60-fcacc6d9cc4b None admin] RBAC: Adding query filter params (interface=public, service_id=a972c8091c734e81a75b624ac4ee4677, region_id=RegionOne) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:23.486107 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ee406-98c0-455c-9c60-fcacc6d9cc4b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:23.487251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-61540651-502a-4ff9-8f73-75e86d53bf8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:40:23.487251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:23.487251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:23.487251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:23.487251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:23.487251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:23.487251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:23.487251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:23.487251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:23.487251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:23.487251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:23.487251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:23.487251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:23.487251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:23.487251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:23.487251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:23.488393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:23.488393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:23.488393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:23.488393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:23.488393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:23.488393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:23.488393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:23.488393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:23.488393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:23.488393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:23.488393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:23.488393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:23.488393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:23.488393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:23.488393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:23.488393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:23.489469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:23.489469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:23.489469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:23.489469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:23.489469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:23.489469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:23.489469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:23.489469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:23.489469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:23.489469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:23.489469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:40:23.489469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:23.490511 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ee406-98c0-455c-9c60-fcacc6d9cc4b None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:23.493474 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 387/779] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:40:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:23.494379 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61540651-502a-4ff9-8f73-75e86d53bf8c None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:23.496869 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 393/780] 10.222.0.45 () {56 vars in 1251 bytes} [Thu May 26 13:40:23 2022] GET /identity/v3/endpoints?service_id=a972c8091c734e81a75b624ac4ee4677&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:23.497909 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ee406-98c0-455c-9c60-fcacc6d9cc4b None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:23.573712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:23.603432 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61540651-502a-4ff9-8f73-75e86d53bf8c None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:23.617102 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ee406-98c0-455c-9c60-fcacc6d9cc4b None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:23.640818 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab05da5-4473-467d-b65e-f1f24337d1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:23.641509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab05da5-4473-467d-b65e-f1f24337d1d8 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:23.641795 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab05da5-4473-467d-b65e-f1f24337d1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:23.642242 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab05da5-4473-467d-b65e-f1f24337d1d8 None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:23.643027 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab05da5-4473-467d-b65e-f1f24337d1d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:23.643337 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab05da5-4473-467d-b65e-f1f24337d1d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:23.645748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab05da5-4473-467d-b65e-f1f24337d1d8 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:23.658083 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471353d-330f-40be-a2bf-db19d5d19ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:23.658999 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471353d-330f-40be-a2bf-db19d5d19ced None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:23.659480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471353d-330f-40be-a2bf-db19d5d19ced None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:23.659986 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471353d-330f-40be-a2bf-db19d5d19ced None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:23.660938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471353d-330f-40be-a2bf-db19d5d19ced None admin] RBAC: Adding query filter params (name=admin) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:23.661045 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 388/781] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:23.661577 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471353d-330f-40be-a2bf-db19d5d19ced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:23.663105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471353d-330f-40be-a2bf-db19d5d19ced None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:23.666094 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab05da5-4473-467d-b65e-f1f24337d1d8 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:23.685069 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 394/782] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:40:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:23.686170 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471353d-330f-40be-a2bf-db19d5d19ced None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:23.723369 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:23.794275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471353d-330f-40be-a2bf-db19d5d19ced None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:23.809495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab05da5-4473-467d-b65e-f1f24337d1d8 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:23.838218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:23.841492 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fe630-c99b-4e48-aa9a-d23207d2c559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:23.843383 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fe630-c99b-4e48-aa9a-d23207d2c559 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:23.843798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fe630-c99b-4e48-aa9a-d23207d2c559 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:23.844086 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fe630-c99b-4e48-aa9a-d23207d2c559 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:23.844923 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fe630-c99b-4e48-aa9a-d23207d2c559 None admin] RBAC: Adding query filter params (role.id=0bb0d62bb4f84638888ceb6ecabda8b3, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=135410329e56486c8ccb65b1f2d87aca) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:23.845236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fe630-c99b-4e48-aa9a-d23207d2c559 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:23.846684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fe630-c99b-4e48-aa9a-d23207d2c559 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:23.848725 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fe31d-e0b1-45e7-b870-76410c53fa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:23.849652 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fe31d-e0b1-45e7-b870-76410c53fa29 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:23.850150 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fe31d-e0b1-45e7-b870-76410c53fa29 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:23.850620 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fe31d-e0b1-45e7-b870-76410c53fa29 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:23.851500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fe31d-e0b1-45e7-b870-76410c53fa29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:23.853046 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fe31d-e0b1-45e7-b870-76410c53fa29 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:23.857470 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 395/783] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:40:23 2022] GET /identity/v3/role_assignments?user.id=135410329e56486c8ccb65b1f2d87aca&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=0bb0d62bb4f84638888ceb6ecabda8b3 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:23.858780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fe630-c99b-4e48-aa9a-d23207d2c559 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:23.873919 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 389/784] 10.222.0.45 () {56 vars in 1087 bytes} [Thu May 26 13:40:23 2022] GET /identity/v3/services => generated 772 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:24.016018 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:24.021072 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fe630-c99b-4e48-aa9a-d23207d2c559 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:24.061540 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a450c-e14d-4510-b5f1-256c4450e6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:24.062344 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a450c-e14d-4510-b5f1-256c4450e6ff None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:24.062631 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a450c-e14d-4510-b5f1-256c4450e6ff None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:24.062915 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a450c-e14d-4510-b5f1-256c4450e6ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:24.075162 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a450c-e14d-4510-b5f1-256c4450e6ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:24.076651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a450c-e14d-4510-b5f1-256c4450e6ff None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:24.096031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-bb5a450c-e14d-4510-b5f1-256c4450e6ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:24.096031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:24.096031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:24.096031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:24.096031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:24.096031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:24.096031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:24.096031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:24.096031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:24.096031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:24.096031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:24.096031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:24.096031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:24.096031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:24.096031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:24.096975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:24.096975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:24.096975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:24.096975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:24.096975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:24.096975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:24.096975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:24.096975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:24.096975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:24.096975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:24.096975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:24.096975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:24.096975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:24.096975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:24.096975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:24.096975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:24.096975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:24.098473 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:24.098473 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:24.098473 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:24.098473 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:24.098473 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 396/785] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:24.103843 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fe31d-e0b1-45e7-b870-76410c53fa29 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:24.214172 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fe31d-e0b1-45e7-b870-76410c53fa29 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:24.268380 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36103a9b-9438-4613-848f-814569bb1b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:24.269103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36103a9b-9438-4613-848f-814569bb1b76 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:24.269451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36103a9b-9438-4613-848f-814569bb1b76 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:24.269727 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36103a9b-9438-4613-848f-814569bb1b76 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:24.270500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36103a9b-9438-4613-848f-814569bb1b76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:24.270807 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36103a9b-9438-4613-848f-814569bb1b76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:24.272179 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36103a9b-9438-4613-848f-814569bb1b76 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:24.284658 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 390/786] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:24.295234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a450c-e14d-4510-b5f1-256c4450e6ff None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:24.432625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff071e-2bfa-44fe-8bfa-76d19614a5d8 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:24.432832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff071e-2bfa-44fe-8bfa-76d19614a5d8 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:24.433112 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff071e-2bfa-44fe-8bfa-76d19614a5d8 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:24.434573 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 391/787] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:24.436116 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a450c-e14d-4510-b5f1-256c4450e6ff None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:24.440546 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccef051-bf02-4e38-a041-74d15f16a794 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:24.440838 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccef051-bf02-4e38-a041-74d15f16a794 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:24.441149 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccef051-bf02-4e38-a041-74d15f16a794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:24.461896 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-dccef051-bf02-4e38-a041-74d15f16a794 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:24.463393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-dccef051-bf02-4e38-a041-74d15f16a794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:24.502204 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b1fee-65ec-4556-82fe-aae427b44eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:24.503003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b1fee-65ec-4556-82fe-aae427b44eff None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:24.503281 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b1fee-65ec-4556-82fe-aae427b44eff None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:24.503551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b1fee-65ec-4556-82fe-aae427b44eff None admin] PATH_INFO: `/v3/users/nova` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:24.514960 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b1fee-65ec-4556-82fe-aae427b44eff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:24.516381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b1fee-65ec-4556-82fe-aae427b44eff None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:24.540876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-cc5b1fee-65ec-4556-82fe-aae427b44eff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 13:40:24.540876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:24.540876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:24.540876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:24.540876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:24.540876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:24.540876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:24.540876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:24.540876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:24.540876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:24.540876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:24.540876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:24.540876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:24.540876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:24.540876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:24.540876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:24.541897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:24.541897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:24.541897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:24.541897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:24.541897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:24.541897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:24.541897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:24.541897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:24.541897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:24.541897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:24.541897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:24.541897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:24.541897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:24.541897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:24.541897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:24.541897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:24.541897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:24.541897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:24.542861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:24.542861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:24.542861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:24.542861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:24.542861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:24.542861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:24.542861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:24.542861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:24.542861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 13:40:24.542861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:24.542861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 397/788] 10.222.0.45 () {56 vars in 1093 bytes} [Thu May 26 13:40:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:24.550210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b1fee-65ec-4556-82fe-aae427b44eff None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:24.557209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:24.571719 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:24.596038 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 392/789] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 13:40:24.638319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccef051-bf02-4e38-a041-74d15f16a794 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:24.720900 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b1fee-65ec-4556-82fe-aae427b44eff None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:24.782041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fc770-a829-4de1-9659-22d77b7e2500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:24.782704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fc770-a829-4de1-9659-22d77b7e2500 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:24.782983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fc770-a829-4de1-9659-22d77b7e2500 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:24.783254 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fc770-a829-4de1-9659-22d77b7e2500 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:24.784152 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fc770-a829-4de1-9659-22d77b7e2500 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:24.784461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fc770-a829-4de1-9659-22d77b7e2500 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:24.785979 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fc770-a829-4de1-9659-22d77b7e2500 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:24.809577 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccef051-bf02-4e38-a041-74d15f16a794 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:24.822671 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 398/790] 10.222.0.45 () {56 vars in 1133 bytes} [Thu May 26 13:40:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:24.829721 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fc770-a829-4de1-9659-22d77b7e2500 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:24.880481 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1ff14-afb9-48f4-89aa-cfe433f72d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:24.881297 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1ff14-afb9-48f4-89aa-cfe433f72d2b None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:24.881572 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1ff14-afb9-48f4-89aa-cfe433f72d2b None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:24.881847 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1ff14-afb9-48f4-89aa-cfe433f72d2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:24.903172 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1ff14-afb9-48f4-89aa-cfe433f72d2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:24.910822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-9df1ff14-afb9-48f4-89aa-cfe433f72d2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:40:24.910822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:24.910822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:24.910822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:24.910822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:24.910822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:24.910822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:24.910822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:24.910822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:24.910822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:24.910822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:24.910822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:24.910822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:24.910822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:24.910822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:24.910822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:24.911748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:24.911748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:24.911748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:24.911748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:24.911748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:24.911748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:24.911748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:24.911748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:24.911748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:24.911748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:24.911748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:24.911748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:24.911748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:24.911748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:24.911748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:24.911748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:24.912842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:24.912842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:24.912842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:24.912842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:24.912842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:24.912842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:24.912842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:24.912842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:24.912842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:24.912842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:24.912842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:40:24.912842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:24.912842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 393/791] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:40:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:24.921804 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1ff14-afb9-48f4-89aa-cfe433f72d2b None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:24.938371 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:25.004092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fc770-a829-4de1-9659-22d77b7e2500 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:25.013631 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:25.058726 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9467cc4-6df6-41c5-947f-28da625ead11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:25.059374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9467cc4-6df6-41c5-947f-28da625ead11 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:25.059658 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9467cc4-6df6-41c5-947f-28da625ead11 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:25.059938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9467cc4-6df6-41c5-947f-28da625ead11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:25.145313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1ff14-afb9-48f4-89aa-cfe433f72d2b None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:25.164588 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9467cc4-6df6-41c5-947f-28da625ead11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:25.166068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9467cc4-6df6-41c5-947f-28da625ead11 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:25.214109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d082f-4e8a-4f29-93c6-c83af4bfaf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:25.214920 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d082f-4e8a-4f29-93c6-c83af4bfaf31 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:25.215206 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d082f-4e8a-4f29-93c6-c83af4bfaf31 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:25.215484 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d082f-4e8a-4f29-93c6-c83af4bfaf31 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:25.216352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d082f-4e8a-4f29-93c6-c83af4bfaf31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:25.216665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d082f-4e8a-4f29-93c6-c83af4bfaf31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:25.218071 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d082f-4e8a-4f29-93c6-c83af4bfaf31 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:25.236519 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:25.238149 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 394/792] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:40:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:25.244708 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d082f-4e8a-4f29-93c6-c83af4bfaf31 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:25.274176 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 399/793] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:40:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 13:40:25.284244 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9467cc4-6df6-41c5-947f-28da625ead11 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:25.415609 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9467cc4-6df6-41c5-947f-28da625ead11 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:25.462362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9896121-95a8-4c33-86eb-3659ba554449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:25.463243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9896121-95a8-4c33-86eb-3659ba554449 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:25.463531 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9896121-95a8-4c33-86eb-3659ba554449 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:25.465455 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9896121-95a8-4c33-86eb-3659ba554449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:25.485737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d082f-4e8a-4f29-93c6-c83af4bfaf31 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:25.489212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9896121-95a8-4c33-86eb-3659ba554449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:25.490691 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9896121-95a8-4c33-86eb-3659ba554449 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:25.494419 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:25.523880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-b9896121-95a8-4c33-86eb-3659ba554449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:25.523880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:25.523880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:25.523880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:25.523880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:25.523880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:25.523880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:25.523880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:25.523880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:25.523880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:25.523880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:25.523880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:25.523880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:25.523880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:25.523880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:25.525182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:25.525182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:25.525182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:25.525182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:25.525182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:25.525182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:25.525182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:25.525182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:25.525182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:25.525182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:25.525182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:25.525182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:25.525182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:25.525182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:25.525182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:25.525182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:25.525182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:25.526141 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:25.526141 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:25.526141 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:25.526141 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:25.526141 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 400/794] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:25.529298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e22e3d-0dc4-4f6e-ad60-ce59709003e5 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:25.529298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e22e3d-0dc4-4f6e-ad60-ce59709003e5 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:25.529298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e22e3d-0dc4-4f6e-ad60-ce59709003e5 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:25.530265 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 401/795] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:25.530974 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e22e3d-0dc4-4f6e-ad60-ce59709003e5 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:25.538960 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269c6ec-c0de-4dba-87fa-87641b8ca183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:25.539756 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269c6ec-c0de-4dba-87fa-87641b8ca183 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:25.540037 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269c6ec-c0de-4dba-87fa-87641b8ca183 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:25.540312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269c6ec-c0de-4dba-87fa-87641b8ca183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:25.550982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269c6ec-c0de-4dba-87fa-87641b8ca183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:25.552516 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269c6ec-c0de-4dba-87fa-87641b8ca183 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:25.556340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:25.572570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-1269c6ec-c0de-4dba-87fa-87641b8ca183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:25.572570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:25.572570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:25.572570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:25.572570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:25.572570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:25.572570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:25.572570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:25.572570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:25.572570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:25.572570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:25.572570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:25.572570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:25.572570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:25.572570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:25.574707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:25.574707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:25.574707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:25.574707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:25.574707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:25.574707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:25.574707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:25.574707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:25.574707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:25.574707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:25.574707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:25.574707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:25.574707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:25.574707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:25.574707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:25.574707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:25.574707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:25.576812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:25.576812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:25.576812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:25.576812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:25.576812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 395/796] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:25.576812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fd027-1bd6-41c6-bbb3-b4e30085cb65 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:25.576812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fd027-1bd6-41c6-bbb3-b4e30085cb65 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:25.576812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fd027-1bd6-41c6-bbb3-b4e30085cb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:25.594649 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-d73fd027-1bd6-41c6-bbb3-b4e30085cb65 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:25.595828 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-d73fd027-1bd6-41c6-bbb3-b4e30085cb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:25.663105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e22e3d-0dc4-4f6e-ad60-ce59709003e5 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:25.676577 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 396/797] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:25.676577 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fd027-1bd6-41c6-bbb3-b4e30085cb65 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:25.701562 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3e7b1-e93c-4a4c-8c62-acfc618b11c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:25.702240 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3e7b1-e93c-4a4c-8c62-acfc618b11c1 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:25.702524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3e7b1-e93c-4a4c-8c62-acfc618b11c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:25.702949 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3e7b1-e93c-4a4c-8c62-acfc618b11c1 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:25.703694 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3e7b1-e93c-4a4c-8c62-acfc618b11c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:25.704425 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3e7b1-e93c-4a4c-8c62-acfc618b11c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:25.706113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3e7b1-e93c-4a4c-8c62-acfc618b11c1 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:25.722188 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 402/798] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:25.723068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3e7b1-e93c-4a4c-8c62-acfc618b11c1 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:25.778865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:25.795808 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fd027-1bd6-41c6-bbb3-b4e30085cb65 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:25.824631 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:25.843580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cb4b5-fa7f-4761-be44-baf482b43f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:25.844527 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cb4b5-fa7f-4761-be44-baf482b43f23 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:25.844820 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cb4b5-fa7f-4761-be44-baf482b43f23 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:25.845109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cb4b5-fa7f-4761-be44-baf482b43f23 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:25.845863 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5cb4b5-fa7f-4761-be44-baf482b43f23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:25.846176 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5cb4b5-fa7f-4761-be44-baf482b43f23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:25.846964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3e7b1-e93c-4a4c-8c62-acfc618b11c1 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:25.847648 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5cb4b5-fa7f-4761-be44-baf482b43f23 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:25.865352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 397/799] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:25.866448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cb4b5-fa7f-4761-be44-baf482b43f23 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:25.892485 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850529ef-9770-4b3a-b761-2dc8d492218a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:25.893648 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850529ef-9770-4b3a-b761-2dc8d492218a None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:25.894238 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850529ef-9770-4b3a-b761-2dc8d492218a None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:25.894660 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850529ef-9770-4b3a-b761-2dc8d492218a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:25.895469 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850529ef-9770-4b3a-b761-2dc8d492218a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:25.897075 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850529ef-9770-4b3a-b761-2dc8d492218a None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:25.911112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-850529ef-9770-4b3a-b761-2dc8d492218a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 13:40:25.911112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:25.911112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:25.911112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:25.911112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:25.911112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:25.911112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:25.911112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:25.911112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 13:40:25.911112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:25.911112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:25.911112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:25.911112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:25.911112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:25.911112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:25.911112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:25.912389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:25.912389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:25.912389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:25.912389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:25.912389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:25.912389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:25.912389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:25.912389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:25.912389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:25.912389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:25.912389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:25.912389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:25.912389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:25.912389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:25.912389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:25.912389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:25.913410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:25.913410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:25.913410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:25.913410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:25.913410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:25.913410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:25.913410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:25.913410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:25.913410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:25.913410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:25.913410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:25.913410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:25.913410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:25.913410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 13:40:25.913410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:25.920594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 403/800] 10.222.0.45 () {56 vars in 1129 bytes} [Thu May 26 13:40:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:25.921748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850529ef-9770-4b3a-b761-2dc8d492218a None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:25.995810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cb4b5-fa7f-4761-be44-baf482b43f23 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:26.035422 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850529ef-9770-4b3a-b761-2dc8d492218a None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:26.041080 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93116ba8-2887-491d-89be-8b90310731a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:26.041917 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93116ba8-2887-491d-89be-8b90310731a3 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:26.042203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93116ba8-2887-491d-89be-8b90310731a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:26.042480 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93116ba8-2887-491d-89be-8b90310731a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:26.052850 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93116ba8-2887-491d-89be-8b90310731a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:26.055972 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93116ba8-2887-491d-89be-8b90310731a3 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:26.076015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-93116ba8-2887-491d-89be-8b90310731a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:26.076015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:26.076015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:26.076015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:26.076015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:26.076015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:26.076015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:26.076015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:26.076015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:26.076015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:26.076015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:26.076015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:26.076015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:26.076015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:26.076015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:26.077209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:26.077209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:26.077209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:26.077209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:26.077209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:26.077209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:26.077209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:26.077209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:26.077209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:26.077209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:26.077209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:26.077209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:26.077209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:26.077209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:26.077209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:26.077209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:26.077209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:26.078464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:26.078464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:26.078464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:26.078464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:26.078464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:26.078464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:26.078464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:26.078464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:26.078464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 398/801] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:26.078464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93116ba8-2887-491d-89be-8b90310731a3 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:26.079187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf2cb3-ad31-4c8d-9cee-078135ebf8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:26.080180 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf2cb3-ad31-4c8d-9cee-078135ebf8af None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:26.080638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf2cb3-ad31-4c8d-9cee-078135ebf8af None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:26.081145 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf2cb3-ad31-4c8d-9cee-078135ebf8af None admin] PATH_INFO: `/v3/users/swift` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:26.087891 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:26.091696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf2cb3-ad31-4c8d-9cee-078135ebf8af None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:26.093572 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf2cb3-ad31-4c8d-9cee-078135ebf8af None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:26.110598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-a8cf2cb3-ad31-4c8d-9cee-078135ebf8af None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 13:40:26.110598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:26.110598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:26.110598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:26.110598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:26.110598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:26.110598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:26.110598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:26.110598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:26.110598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:26.110598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:26.110598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:26.110598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:26.110598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:26.110598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:26.110598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:26.111593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:26.111593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:26.111593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:26.111593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:26.111593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:26.111593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:26.111593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:26.111593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:26.111593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:26.111593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:26.111593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:26.111593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:26.111593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:26.111593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:26.111593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:26.111593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:26.111593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:26.111593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:26.112547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:26.112547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:26.112547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:26.112547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:26.112547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:26.112547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:26.112547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:26.112547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:26.112547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 13:40:26.112547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:26.115882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 404/802] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:40:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:26.116933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf2cb3-ad31-4c8d-9cee-078135ebf8af None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:26.124953 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:26.221506 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93116ba8-2887-491d-89be-8b90310731a3 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:26.243226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf2cb3-ad31-4c8d-9cee-078135ebf8af None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:26.269743 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af54d5-aaa7-4ffa-b171-97a79ba51df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:26.270777 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af54d5-aaa7-4ffa-b171-97a79ba51df2 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:26.271130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af54d5-aaa7-4ffa-b171-97a79ba51df2 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:26.271502 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af54d5-aaa7-4ffa-b171-97a79ba51df2 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:26.272544 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af54d5-aaa7-4ffa-b171-97a79ba51df2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:26.272925 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af54d5-aaa7-4ffa-b171-97a79ba51df2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:26.275119 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af54d5-aaa7-4ffa-b171-97a79ba51df2 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:26.286084 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 399/803] 10.222.0.45 () {56 vars in 1124 bytes} [Thu May 26 13:40:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:26.286084 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af54d5-aaa7-4ffa-b171-97a79ba51df2 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:26.287185 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea2584-b19b-4048-bdef-2f792e8846ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:26.288117 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea2584-b19b-4048-bdef-2f792e8846ba None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:26.288619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea2584-b19b-4048-bdef-2f792e8846ba None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:26.289111 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea2584-b19b-4048-bdef-2f792e8846ba None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:26.290615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea2584-b19b-4048-bdef-2f792e8846ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:26.291133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea2584-b19b-4048-bdef-2f792e8846ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:26.292818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea2584-b19b-4048-bdef-2f792e8846ba None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:26.310493 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 405/804] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:26.311739 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea2584-b19b-4048-bdef-2f792e8846ba None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:26.376663 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:26.387474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:26.412241 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af54d5-aaa7-4ffa-b171-97a79ba51df2 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:26.431279 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea2584-b19b-4048-bdef-2f792e8846ba None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:26.451940 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ef8dc-3e22-423a-853f-0648d3f85eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:26.452610 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ef8dc-3e22-423a-853f-0648d3f85eec None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:26.452894 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ef8dc-3e22-423a-853f-0648d3f85eec None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:26.453169 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ef8dc-3e22-423a-853f-0648d3f85eec None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:26.454034 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ef8dc-3e22-423a-853f-0648d3f85eec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:26.454346 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ef8dc-3e22-423a-853f-0648d3f85eec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:26.455772 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ef8dc-3e22-423a-853f-0648d3f85eec None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:26.467741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75997b54-c54f-470a-9c75-0672483d01ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:26.468399 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75997b54-c54f-470a-9c75-0672483d01ff None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:26.468683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75997b54-c54f-470a-9c75-0672483d01ff None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:26.468961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75997b54-c54f-470a-9c75-0672483d01ff None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:26.469700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75997b54-c54f-470a-9c75-0672483d01ff None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:26.470012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75997b54-c54f-470a-9c75-0672483d01ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:26.471335 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75997b54-c54f-470a-9c75-0672483d01ff None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:26.474371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 400/805] 10.222.0.45 () {56 vars in 1135 bytes} [Thu May 26 13:40:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:26.481178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 406/806] 10.222.0.45 () {56 vars in 1124 bytes} [Thu May 26 13:40:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:26.481178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553f4bf-00d0-4b90-ac47-5813cbfab484 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:26.481178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553f4bf-00d0-4b90-ac47-5813cbfab484 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:26.481178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553f4bf-00d0-4b90-ac47-5813cbfab484 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:26.481542 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ef8dc-3e22-423a-853f-0648d3f85eec None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:26.481617 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 407/807] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:26.481617 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553f4bf-00d0-4b90-ac47-5813cbfab484 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:26.589444 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553f4bf-00d0-4b90-ac47-5813cbfab484 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:26.592978 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ef8dc-3e22-423a-853f-0648d3f85eec None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:26.617092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:26.620905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:26.625177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d3fb4-8f65-4217-ac2e-ea5356345e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:26.625985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d3fb4-8f65-4217-ac2e-ea5356345e70 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:26.626262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d3fb4-8f65-4217-ac2e-ea5356345e70 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:26.626533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d3fb4-8f65-4217-ac2e-ea5356345e70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:26.629409 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3fb97-b30d-4d2b-8ae5-6edd3e1aa1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:26.630050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3fb97-b30d-4d2b-8ae5-6edd3e1aa1cc None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:26.630329 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3fb97-b30d-4d2b-8ae5-6edd3e1aa1cc None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:26.630601 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3fb97-b30d-4d2b-8ae5-6edd3e1aa1cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:26.631415 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3fb97-b30d-4d2b-8ae5-6edd3e1aa1cc None admin] RBAC: Adding query filter params (role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=1994043a81bb454297c208839794a479) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:26.631725 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3fb97-b30d-4d2b-8ae5-6edd3e1aa1cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:26.633141 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3fb97-b30d-4d2b-8ae5-6edd3e1aa1cc None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:26.637285 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d3fb4-8f65-4217-ac2e-ea5356345e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:26.638695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d3fb4-8f65-4217-ac2e-ea5356345e70 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:26.639188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 401/808] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:40:26 2022] GET /identity/v3/role_assignments?user.id=1994043a81bb454297c208839794a479&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:26.639932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3fb97-b30d-4d2b-8ae5-6edd3e1aa1cc None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:26.661885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-098d3fb4-8f65-4217-ac2e-ea5356345e70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:26.661885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:26.661885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:26.661885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:26.661885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:26.661885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:26.661885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:26.661885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:26.661885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:26.661885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:26.661885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:26.661885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:26.661885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:26.661885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:26.661885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:26.662875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:26.662875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:26.662875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:26.662875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:26.662875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:26.662875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:26.662875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:26.662875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:26.662875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:26.662875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:26.662875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:26.662875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:26.662875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:26.662875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:26.662875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:26.662875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:26.662875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:26.663912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:26.663912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:26.663912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:26.663912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:26.663912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 408/809] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:26.665104 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3171614-3265-4a45-a62d-0343e6d1daa9 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:26.665104 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3171614-3265-4a45-a62d-0343e6d1daa9 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:26.665104 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3171614-3265-4a45-a62d-0343e6d1daa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:26.683455 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-b3171614-3265-4a45-a62d-0343e6d1daa9 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:26.684574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-b3171614-3265-4a45-a62d-0343e6d1daa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:26.765448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 409/810] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:26.765448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0bddd-bb63-4767-8328-73af4169a237 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:26.765448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0bddd-bb63-4767-8328-73af4169a237 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:26.765448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0bddd-bb63-4767-8328-73af4169a237 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:26.765448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 410/811] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:26.765448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0bddd-bb63-4767-8328-73af4169a237 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:26.785900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3fb97-b30d-4d2b-8ae5-6edd3e1aa1cc None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:26.824632 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8c10e-b3fb-47c1-a273-bd0e51c4b9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:26.825902 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8c10e-b3fb-47c1-a273-bd0e51c4b9e5 None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:26.825902 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8c10e-b3fb-47c1-a273-bd0e51c4b9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:26.826069 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8c10e-b3fb-47c1-a273-bd0e51c4b9e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:26.826842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8c10e-b3fb-47c1-a273-bd0e51c4b9e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:26.828217 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8c10e-b3fb-47c1-a273-bd0e51c4b9e5 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:26.857013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 402/812] 10.222.0.45 () {60 vars in 1144 bytes} [Thu May 26 13:40:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:40:26.857013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf2bbb-f36c-4373-9413-d04935967891 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:26.857013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf2bbb-f36c-4373-9413-d04935967891 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:26.857013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf2bbb-f36c-4373-9413-d04935967891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:26.879638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-48bf2bbb-f36c-4373-9413-d04935967891 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:26.881803 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-48bf2bbb-f36c-4373-9413-d04935967891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:26.897580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0bddd-bb63-4767-8328-73af4169a237 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:26.906414 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:26.945879 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb794cb-9154-4997-a530-70e57f519322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:26.946637 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb794cb-9154-4997-a530-70e57f519322 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:26.946929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb794cb-9154-4997-a530-70e57f519322 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:26.947213 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb794cb-9154-4997-a530-70e57f519322 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:26.948020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb794cb-9154-4997-a530-70e57f519322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:26.948332 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb794cb-9154-4997-a530-70e57f519322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:26.950621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb794cb-9154-4997-a530-70e57f519322 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:26.953650 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:26.974681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 411/813] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:26.977636 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb794cb-9154-4997-a530-70e57f519322 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:26.993342 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 403/814] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:26.994391 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf2bbb-f36c-4373-9413-d04935967891 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:27.083598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb794cb-9154-4997-a530-70e57f519322 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:27.110645 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf2bbb-f36c-4373-9413-d04935967891 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:27.125185 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87cf65-a042-49f3-89a6-9d326c2a9291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:27.126424 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87cf65-a042-49f3-89a6-9d326c2a9291 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:27.126594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87cf65-a042-49f3-89a6-9d326c2a9291 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:27.126865 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87cf65-a042-49f3-89a6-9d326c2a9291 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:27.138346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87cf65-a042-49f3-89a6-9d326c2a9291 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:27.146093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-2a87cf65-a042-49f3-89a6-9d326c2a9291 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:27.146093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:27.146093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:27.146093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:27.146093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:27.146093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:27.146093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:27.146093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:27.146093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:27.146093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:27.146093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:27.146093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:27.146093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:27.146093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:27.146093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:27.146093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:27.147092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:27.147092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:27.147092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:27.147092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:27.147092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:27.147092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:27.147092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:27.147092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:27.147092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:27.147092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:27.147092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:27.147092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:27.147092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:27.147092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:27.147092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:27.147092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:27.147956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:27.147956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:27.147956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:27.147956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:27.147956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:27.147956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:27.147956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:27.147956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:27.147956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:27.147956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:27.147956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:27.147956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:27.147956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 412/815] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:40:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:27.148672 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87cf65-a042-49f3-89a6-9d326c2a9291 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:27.156640 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eed73c-cc8b-49e8-9f23-71f75373e196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:27.157479 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eed73c-cc8b-49e8-9f23-71f75373e196 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:27.158030 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eed73c-cc8b-49e8-9f23-71f75373e196 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:27.158030 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eed73c-cc8b-49e8-9f23-71f75373e196 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:27.166169 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eed73c-cc8b-49e8-9f23-71f75373e196 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:27.167152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eed73c-cc8b-49e8-9f23-71f75373e196 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:27.181237 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:27.181425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-94eed73c-cc8b-49e8-9f23-71f75373e196 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:27.181425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:27.181425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:27.181425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:27.181425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:27.181425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:27.181425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:27.181425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:27.181425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:27.181425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:27.181425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:27.181425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:27.181425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:27.181425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:27.181425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:27.182276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:27.182276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:27.182276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:27.182276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:27.182276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:27.182276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:27.182276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:27.182276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:27.182276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:27.182276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:27.182276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:27.182276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:27.182276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:27.182276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:27.182276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:27.182276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:27.182276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:27.183174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:27.183174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:27.183174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:27.183174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:27.183174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:27.183174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:27.183174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:27.183174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:27.183174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 404/816] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:27.183667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eed73c-cc8b-49e8-9f23-71f75373e196 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:27.233785 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:27.279355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87cf65-a042-49f3-89a6-9d326c2a9291 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:27.302668 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eed73c-cc8b-49e8-9f23-71f75373e196 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:27.317419 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5e76d-de8b-4086-9409-ed83ae08a080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:27.318508 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5e76d-de8b-4086-9409-ed83ae08a080 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:27.319031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5e76d-de8b-4086-9409-ed83ae08a080 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:27.319563 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5e76d-de8b-4086-9409-ed83ae08a080 None admin] PATH_INFO: `/v3/services/network` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:27.320506 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5e76d-de8b-4086-9409-ed83ae08a080 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:27.322068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5e76d-de8b-4086-9409-ed83ae08a080 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:27.335699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-ddd5e76d-de8b-4086-9409-ed83ae08a080 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 13:40:27.335699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:27.335699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:27.335699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:27.335699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:27.335699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:27.335699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:27.335699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:27.335699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 13:40:27.335699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:27.335699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:27.335699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:27.335699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:27.335699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:27.335699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:27.335699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:27.335699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:27.336705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:27.336705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:27.336705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:27.336705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:27.336705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:27.336705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:27.336705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:27.336705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:27.336705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:27.336705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:27.336705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:27.336705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:27.336705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:27.336705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:27.336705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:27.336705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:27.337594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:27.337594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:27.337594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:27.337594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:27.337594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:27.337594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:27.337594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:27.337594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:27.337594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:27.337594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:27.337594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:27.337594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:27.337594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 13:40:27.337594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:27.338371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699b64e-98e2-46a6-9c8f-2dbbc113d8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:27.338371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699b64e-98e2-46a6-9c8f-2dbbc113d8f2 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:27.339113 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699b64e-98e2-46a6-9c8f-2dbbc113d8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:27.339113 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699b64e-98e2-46a6-9c8f-2dbbc113d8f2 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:27.339606 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699b64e-98e2-46a6-9c8f-2dbbc113d8f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:27.339905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699b64e-98e2-46a6-9c8f-2dbbc113d8f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:27.341350 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699b64e-98e2-46a6-9c8f-2dbbc113d8f2 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:27.341559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 413/817] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:27 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:27.342529 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5e76d-de8b-4086-9409-ed83ae08a080 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:27.360038 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 405/818] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:40:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:27.361027 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699b64e-98e2-46a6-9c8f-2dbbc113d8f2 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:27.443930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:27.454317 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5e76d-de8b-4086-9409-ed83ae08a080 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:27.464963 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699b64e-98e2-46a6-9c8f-2dbbc113d8f2 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:27.488747 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:27.493326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f265650-9d14-47c8-9ff3-f13faf0bb2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:27.494294 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f265650-9d14-47c8-9ff3-f13faf0bb2a4 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:27.494568 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f265650-9d14-47c8-9ff3-f13faf0bb2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:27.494840 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f265650-9d14-47c8-9ff3-f13faf0bb2a4 None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:27.495921 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f265650-9d14-47c8-9ff3-f13faf0bb2a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:27.496232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f265650-9d14-47c8-9ff3-f13faf0bb2a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:27.498882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f265650-9d14-47c8-9ff3-f13faf0bb2a4 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:27.506111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c77693-dd59-4690-908b-b6fbbb968aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:27.506789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c77693-dd59-4690-908b-b6fbbb968aaa None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:27.507069 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c77693-dd59-4690-908b-b6fbbb968aaa None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:27.507343 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c77693-dd59-4690-908b-b6fbbb968aaa None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:27.508050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c77693-dd59-4690-908b-b6fbbb968aaa None admin] RBAC: Adding query filter params (name=network) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:27.508355 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c77693-dd59-4690-908b-b6fbbb968aaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:27.510917 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c77693-dd59-4690-908b-b6fbbb968aaa None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:27.520656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 406/819] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 13:40:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:27.521559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c77693-dd59-4690-908b-b6fbbb968aaa None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:27.523616 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 414/820] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:27.524526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f265650-9d14-47c8-9ff3-f13faf0bb2a4 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:27.665374 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c77693-dd59-4690-908b-b6fbbb968aaa None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:27.685298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f265650-9d14-47c8-9ff3-f13faf0bb2a4 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:27.710079 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9d1d1-dfa4-4fb8-b1a6-20ba4d4b0a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:27.710874 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d1d1-dfa4-4fb8-b1a6-20ba4d4b0a25 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:27.711150 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d1d1-dfa4-4fb8-b1a6-20ba4d4b0a25 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:27.717290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d1d1-dfa4-4fb8-b1a6-20ba4d4b0a25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:27.722784 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9d1d1-dfa4-4fb8-b1a6-20ba4d4b0a25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:27.724224 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9d1d1-dfa4-4fb8-b1a6-20ba4d4b0a25 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:27.742044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-3bc9d1d1-dfa4-4fb8-b1a6-20ba4d4b0a25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:27.742044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:27.742044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:27.742044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:27.742044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:27.742044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:27.742044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:27.742044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:27.742044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:27.742044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:27.742044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:27.742044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:27.742044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:27.742044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:27.742044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:27.742962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:27.742962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:27.742962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:27.742962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:27.742962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:27.742962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:27.742962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:27.742962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:27.742962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:27.742962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:27.742962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:27.742962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:27.742962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:27.742962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:27.742962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:27.742962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:27.742962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:27.743886 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:27.743886 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:27.743886 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:27.743886 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:27.748287 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 407/821] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:27.749303 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9d1d1-dfa4-4fb8-b1a6-20ba4d4b0a25 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:27.750342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d9b64-1b41-4a80-9d91-9bcb7f36ff6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:27.751018 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d9b64-1b41-4a80-9d91-9bcb7f36ff6c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:27.751300 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d9b64-1b41-4a80-9d91-9bcb7f36ff6c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:27.751576 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d9b64-1b41-4a80-9d91-9bcb7f36ff6c None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:27.752406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d9b64-1b41-4a80-9d91-9bcb7f36ff6c None admin] RBAC: Adding query filter params (type=network) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:27.752762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d9b64-1b41-4a80-9d91-9bcb7f36ff6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:27.755172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d9b64-1b41-4a80-9d91-9bcb7f36ff6c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:27.767741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 415/822] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 13:40:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:27.768618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d9b64-1b41-4a80-9d91-9bcb7f36ff6c None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:27.773182 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:27.801861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:27.860593 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9d1d1-dfa4-4fb8-b1a6-20ba4d4b0a25 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:27.896715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8c009-957b-494f-b1c9-f6ba0b1ef952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:27.901292 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8c009-957b-494f-b1c9-f6ba0b1ef952 None admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:27.901292 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8c009-957b-494f-b1c9-f6ba0b1ef952 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:27.901292 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8c009-957b-494f-b1c9-f6ba0b1ef952 None admin] PATH_INFO: `/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/e517dc43cc6d401e820c65ad4c941386/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:27.901292 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8c009-957b-494f-b1c9-f6ba0b1ef952 None admin] RBAC: Authorizing `identity:create_grant(project_id=095d02b8a79c4915ac8d3c5b81e195a4, user_id=e517dc43cc6d401e820c65ad4c941386, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:27.901981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8c009-957b-494f-b1c9-f6ba0b1ef952 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:27.928134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 408/823] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:40:27 2022] PUT /identity/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/e517dc43cc6d401e820c65ad4c941386/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:40:27.928134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8c009-957b-494f-b1c9-f6ba0b1ef952 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:28.015735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:28.061310 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8c009-957b-494f-b1c9-f6ba0b1ef952 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:28.064879 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d9b64-1b41-4a80-9d91-9bcb7f36ff6c None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:28.185381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c62131-f859-4847-ac6c-3e40c75ea4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:28.185381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c62131-f859-4847-ac6c-3e40c75ea4fd None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:28.185381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c62131-f859-4847-ac6c-3e40c75ea4fd None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:28.185381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c62131-f859-4847-ac6c-3e40c75ea4fd None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:28.186232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c62131-f859-4847-ac6c-3e40c75ea4fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:28.186232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c62131-f859-4847-ac6c-3e40c75ea4fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:28.186232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c62131-f859-4847-ac6c-3e40c75ea4fd None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:28.189289 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37da228-4a4c-4a4a-a036-f2ed9b2e284c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:28.189289 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37da228-4a4c-4a4a-a036-f2ed9b2e284c None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:28.189289 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37da228-4a4c-4a4a-a036-f2ed9b2e284c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:28.189289 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37da228-4a4c-4a4a-a036-f2ed9b2e284c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:28.190259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37da228-4a4c-4a4a-a036-f2ed9b2e284c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:28.190259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37da228-4a4c-4a4a-a036-f2ed9b2e284c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:28.204734 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 416/824] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:28.205708 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c62131-f859-4847-ac6c-3e40c75ea4fd None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:28.241906 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 409/825] 10.222.0.45 () {60 vars in 1144 bytes} [Thu May 26 13:40:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:40:28.316512 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:28.347810 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c62131-f859-4847-ac6c-3e40c75ea4fd None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:28.391851 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4a8fa-b1f7-4114-a6a4-2ca1a77bf0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:28.392938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4a8fa-b1f7-4114-a6a4-2ca1a77bf0ce None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:28.393395 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4a8fa-b1f7-4114-a6a4-2ca1a77bf0ce None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:28.393809 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4a8fa-b1f7-4114-a6a4-2ca1a77bf0ce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:28.402980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4a8fa-b1f7-4114-a6a4-2ca1a77bf0ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:28.404718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4a8fa-b1f7-4114-a6a4-2ca1a77bf0ce None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:28.420727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-99a4a8fa-b1f7-4114-a6a4-2ca1a77bf0ce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 13:40:28.420727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:28.420727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:28.420727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:28.420727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:28.420727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:28.420727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:28.420727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:28.420727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:28.420727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:28.420727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:28.420727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:28.420727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:28.420727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:28.420727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:28.420727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:28.421818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:28.421818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:28.421818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:28.421818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:28.421818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:28.421818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:28.421818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:28.421818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:28.421818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:28.421818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:28.421818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:28.421818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:28.421818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:28.421818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:28.421818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:28.421818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:28.421818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:28.421818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:28.423012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:28.423012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:28.423012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:28.423012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:28.423012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:28.423012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:28.423012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:28.423012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:28.423012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 13:40:28.423012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:28.423012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 417/826] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 13:40:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:28.430368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37da228-4a4c-4a4a-a036-f2ed9b2e284c None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:28.573174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37da228-4a4c-4a4a-a036-f2ed9b2e284c None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:28.603274 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:28.609679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1fac6-36f4-46e8-8d4b-eca01fcc350d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:28.610793 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1fac6-36f4-46e8-8d4b-eca01fcc350d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:28.611443 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1fac6-36f4-46e8-8d4b-eca01fcc350d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:28.612267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1fac6-36f4-46e8-8d4b-eca01fcc350d None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:28.613250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1fac6-36f4-46e8-8d4b-eca01fcc350d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:28.615091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1fac6-36f4-46e8-8d4b-eca01fcc350d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:28.616523 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1fac6-36f4-46e8-8d4b-eca01fcc350d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:28.635211 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 410/827] 10.222.0.45 () {56 vars in 1149 bytes} [Thu May 26 13:40:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:28.641052 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4a8fa-b1f7-4114-a6a4-2ca1a77bf0ce None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:28.758780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4a8fa-b1f7-4114-a6a4-2ca1a77bf0ce None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:28.790532 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:28.796942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eeada4-bed7-498e-af98-89198f5a22be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:28.797761 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eeada4-bed7-498e-af98-89198f5a22be None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:28.798036 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eeada4-bed7-498e-af98-89198f5a22be None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:28.798306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eeada4-bed7-498e-af98-89198f5a22be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:28.812067 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eeada4-bed7-498e-af98-89198f5a22be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:28.813527 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eeada4-bed7-498e-af98-89198f5a22be None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:28.831232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-15eeada4-bed7-498e-af98-89198f5a22be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:28.831232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:28.831232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:28.831232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:28.831232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:28.831232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:28.831232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:28.831232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:28.831232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:28.831232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:28.831232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:28.831232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:28.831232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:28.831232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:28.831232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:28.832178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:28.832178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:28.832178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:28.832178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:28.832178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:28.832178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:28.832178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:28.832178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:28.832178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:28.832178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:28.832178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:28.832178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:28.832178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:28.832178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:28.832178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:28.832178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:28.832178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:28.833072 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:28.833072 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:28.833072 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:28.833072 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:28.833072 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 418/828] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:28.839301 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1fac6-36f4-46e8-8d4b-eca01fcc350d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:28.946037 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1fac6-36f4-46e8-8d4b-eca01fcc350d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:28.981337 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa8647-2ed3-4235-a7ba-da6df133acb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:28.982001 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa8647-2ed3-4235-a7ba-da6df133acb6 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:28.982282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa8647-2ed3-4235-a7ba-da6df133acb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:28.982555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa8647-2ed3-4235-a7ba-da6df133acb6 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:28.983269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa8647-2ed3-4235-a7ba-da6df133acb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:28.983571 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa8647-2ed3-4235-a7ba-da6df133acb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:28.984946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa8647-2ed3-4235-a7ba-da6df133acb6 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:28.997390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 411/829] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:29.006342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eeada4-bed7-498e-af98-89198f5a22be None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:29.109134 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eeada4-bed7-498e-af98-89198f5a22be None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:29.131627 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c123cf4-ed0e-4ec8-953f-bb2c7f458d50 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:29.131961 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c123cf4-ed0e-4ec8-953f-bb2c7f458d50 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:29.132197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c123cf4-ed0e-4ec8-953f-bb2c7f458d50 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:29.133822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 412/830] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:29.139197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8870f91-39ba-4d50-b7ed-07835cb2946e None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:29.139488 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8870f91-39ba-4d50-b7ed-07835cb2946e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:29.139758 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8870f91-39ba-4d50-b7ed-07835cb2946e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:29.146012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c493c-bf3f-45b0-8255-27b959605c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:29.147143 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c493c-bf3f-45b0-8255-27b959605c7e None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:29.147623 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c493c-bf3f-45b0-8255-27b959605c7e None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:29.148093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c493c-bf3f-45b0-8255-27b959605c7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:29.155363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c493c-bf3f-45b0-8255-27b959605c7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:29.156998 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c493c-bf3f-45b0-8255-27b959605c7e None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:29.157733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a8870f91-39ba-4d50-b7ed-07835cb2946e None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:29.159119 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a8870f91-39ba-4d50-b7ed-07835cb2946e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:29.172439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-9b9c493c-bf3f-45b0-8255-27b959605c7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:29.172439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:29.172439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:29.172439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:29.172439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:29.172439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:29.172439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:29.172439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:29.172439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:29.172439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:29.172439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:29.172439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:29.172439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:29.172439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:29.172439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:29.173365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:29.173365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:29.173365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:29.173365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:29.173365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:29.173365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:29.173365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:29.173365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:29.173365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:29.173365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:29.173365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:29.173365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:29.173365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:29.173365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:29.173365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:29.173365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:29.173365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:29.174265 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:29.174265 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:29.174265 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:29.174265 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:29.174265 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:29.174265 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:29.174265 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:29.174265 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:29.181356 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 419/831] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:29.183023 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c493c-bf3f-45b0-8255-27b959605c7e None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:29.208077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:29.240986 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:29.241567 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 413/832] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 13:40:29.260881 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8870f91-39ba-4d50-b7ed-07835cb2946e None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:29.317334 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c493c-bf3f-45b0-8255-27b959605c7e None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:29.365237 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdce624-c315-4cbc-ac2b-37e77e934107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:29.366608 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdce624-c315-4cbc-ac2b-37e77e934107 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:29.367619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdce624-c315-4cbc-ac2b-37e77e934107 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:29.368280 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdce624-c315-4cbc-ac2b-37e77e934107 None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:29.369423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdce624-c315-4cbc-ac2b-37e77e934107 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:29.370190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdce624-c315-4cbc-ac2b-37e77e934107 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:29.372603 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdce624-c315-4cbc-ac2b-37e77e934107 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:29.376912 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8870f91-39ba-4d50-b7ed-07835cb2946e None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:29.390245 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 420/833] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:29.396220 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdce624-c315-4cbc-ac2b-37e77e934107 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:29.418404 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39f222-11d0-4f6f-9a00-906fcf457db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:29.419222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39f222-11d0-4f6f-9a00-906fcf457db9 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:29.419506 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39f222-11d0-4f6f-9a00-906fcf457db9 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:29.419781 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39f222-11d0-4f6f-9a00-906fcf457db9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:29.420433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39f222-11d0-4f6f-9a00-906fcf457db9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:29.422041 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39f222-11d0-4f6f-9a00-906fcf457db9 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:29.435109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-ef39f222-11d0-4f6f-9a00-906fcf457db9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 13:40:29.435109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:29.435109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:29.435109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:29.435109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:29.435109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:29.435109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:29.435109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:29.435109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 13:40:29.435109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:29.435109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:29.435109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:29.435109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:29.435109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:29.435109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:29.435109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:29.436091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:29.436091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:29.436091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:29.436091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:29.436091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:29.436091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:29.436091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:29.436091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:29.436091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:29.436091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:29.436091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:29.436091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:29.436091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:29.436091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:29.436091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:29.436091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:29.436927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:29.436927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:29.436927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:29.436927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:29.436927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:29.436927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:29.436927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:29.436927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:29.436927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:29.436927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:29.436927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:29.436927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:29.436927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:29.436927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 13:40:29.436927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:29.436927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 414/834] 10.222.0.45 () {56 vars in 1132 bytes} [Thu May 26 13:40:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:29.437829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fce16-21f6-4268-a8bf-47627a1c0576 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:29.437897 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fce16-21f6-4268-a8bf-47627a1c0576 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:29.438194 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fce16-21f6-4268-a8bf-47627a1c0576 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:29.439670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 415/835] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:29.444909 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fce16-21f6-4268-a8bf-47627a1c0576 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:29.495244 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:29.505881 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdce624-c315-4cbc-ac2b-37e77e934107 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:29.507626 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:29.541114 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fd20e-965c-4669-a930-8e21a5088957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:29.542086 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fd20e-965c-4669-a930-8e21a5088957 None admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:29.542364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fd20e-965c-4669-a930-8e21a5088957 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:29.542643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fd20e-965c-4669-a930-8e21a5088957 None admin] PATH_INFO: `/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/135410329e56486c8ccb65b1f2d87aca/roles/0bb0d62bb4f84638888ceb6ecabda8b3` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:29.557914 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fd20e-965c-4669-a930-8e21a5088957 None admin] RBAC: Authorizing `identity:create_grant(project_id=095d02b8a79c4915ac8d3c5b81e195a4, user_id=135410329e56486c8ccb65b1f2d87aca, role_id=0bb0d62bb4f84638888ceb6ecabda8b3)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:29.558253 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fce16-21f6-4268-a8bf-47627a1c0576 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:29.559332 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fd20e-965c-4669-a930-8e21a5088957 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:29.573128 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 421/836] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:40:29 2022] PUT /identity/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/135410329e56486c8ccb65b1f2d87aca/roles/0bb0d62bb4f84638888ceb6ecabda8b3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:40:29.574423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946b68-8267-4743-b3a7-abe7104a6423 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:29.574709 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946b68-8267-4743-b3a7-abe7104a6423 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:29.574983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946b68-8267-4743-b3a7-abe7104a6423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:29.592193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-0c946b68-8267-4743-b3a7-abe7104a6423 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:29.593452 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0c946b68-8267-4743-b3a7-abe7104a6423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:29.616521 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafc660-b9a2-49db-a4e1-be4d2c89fcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:29.618148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafc660-b9a2-49db-a4e1-be4d2c89fcad None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:29.619012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafc660-b9a2-49db-a4e1-be4d2c89fcad None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:29.619539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafc660-b9a2-49db-a4e1-be4d2c89fcad None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:29.620690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafc660-b9a2-49db-a4e1-be4d2c89fcad None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:29.621646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafc660-b9a2-49db-a4e1-be4d2c89fcad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:29.623765 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafc660-b9a2-49db-a4e1-be4d2c89fcad None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:29.636673 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 416/837] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 13:40:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:29.639392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafc660-b9a2-49db-a4e1-be4d2c89fcad None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:29.684175 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 422/838] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:29.701073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c946b68-8267-4743-b3a7-abe7104a6423 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:29.783254 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafc660-b9a2-49db-a4e1-be4d2c89fcad None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:29.793956 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:29.801068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:29.823234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560463b-4535-48f5-a5b4-cf543125c12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:29.823944 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560463b-4535-48f5-a5b4-cf543125c12b None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:29.824306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560463b-4535-48f5-a5b4-cf543125c12b None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:29.824583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560463b-4535-48f5-a5b4-cf543125c12b None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:29.825302 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560463b-4535-48f5-a5b4-cf543125c12b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:29.825611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560463b-4535-48f5-a5b4-cf543125c12b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:29.826927 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c946b68-8267-4743-b3a7-abe7104a6423 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:29.827041 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560463b-4535-48f5-a5b4-cf543125c12b None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:29.835342 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 417/839] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 13:40:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:29.866322 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c739a8-7dc4-4472-8587-0f60ca00d9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:29.867757 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c739a8-7dc4-4472-8587-0f60ca00d9c9 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:29.868250 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c739a8-7dc4-4472-8587-0f60ca00d9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:29.868771 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c739a8-7dc4-4472-8587-0f60ca00d9c9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:29.869686 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c739a8-7dc4-4472-8587-0f60ca00d9c9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:29.871451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c739a8-7dc4-4472-8587-0f60ca00d9c9 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:29.885509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-b8c739a8-7dc4-4472-8587-0f60ca00d9c9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 13:40:29.885509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:29.885509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:29.885509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:29.885509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:29.885509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:29.885509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:29.885509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:29.885509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 13:40:29.885509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:29.885509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:29.885509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:29.885509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:29.885509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:29.885509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:29.885509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:29.885509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:29.886574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:29.886574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:29.886574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:29.886574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:29.886574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:29.886574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:29.886574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:29.886574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:29.886574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:29.886574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:29.886574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:29.886574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:29.886574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:29.886574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:29.886574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:29.886574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:29.887423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:29.887423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:29.887423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:29.887423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:29.887423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:29.887423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:29.887423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:29.887423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:29.887423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:29.887423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:29.887423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:29.887423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:29.887423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 13:40:29.887423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:29.890449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 423/840] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:40:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:29.897334 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560463b-4535-48f5-a5b4-cf543125c12b None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:30.008217 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560463b-4535-48f5-a5b4-cf543125c12b None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:30.051695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75307065-541c-45d1-98be-0158da31422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:30.052369 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75307065-541c-45d1-98be-0158da31422e None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:30.052648 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75307065-541c-45d1-98be-0158da31422e None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:30.052921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75307065-541c-45d1-98be-0158da31422e None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:30.053651 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75307065-541c-45d1-98be-0158da31422e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:30.053955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75307065-541c-45d1-98be-0158da31422e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:30.055320 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75307065-541c-45d1-98be-0158da31422e None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:30.060446 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 418/841] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:40:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:30.065969 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c739a8-7dc4-4472-8587-0f60ca00d9c9 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:30.173622 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c739a8-7dc4-4472-8587-0f60ca00d9c9 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:30.207883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1cce4-f01c-4ddb-a7a0-62b412fcd470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:30.208549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1cce4-f01c-4ddb-a7a0-62b412fcd470 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:30.208828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1cce4-f01c-4ddb-a7a0-62b412fcd470 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:30.209102 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1cce4-f01c-4ddb-a7a0-62b412fcd470 None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:30.209824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1cce4-f01c-4ddb-a7a0-62b412fcd470 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:30.210128 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1cce4-f01c-4ddb-a7a0-62b412fcd470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:30.211470 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1cce4-f01c-4ddb-a7a0-62b412fcd470 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:30.216617 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 424/842] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:40:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:30.495538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead1b57-de82-436f-a974-f6c64f7028e7 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:30.496040 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead1b57-de82-436f-a974-f6c64f7028e7 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:30.496040 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead1b57-de82-436f-a974-f6c64f7028e7 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:30.497633 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 419/843] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:30.503075 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b184d-8d8e-46a7-a786-eb65fee6b051 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:30.503932 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b184d-8d8e-46a7-a786-eb65fee6b051 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:30.504217 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b184d-8d8e-46a7-a786-eb65fee6b051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:30.520994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-e31b184d-8d8e-46a7-a786-eb65fee6b051 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:30.522213 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e31b184d-8d8e-46a7-a786-eb65fee6b051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:30.524981 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:30.594566 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 425/844] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:30.617622 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead1b57-de82-436f-a974-f6c64f7028e7 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:30.654539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:30.729794 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead1b57-de82-436f-a974-f6c64f7028e7 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:30.764541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619d637-fe7c-4cc2-994b-e7f36841475b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:30.765603 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619d637-fe7c-4cc2-994b-e7f36841475b None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:30.766030 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619d637-fe7c-4cc2-994b-e7f36841475b None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:30.766448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619d637-fe7c-4cc2-994b-e7f36841475b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:30.776851 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619d637-fe7c-4cc2-994b-e7f36841475b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:30.785181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-4619d637-fe7c-4cc2-994b-e7f36841475b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:40:30.785181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:30.785181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:30.785181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:30.785181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:30.785181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:30.785181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:30.785181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:30.785181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:30.785181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:30.785181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:30.785181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:30.785181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:30.785181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:30.785181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:30.785181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:30.786367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:30.786367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:30.786367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:30.786367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:30.786367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:30.786367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:30.786367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:30.786367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:30.786367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:30.786367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:30.786367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:30.786367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:30.786367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:30.786367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:30.786367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:30.786367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:30.787448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:30.787448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:30.787448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:30.787448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:30.787448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:30.787448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:30.787448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:30.787448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:30.787448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:30.787448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:30.787448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:40:30.787448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:30.794692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 420/845] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:40:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:30.798485 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b184d-8d8e-46a7-a786-eb65fee6b051 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:30.898176 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b184d-8d8e-46a7-a786-eb65fee6b051 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:30.933587 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501ce1a-e220-4c37-99ae-bc8602b7eb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:30.934262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501ce1a-e220-4c37-99ae-bc8602b7eb79 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:30.934547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501ce1a-e220-4c37-99ae-bc8602b7eb79 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:30.934827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501ce1a-e220-4c37-99ae-bc8602b7eb79 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:30.935576 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501ce1a-e220-4c37-99ae-bc8602b7eb79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:30.935886 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501ce1a-e220-4c37-99ae-bc8602b7eb79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:30.937237 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501ce1a-e220-4c37-99ae-bc8602b7eb79 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:30.946087 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 426/846] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:40:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:30.951728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619d637-fe7c-4cc2-994b-e7f36841475b None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:31.054217 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:31.060322 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619d637-fe7c-4cc2-994b-e7f36841475b None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:31.100062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742cc44e-cfec-4afa-a192-783a3b992dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:31.100857 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cc44e-cfec-4afa-a192-783a3b992dad None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:31.101185 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cc44e-cfec-4afa-a192-783a3b992dad None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:31.101502 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cc44e-cfec-4afa-a192-783a3b992dad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:31.112082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742cc44e-cfec-4afa-a192-783a3b992dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:31.113722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742cc44e-cfec-4afa-a192-783a3b992dad None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:31.131509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-742cc44e-cfec-4afa-a192-783a3b992dad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:31.131509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:31.131509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:31.131509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:31.131509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:31.131509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:31.131509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:31.131509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:31.131509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:31.131509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:31.131509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:31.131509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:31.131509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:31.131509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:31.131509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:31.132394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:31.132394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:31.132394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:31.132394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:31.132394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:31.132394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:31.132394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:31.132394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:31.132394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:31.132394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:31.132394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:31.132394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:31.132394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:31.132394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:31.132394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:31.132394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:31.132394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:31.133547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:31.133547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:31.133547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:31.133547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:31.133547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 421/847] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:31.142348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501ce1a-e220-4c37-99ae-bc8602b7eb79 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:31.145738 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:31.244836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501ce1a-e220-4c37-99ae-bc8602b7eb79 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:31.278578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a28ad-1129-495d-b1d8-236d585f6e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:31.279241 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a28ad-1129-495d-b1d8-236d585f6e2e None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:31.279520 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a28ad-1129-495d-b1d8-236d585f6e2e None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:31.279795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a28ad-1129-495d-b1d8-236d585f6e2e None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:31.280501 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a28ad-1129-495d-b1d8-236d585f6e2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:31.280804 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a28ad-1129-495d-b1d8-236d585f6e2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:31.282167 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a28ad-1129-495d-b1d8-236d585f6e2e None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:31.294801 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 427/848] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:31.300001 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742cc44e-cfec-4afa-a192-783a3b992dad None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:31.410389 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742cc44e-cfec-4afa-a192-783a3b992dad None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:31.448077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5d5ad-0411-4adf-9a26-3dde5d20694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:31.448875 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5d5ad-0411-4adf-9a26-3dde5d20694a None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:31.449204 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5d5ad-0411-4adf-9a26-3dde5d20694a None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:31.449506 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5d5ad-0411-4adf-9a26-3dde5d20694a None admin] PATH_INFO: `/v3/users/swift` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:31.457907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5d5ad-0411-4adf-9a26-3dde5d20694a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:31.459344 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5d5ad-0411-4adf-9a26-3dde5d20694a None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:31.474082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-e0c5d5ad-0411-4adf-9a26-3dde5d20694a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 13:40:31.474082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:31.474082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:31.474082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:31.474082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:31.474082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:31.474082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:31.474082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:31.474082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:31.474082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:31.474082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:31.474082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:31.474082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:31.474082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:31.474082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:31.474082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:31.475085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:31.475085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:31.475085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:31.475085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:31.475085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:31.475085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:31.475085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:31.475085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:31.475085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:31.475085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:31.475085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:31.475085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:31.475085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:31.475085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:31.475085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:31.475085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:31.475085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:31.475085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:31.476076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:31.476076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:31.476076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:31.476076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:31.476076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:31.476076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:31.476076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:31.476076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:31.476076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 13:40:31.476076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:31.476076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 422/849] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:40:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:31.481144 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a28ad-1129-495d-b1d8-236d585f6e2e None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:31.547248 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:31.587087 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a28ad-1129-495d-b1d8-236d585f6e2e None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:31.625356 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d266e-2d4c-4a99-92e8-387579ba62c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:31.626028 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d266e-2d4c-4a99-92e8-387579ba62c5 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:31.626307 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d266e-2d4c-4a99-92e8-387579ba62c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:31.626579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d266e-2d4c-4a99-92e8-387579ba62c5 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:31.627412 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d266e-2d4c-4a99-92e8-387579ba62c5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:31.627720 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d266e-2d4c-4a99-92e8-387579ba62c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:31.629693 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d266e-2d4c-4a99-92e8-387579ba62c5 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:31.648020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 428/850] 10.222.0.45 () {56 vars in 1135 bytes} [Thu May 26 13:40:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:31.653618 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5d5ad-0411-4adf-9a26-3dde5d20694a None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:31.670745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:31.760105 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5d5ad-0411-4adf-9a26-3dde5d20694a None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:31.800651 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c7811-cffa-446d-8718-0c617a7da050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:31.801729 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c7811-cffa-446d-8718-0c617a7da050 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:31.802212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c7811-cffa-446d-8718-0c617a7da050 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:31.802681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c7811-cffa-446d-8718-0c617a7da050 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:31.873488 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c7811-cffa-446d-8718-0c617a7da050 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:31.875295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c7811-cffa-446d-8718-0c617a7da050 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:31.886431 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:31.963747 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100540ea-d04c-477a-a036-752697425fa3 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:31.964245 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100540ea-d04c-477a-a036-752697425fa3 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:31.964245 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100540ea-d04c-477a-a036-752697425fa3 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:31.965847 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 429/851] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:40:31.974551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d44469-6684-4849-9b74-78929024620e None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:31.974837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d44469-6684-4849-9b74-78929024620e None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:31.975117 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d44469-6684-4849-9b74-78929024620e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:31.978724 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 423/852] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:40:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 13:40:31.984109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c7811-cffa-446d-8718-0c617a7da050 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:31.997756 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-79d44469-6684-4849-9b74-78929024620e None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:32.000123 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-79d44469-6684-4849-9b74-78929024620e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:32.097290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 430/853] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:32.104581 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c7811-cffa-446d-8718-0c617a7da050 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:32.114846 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:32.117161 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d44469-6684-4849-9b74-78929024620e None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:32.150711 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c5b4f-4f28-4f67-86e0-cf2f35767e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:32.151741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c5b4f-4f28-4f67-86e0-cf2f35767e49 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:32.152022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c5b4f-4f28-4f67-86e0-cf2f35767e49 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:32.152297 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c5b4f-4f28-4f67-86e0-cf2f35767e49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:32.165451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c5b4f-4f28-4f67-86e0-cf2f35767e49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:32.167374 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c5b4f-4f28-4f67-86e0-cf2f35767e49 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:32.176272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:32.194723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-d75c5b4f-4f28-4f67-86e0-cf2f35767e49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:32.194723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:32.194723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:32.194723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:32.194723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:32.194723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:32.194723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:32.194723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:32.194723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:32.194723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:32.194723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:32.194723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:32.194723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:32.194723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:32.194723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:32.195681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:32.195681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:32.195681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:32.195681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:32.195681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:32.195681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:32.195681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:32.195681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:32.195681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:32.195681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:32.195681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:32.195681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:32.195681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:32.195681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:32.195681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:32.195681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:32.195681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:32.197222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:32.197222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:32.197222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:32.197222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:32.201109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 424/854] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:32.201984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c5b4f-4f28-4f67-86e0-cf2f35767e49 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:32.235610 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d44469-6684-4849-9b74-78929024620e None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:32.272075 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c36d71-adb0-4581-a135-c108ad0be406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:32.273091 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c36d71-adb0-4581-a135-c108ad0be406 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:32.273581 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c36d71-adb0-4581-a135-c108ad0be406 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:32.273856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c36d71-adb0-4581-a135-c108ad0be406 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:32.285795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c36d71-adb0-4581-a135-c108ad0be406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:32.293437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-14c36d71-adb0-4581-a135-c108ad0be406 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:32.293437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:32.293437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:32.293437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:32.293437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:32.293437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:32.293437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:32.293437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:32.293437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:32.293437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:32.293437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:32.293437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:32.293437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:32.293437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:32.293437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:32.293437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:32.294398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:32.294398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:32.294398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:32.294398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:32.294398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:32.294398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:32.294398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:32.294398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:32.294398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:32.294398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:32.294398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:32.294398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:32.294398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:32.294398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:32.294398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:32.294398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:32.296157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:32.296157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:32.296157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:32.296157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:32.296157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:32.296157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:32.296157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:32.296157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:32.296157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:32.296157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:32.296157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:40:32.296157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:32.296157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 431/855] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:40:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:32.296157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a4e4-f3db-4e44-9850-bbbd5170a684 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:32.296941 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a4e4-f3db-4e44-9850-bbbd5170a684 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:32.296941 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a4e4-f3db-4e44-9850-bbbd5170a684 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:32.301385 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 432/856] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:32.302752 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37a4e4-f3db-4e44-9850-bbbd5170a684 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:32.311717 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c5b4f-4f28-4f67-86e0-cf2f35767e49 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:32.351643 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaac02a-44fe-4a01-b13e-f9a217d458a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:32.352320 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaac02a-44fe-4a01-b13e-f9a217d458a2 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:32.352600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaac02a-44fe-4a01-b13e-f9a217d458a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:32.352928 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaac02a-44fe-4a01-b13e-f9a217d458a2 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:32.353637 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaac02a-44fe-4a01-b13e-f9a217d458a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:32.353952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaac02a-44fe-4a01-b13e-f9a217d458a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:32.355471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaac02a-44fe-4a01-b13e-f9a217d458a2 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:32.372883 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 425/857] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:32.372883 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635168a-c666-490e-86ae-277e706d1f93 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:32.372883 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635168a-c666-490e-86ae-277e706d1f93 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:32.372883 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635168a-c666-490e-86ae-277e706d1f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:32.390372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-1635168a-c666-490e-86ae-277e706d1f93 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:32.391554 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1635168a-c666-490e-86ae-277e706d1f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:32.408632 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:32.419088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37a4e4-f3db-4e44-9850-bbbd5170a684 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:32.430417 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:32.455039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a805743-2c3d-49d2-b0b8-daef77759e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:32.455701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a805743-2c3d-49d2-b0b8-daef77759e21 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:32.455979 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a805743-2c3d-49d2-b0b8-daef77759e21 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:32.456805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a805743-2c3d-49d2-b0b8-daef77759e21 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:32.457571 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a805743-2c3d-49d2-b0b8-daef77759e21 None admin] RBAC: Adding query filter params (name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:32.457875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a805743-2c3d-49d2-b0b8-daef77759e21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:32.459215 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a805743-2c3d-49d2-b0b8-daef77759e21 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:32.465953 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 426/858] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:32.466822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635168a-c666-490e-86ae-277e706d1f93 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:32.485175 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 433/859] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:40:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:32.487008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a805743-2c3d-49d2-b0b8-daef77759e21 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:32.571634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635168a-c666-490e-86ae-277e706d1f93 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:32.592429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a805743-2c3d-49d2-b0b8-daef77759e21 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:32.604891 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b97a3-e2c5-4bf1-8f40-94bd48f92c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:32.605705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b97a3-e2c5-4bf1-8f40-94bd48f92c1b None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:32.605990 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b97a3-e2c5-4bf1-8f40-94bd48f92c1b None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:32.606263 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b97a3-e2c5-4bf1-8f40-94bd48f92c1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:32.613497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b97a3-e2c5-4bf1-8f40-94bd48f92c1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:32.614985 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b97a3-e2c5-4bf1-8f40-94bd48f92c1b None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:32.625825 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442398cc-9a4b-4e92-bbb0-b07d62787b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:32.626607 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442398cc-9a4b-4e92-bbb0-b07d62787b0e None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:32.626886 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442398cc-9a4b-4e92-bbb0-b07d62787b0e None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:32.627160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442398cc-9a4b-4e92-bbb0-b07d62787b0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:32.629123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-769b97a3-e2c5-4bf1-8f40-94bd48f92c1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:32.629123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:32.629123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:32.629123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:32.629123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:32.629123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:32.629123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:32.629123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:32.629123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:32.629123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:32.629123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:32.629123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:32.629123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:32.629123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:32.629123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:32.630054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:32.630054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:32.630054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:32.630054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:32.630054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:32.630054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:32.630054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:32.630054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:32.630054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:32.630054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:32.630054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:32.630054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:32.630054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:32.630054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:32.630054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:32.630054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:32.630054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:32.630964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:32.630964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:32.630964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:32.630964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:32.630964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:32.630964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:32.630964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:32.630964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:32.630964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 427/860] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:32.631463 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b97a3-e2c5-4bf1-8f40-94bd48f92c1b None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:32.639625 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442398cc-9a4b-4e92-bbb0-b07d62787b0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:32.641041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442398cc-9a4b-4e92-bbb0-b07d62787b0e None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:32.643862 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:32.658290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-442398cc-9a4b-4e92-bbb0-b07d62787b0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:32.658290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:32.658290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:32.658290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:32.658290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:32.658290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:32.658290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:32.658290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:32.658290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:32.658290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:32.658290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:32.658290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:32.658290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:32.658290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:32.658290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:32.659389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:32.659389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:32.659389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:32.659389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:32.659389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:32.659389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:32.659389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:32.659389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:32.659389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:32.659389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:32.659389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:32.659389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:32.659389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:32.659389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:32.659389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:32.659389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:32.659389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:32.660391 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:32.660391 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:32.660391 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:32.660391 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:32.660391 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 434/861] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:32.660670 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea48986-a6b0-47c7-bc61-573842e3ebe9 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:32.661030 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea48986-a6b0-47c7-bc61-573842e3ebe9 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:32.661294 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea48986-a6b0-47c7-bc61-573842e3ebe9 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:32.665734 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 435/862] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:32.665734 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea48986-a6b0-47c7-bc61-573842e3ebe9 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:32.689867 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:32.735568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b97a3-e2c5-4bf1-8f40-94bd48f92c1b None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:32.767979 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea48986-a6b0-47c7-bc61-573842e3ebe9 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:32.768773 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d2915-31c5-453e-b101-193461f7fbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:32.769463 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d2915-31c5-453e-b101-193461f7fbfe None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:32.769746 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d2915-31c5-453e-b101-193461f7fbfe None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:32.770028 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d2915-31c5-453e-b101-193461f7fbfe None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:32.770750 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d2915-31c5-453e-b101-193461f7fbfe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:32.772113 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d2915-31c5-453e-b101-193461f7fbfe None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:32.797298 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 428/863] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 13:40:32 2022] POST /identity/v3/services => generated 269 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:40:32.797298 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d2915-31c5-453e-b101-193461f7fbfe None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:32.813339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349f9f3-4bf9-4869-bb18-26653bb1ae87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:32.814221 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349f9f3-4bf9-4869-bb18-26653bb1ae87 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:32.814404 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349f9f3-4bf9-4869-bb18-26653bb1ae87 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:32.814689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349f9f3-4bf9-4869-bb18-26653bb1ae87 None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:32.815562 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349f9f3-4bf9-4869-bb18-26653bb1ae87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:32.816711 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349f9f3-4bf9-4869-bb18-26653bb1ae87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:32.817954 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349f9f3-4bf9-4869-bb18-26653bb1ae87 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:32.835487 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 436/864] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:32.835487 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa0363-733c-42d7-81c9-560effb0382d None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:32.835487 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa0363-733c-42d7-81c9-560effb0382d None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:32.835487 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa0363-733c-42d7-81c9-560effb0382d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:32.852137 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-b7aa0363-733c-42d7-81c9-560effb0382d None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:32.853354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-b7aa0363-733c-42d7-81c9-560effb0382d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:32.893945 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:32.929346 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d2915-31c5-453e-b101-193461f7fbfe None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:32.945483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 437/865] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:32 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:32.945483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa0363-733c-42d7-81c9-560effb0382d None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:32.967326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:32.974880 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e5665-faca-48cc-b525-df204373f0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:32.975751 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e5665-faca-48cc-b525-df204373f0d1 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:32.976195 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e5665-faca-48cc-b525-df204373f0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:32.976648 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e5665-faca-48cc-b525-df204373f0d1 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:32.977398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e5665-faca-48cc-b525-df204373f0d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:32.977707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e5665-faca-48cc-b525-df204373f0d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:32.979081 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e5665-faca-48cc-b525-df204373f0d1 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:32.992953 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 429/866] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:32.994141 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e5665-faca-48cc-b525-df204373f0d1 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:33.070496 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa0363-733c-42d7-81c9-560effb0382d None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:33.105763 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada58dcb-3e1e-4d1e-b6de-754fac9dcb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:33.106416 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada58dcb-3e1e-4d1e-b6de-754fac9dcb3c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:33.106693 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada58dcb-3e1e-4d1e-b6de-754fac9dcb3c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:33.106965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada58dcb-3e1e-4d1e-b6de-754fac9dcb3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:33.107780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada58dcb-3e1e-4d1e-b6de-754fac9dcb3c None admin] RBAC: Adding query filter params (role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=e517dc43cc6d401e820c65ad4c941386) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:33.108087 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada58dcb-3e1e-4d1e-b6de-754fac9dcb3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:33.108656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e5665-faca-48cc-b525-df204373f0d1 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:33.109521 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada58dcb-3e1e-4d1e-b6de-754fac9dcb3c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:33.116020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 438/867] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:40:32 2022] GET /identity/v3/role_assignments?user.id=e517dc43cc6d401e820c65ad4c941386&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:33.116801 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada58dcb-3e1e-4d1e-b6de-754fac9dcb3c None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:33.154909 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:33.163764 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b34cf8-0b88-4018-b6a3-ed47200fe9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:33.164852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b34cf8-0b88-4018-b6a3-ed47200fe9c2 None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:33.165425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b34cf8-0b88-4018-b6a3-ed47200fe9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:33.165915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b34cf8-0b88-4018-b6a3-ed47200fe9c2 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:33.166907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b34cf8-0b88-4018-b6a3-ed47200fe9c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:33.168525 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b34cf8-0b88-4018-b6a3-ed47200fe9c2 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:33.193894 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 430/868] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 13:40:32 2022] POST /identity/v3/services => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:40:33.223279 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:33.254363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada58dcb-3e1e-4d1e-b6de-754fac9dcb3c None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:33.302819 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d207334-87de-44a9-89da-498555b0dd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:33.303651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d207334-87de-44a9-89da-498555b0dd4b None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:33.303929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d207334-87de-44a9-89da-498555b0dd4b None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:33.304261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d207334-87de-44a9-89da-498555b0dd4b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:33.313212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d207334-87de-44a9-89da-498555b0dd4b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:33.314830 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d207334-87de-44a9-89da-498555b0dd4b None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:33.332251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-1d207334-87de-44a9-89da-498555b0dd4b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 13:40:33.332251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:33.332251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:33.332251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:33.332251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:33.332251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:33.332251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:33.332251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:33.332251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:33.332251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:33.332251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:33.332251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:33.332251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:33.332251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:33.332251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:33.332251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:33.333355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:33.333355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:33.333355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:33.333355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:33.333355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:33.333355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:33.333355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:33.333355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:33.333355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:33.333355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:33.333355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:33.333355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:33.333355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:33.333355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:33.333355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:33.333355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:33.333355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:33.333355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:33.334372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:33.334372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:33.334372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:33.334372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:33.334372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:33.334372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:33.334372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:33.334372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:33.334372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 13:40:33.334372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:33.334372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 439/869] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 13:40:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:33.339875 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b34cf8-0b88-4018-b6a3-ed47200fe9c2 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:33.453980 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b34cf8-0b88-4018-b6a3-ed47200fe9c2 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:33.491690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc34f5-487f-44f7-8b8b-03c86d4ec090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:33.492358 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc34f5-487f-44f7-8b8b-03c86d4ec090 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:33.492635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc34f5-487f-44f7-8b8b-03c86d4ec090 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:33.492903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc34f5-487f-44f7-8b8b-03c86d4ec090 None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:33.493785 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc34f5-487f-44f7-8b8b-03c86d4ec090 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:33.494091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc34f5-487f-44f7-8b8b-03c86d4ec090 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:33.495511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc34f5-487f-44f7-8b8b-03c86d4ec090 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:33.514242 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 431/870] 10.222.0.45 () {56 vars in 1149 bytes} [Thu May 26 13:40:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:33.520209 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d207334-87de-44a9-89da-498555b0dd4b None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:33.621770 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d207334-87de-44a9-89da-498555b0dd4b None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:33.651054 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:33.657186 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da80d2-6780-41db-979f-b24c223f9f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:33.657872 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da80d2-6780-41db-979f-b24c223f9f54 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:33.658199 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da80d2-6780-41db-979f-b24c223f9f54 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:33.658481 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da80d2-6780-41db-979f-b24c223f9f54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:33.732212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da80d2-6780-41db-979f-b24c223f9f54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:33.733701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da80d2-6780-41db-979f-b24c223f9f54 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:33.833388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 440/871] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:40:33 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 13:40:33.842335 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc34f5-487f-44f7-8b8b-03c86d4ec090 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:33.897054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:33.953624 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc34f5-487f-44f7-8b8b-03c86d4ec090 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:33.992675 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ca21c-5691-41e2-88eb-4337101a622e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:33.993778 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ca21c-5691-41e2-88eb-4337101a622e None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:33.994229 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ca21c-5691-41e2-88eb-4337101a622e None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:33.994663 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ca21c-5691-41e2-88eb-4337101a622e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:34.005973 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ca21c-5691-41e2-88eb-4337101a622e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:34.007628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ca21c-5691-41e2-88eb-4337101a622e None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:34.026074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-119ca21c-5691-41e2-88eb-4337101a622e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:34.026074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:34.026074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:34.026074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:34.026074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:34.026074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:34.026074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:34.026074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:34.026074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:34.026074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:34.026074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:34.026074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:34.026074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:34.026074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:34.026074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:34.027077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:34.027077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:34.027077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:34.027077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:34.027077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:34.027077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:34.027077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:34.027077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:34.027077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:34.027077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:34.027077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:34.027077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:34.027077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:34.027077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:34.027077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:34.027077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:34.027077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:34.028008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:34.028008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:34.028008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:34.028008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:34.028008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 432/872] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:34.032961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da80d2-6780-41db-979f-b24c223f9f54 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:34.064382 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:34.134401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da80d2-6780-41db-979f-b24c223f9f54 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:34.169017 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56145c-3221-4cb6-ae4a-bdc2f89e515a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:34.169627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56145c-3221-4cb6-ae4a-bdc2f89e515a None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:34.169905 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56145c-3221-4cb6-ae4a-bdc2f89e515a None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:34.170177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56145c-3221-4cb6-ae4a-bdc2f89e515a None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:34.170886 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56145c-3221-4cb6-ae4a-bdc2f89e515a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:34.171187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56145c-3221-4cb6-ae4a-bdc2f89e515a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:34.172524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56145c-3221-4cb6-ae4a-bdc2f89e515a None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:34.184406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 441/873] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:34.189807 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ca21c-5691-41e2-88eb-4337101a622e None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:34.289953 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:34.293578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ca21c-5691-41e2-88eb-4337101a622e None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:34.330478 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c9c04-e870-4ad8-a95c-35cffd5450c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:34.331296 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c9c04-e870-4ad8-a95c-35cffd5450c8 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:34.331581 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c9c04-e870-4ad8-a95c-35cffd5450c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:34.331859 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c9c04-e870-4ad8-a95c-35cffd5450c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:34.339699 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c9c04-e870-4ad8-a95c-35cffd5450c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:34.341196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c9c04-e870-4ad8-a95c-35cffd5450c8 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:34.356790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-901c9c04-e870-4ad8-a95c-35cffd5450c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:34.356790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:34.356790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:34.356790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:34.356790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:34.356790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:34.356790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:34.356790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:34.356790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:34.356790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:34.356790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:34.356790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:34.356790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:34.356790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:34.356790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:34.359002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:34.359002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:34.359002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:34.359002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:34.359002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:34.359002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:34.359002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:34.359002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:34.359002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:34.359002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:34.359002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:34.359002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:34.359002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:34.359002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:34.359002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:34.359002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:34.359002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:34.361220 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:34.361220 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:34.361220 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:34.361220 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:34.361220 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:34.361220 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:34.361220 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:34.361220 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:34.361220 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 433/874] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:34.369319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56145c-3221-4cb6-ae4a-bdc2f89e515a None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:34.464351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:34.474131 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56145c-3221-4cb6-ae4a-bdc2f89e515a None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:34.508527 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0b632-e8d8-4b1c-b62e-2028d1a88924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:34.509595 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0b632-e8d8-4b1c-b62e-2028d1a88924 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:34.509912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0b632-e8d8-4b1c-b62e-2028d1a88924 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:34.510200 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0b632-e8d8-4b1c-b62e-2028d1a88924 None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:34.511066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0b632-e8d8-4b1c-b62e-2028d1a88924 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:34.511414 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0b632-e8d8-4b1c-b62e-2028d1a88924 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:34.512928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0b632-e8d8-4b1c-b62e-2028d1a88924 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:34.525995 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 442/875] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:34.531886 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c9c04-e870-4ad8-a95c-35cffd5450c8 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:34.640086 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c9c04-e870-4ad8-a95c-35cffd5450c8 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:34.678371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ec4c0-024f-40d0-b9c5-796e302a69be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:34.679034 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ec4c0-024f-40d0-b9c5-796e302a69be None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:34.679317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ec4c0-024f-40d0-b9c5-796e302a69be None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:34.679592 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ec4c0-024f-40d0-b9c5-796e302a69be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:34.682325 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ec4c0-024f-40d0-b9c5-796e302a69be None admin] RBAC: Adding query filter params (role.id=0bb0d62bb4f84638888ceb6ecabda8b3, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=135410329e56486c8ccb65b1f2d87aca) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:34.682809 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ec4c0-024f-40d0-b9c5-796e302a69be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:34.684414 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ec4c0-024f-40d0-b9c5-796e302a69be None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:34.691708 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 434/876] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:40:34 2022] GET /identity/v3/role_assignments?user.id=135410329e56486c8ccb65b1f2d87aca&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=0bb0d62bb4f84638888ceb6ecabda8b3 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:35.097749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaee33b-88a3-4571-9827-7754ec04d872 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:35.098322 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaee33b-88a3-4571-9827-7754ec04d872 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:35.098322 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaee33b-88a3-4571-9827-7754ec04d872 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:35.099903 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 443/877] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:35.105597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754242af-9694-4b7b-aa58-505cd6085805 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:35.106104 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754242af-9694-4b7b-aa58-505cd6085805 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:35.106185 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754242af-9694-4b7b-aa58-505cd6085805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:35.123454 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-754242af-9694-4b7b-aa58-505cd6085805 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:35.124647 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-754242af-9694-4b7b-aa58-505cd6085805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:35.143200 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:35.194920 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 435/878] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:35.217381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaee33b-88a3-4571-9827-7754ec04d872 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:35.326856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaee33b-88a3-4571-9827-7754ec04d872 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:35.362148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56036952-a4fb-4b1e-97c7-9f627dca112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:35.363522 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56036952-a4fb-4b1e-97c7-9f627dca112e None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:35.363800 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56036952-a4fb-4b1e-97c7-9f627dca112e None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:35.364072 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56036952-a4fb-4b1e-97c7-9f627dca112e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:35.364719 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56036952-a4fb-4b1e-97c7-9f627dca112e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:35.366090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56036952-a4fb-4b1e-97c7-9f627dca112e None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:35.378513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-56036952-a4fb-4b1e-97c7-9f627dca112e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 13:40:35.378513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:35.378513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:35.378513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:35.378513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:35.378513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:35.378513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:35.378513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:35.378513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 13:40:35.378513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:35.378513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:35.378513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:35.378513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:35.378513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:35.378513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:35.378513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:35.379534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:35.379534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:35.379534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:35.379534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:35.379534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:35.379534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:35.379534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:35.379534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:35.379534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:35.379534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:35.379534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:35.379534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:35.379534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:35.379534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:35.379534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:35.379534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:35.380689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:35.380689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:35.380689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:35.380689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:35.380689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:35.380689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:35.380689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:35.380689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:35.380689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:35.380689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:35.380689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:35.380689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:35.380689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:35.380689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 13:40:35.380689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:35.380689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 444/879] 10.222.0.45 () {56 vars in 1132 bytes} [Thu May 26 13:40:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:35.388411 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754242af-9694-4b7b-aa58-505cd6085805 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:35.490418 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52c856-cd9d-4116-91e8-afcdd2b43b42 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:35.490716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52c856-cd9d-4116-91e8-afcdd2b43b42 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:35.491141 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52c856-cd9d-4116-91e8-afcdd2b43b42 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:35.492815 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 445/880] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:40:35.497694 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d9f97-1fd3-4ee7-8f9d-c77d46c28ee0 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:35.498049 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d9f97-1fd3-4ee7-8f9d-c77d46c28ee0 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:35.498400 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d9f97-1fd3-4ee7-8f9d-c77d46c28ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:35.498816 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754242af-9694-4b7b-aa58-505cd6085805 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:35.515831 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-dd0d9f97-1fd3-4ee7-8f9d-c77d46c28ee0 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:35.517136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-dd0d9f97-1fd3-4ee7-8f9d-c77d46c28ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:35.527294 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:35.537765 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a852b2-c6b7-4437-9369-8715185ab6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:35.538438 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a852b2-c6b7-4437-9369-8715185ab6cb None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:35.538819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a852b2-c6b7-4437-9369-8715185ab6cb None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:35.539105 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a852b2-c6b7-4437-9369-8715185ab6cb None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:35.540290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a852b2-c6b7-4437-9369-8715185ab6cb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:35.540604 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a852b2-c6b7-4437-9369-8715185ab6cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:35.542455 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a852b2-c6b7-4437-9369-8715185ab6cb None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:35.550523 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 436/881] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 13:40:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:35.555581 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a852b2-c6b7-4437-9369-8715185ab6cb None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:35.581861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:35.593361 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 446/882] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 13:40:35.614840 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d9f97-1fd3-4ee7-8f9d-c77d46c28ee0 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:35.677910 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a852b2-c6b7-4437-9369-8715185ab6cb None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:35.722794 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e46a8d-f8be-4295-b4c1-5c8d247999f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:35.723408 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e46a8d-f8be-4295-b4c1-5c8d247999f9 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:35.723695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e46a8d-f8be-4295-b4c1-5c8d247999f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:35.723979 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e46a8d-f8be-4295-b4c1-5c8d247999f9 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:35.724665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e46a8d-f8be-4295-b4c1-5c8d247999f9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:35.724974 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e46a8d-f8be-4295-b4c1-5c8d247999f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:35.726479 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e46a8d-f8be-4295-b4c1-5c8d247999f9 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:35.731418 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 437/883] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 13:40:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:35.732457 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c904a0-ad41-4870-a39e-8c489ae5924a None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:35.732747 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c904a0-ad41-4870-a39e-8c489ae5924a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:35.733024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c904a0-ad41-4870-a39e-8c489ae5924a None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:35.734398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 438/884] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:35.735923 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d9f97-1fd3-4ee7-8f9d-c77d46c28ee0 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:35.739861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c904a0-ad41-4870-a39e-8c489ae5924a None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:35.774563 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1655021-3e34-47a5-bd46-6ee85102adfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:35.775612 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1655021-3e34-47a5-bd46-6ee85102adfa None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:35.775895 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1655021-3e34-47a5-bd46-6ee85102adfa None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:35.776175 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1655021-3e34-47a5-bd46-6ee85102adfa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:35.776822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1655021-3e34-47a5-bd46-6ee85102adfa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:35.778190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1655021-3e34-47a5-bd46-6ee85102adfa None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:35.790113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-c1655021-3e34-47a5-bd46-6ee85102adfa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 13:40:35.790113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:35.790113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:35.790113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:35.790113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:35.790113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:35.790113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:35.790113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:35.790113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 13:40:35.790113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:35.790113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:35.790113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:35.790113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:35.790113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:35.790113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:35.790113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:35.790113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:35.791130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:35.791130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:35.791130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:35.791130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:35.791130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:35.791130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:35.791130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:35.791130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:35.791130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:35.791130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:35.791130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:35.791130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:35.791130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:35.791130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:35.791130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:35.791130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:35.791977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:35.791977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:35.791977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:35.791977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:35.791977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:35.791977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:35.791977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:35.791977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:35.791977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:35.791977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:35.791977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:35.791977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:35.791977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 13:40:35.791977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:35.791977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 447/885] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 13:40:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:35.797390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3e528-1ae7-4896-bcb9-9b8ba75e5540 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:35.797679 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3e528-1ae7-4896-bcb9-9b8ba75e5540 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:35.797959 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3e528-1ae7-4896-bcb9-9b8ba75e5540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:35.815194 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-0cc3e528-1ae7-4896-bcb9-9b8ba75e5540 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:35.816930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0cc3e528-1ae7-4896-bcb9-9b8ba75e5540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:35.818896 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:35.840032 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:35.863240 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c904a0-ad41-4870-a39e-8c489ae5924a None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:35.889716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 448/886] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:35.890314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3e528-1ae7-4896-bcb9-9b8ba75e5540 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:35.910570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75a495-18a4-47ea-bad6-88925a283408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:35.911674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75a495-18a4-47ea-bad6-88925a283408 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:35.911958 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75a495-18a4-47ea-bad6-88925a283408 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:35.912238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75a495-18a4-47ea-bad6-88925a283408 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:35.913828 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75a495-18a4-47ea-bad6-88925a283408 None admin] RBAC: Adding query filter params (interface=public, service_id=df0b0d95a44b4cf58b5e15191d28c4c7, region_id=RegionOne) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:35.914440 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75a495-18a4-47ea-bad6-88925a283408 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:35.916149 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75a495-18a4-47ea-bad6-88925a283408 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:35.928271 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 439/887] 10.222.0.45 () {56 vars in 1251 bytes} [Thu May 26 13:40:35 2022] GET /identity/v3/endpoints?service_id=df0b0d95a44b4cf58b5e15191d28c4c7&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:35.929500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75a495-18a4-47ea-bad6-88925a283408 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:35.997256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3e528-1ae7-4896-bcb9-9b8ba75e5540 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:36.036987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f402b9-f778-4414-a775-06ac7634de5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:36.037689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f402b9-f778-4414-a775-06ac7634de5a None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:36.037982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f402b9-f778-4414-a775-06ac7634de5a None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:36.038259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f402b9-f778-4414-a775-06ac7634de5a None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:36.038972 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f402b9-f778-4414-a775-06ac7634de5a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:36.039281 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f402b9-f778-4414-a775-06ac7634de5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:36.040776 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f402b9-f778-4414-a775-06ac7634de5a None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:36.044971 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75a495-18a4-47ea-bad6-88925a283408 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:36.052942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 449/888] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 13:40:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:36.052942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f402b9-f778-4414-a775-06ac7634de5a None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:36.052942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:36.092662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c8fae-9ae9-4b72-84aa-5f82c418d0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:36.093488 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c8fae-9ae9-4b72-84aa-5f82c418d0a4 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:36.094206 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c8fae-9ae9-4b72-84aa-5f82c418d0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:36.094537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c8fae-9ae9-4b72-84aa-5f82c418d0a4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:36.095186 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c8fae-9ae9-4b72-84aa-5f82c418d0a4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:36.097261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c8fae-9ae9-4b72-84aa-5f82c418d0a4 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:36.109114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-b64c8fae-9ae9-4b72-84aa-5f82c418d0a4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 13:40:36.109114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:36.109114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:36.109114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:36.109114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:36.109114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:36.109114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:36.109114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:36.109114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 13:40:36.109114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:36.109114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:36.109114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:36.109114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:36.109114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:36.109114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:36.109114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:36.109114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:36.110712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:36.110712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:36.110712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:36.110712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:36.110712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:36.110712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:36.110712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:36.110712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:36.110712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:36.110712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:36.110712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:36.110712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:36.110712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:36.110712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:36.110712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:36.110712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:36.112378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:36.112378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:36.112378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:36.112378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:36.112378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:36.112378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:36.112378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:36.112378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:36.112378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:36.112378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:36.112378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:36.112378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:36.112378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 13:40:36.112378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:36.112378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 440/889] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:40:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:36.113201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c8fae-9ae9-4b72-84aa-5f82c418d0a4 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:36.124540 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:36.164941 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f402b9-f778-4414-a775-06ac7634de5a None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:36.199421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7ee31-fe25-4740-891e-7f320deb1133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:36.200075 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7ee31-fe25-4740-891e-7f320deb1133 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:36.200355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7ee31-fe25-4740-891e-7f320deb1133 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:36.200629 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7ee31-fe25-4740-891e-7f320deb1133 None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:36.201361 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7ee31-fe25-4740-891e-7f320deb1133 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:36.202706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7ee31-fe25-4740-891e-7f320deb1133 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:36.209090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 450/890] 10.222.0.45 () {56 vars in 1087 bytes} [Thu May 26 13:40:36 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:40:36.209903 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7ee31-fe25-4740-891e-7f320deb1133 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:36.224850 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c8fae-9ae9-4b72-84aa-5f82c418d0a4 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:36.264841 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34d3da-9120-478a-ab0e-4fbcad6a027c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:36.265665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34d3da-9120-478a-ab0e-4fbcad6a027c None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:36.266017 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34d3da-9120-478a-ab0e-4fbcad6a027c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:36.266363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34d3da-9120-478a-ab0e-4fbcad6a027c None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:36.267140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34d3da-9120-478a-ab0e-4fbcad6a027c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:36.267444 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34d3da-9120-478a-ab0e-4fbcad6a027c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:36.269458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34d3da-9120-478a-ab0e-4fbcad6a027c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:36.281734 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 441/891] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 13:40:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:36.300340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:36.348643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7ee31-fe25-4740-891e-7f320deb1133 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:36.395170 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e55c92-811a-4bfb-815e-969328156ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:36.396114 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e55c92-811a-4bfb-815e-969328156ebe None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:36.396409 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e55c92-811a-4bfb-815e-969328156ebe None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:36.396691 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e55c92-811a-4bfb-815e-969328156ebe None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:36.397595 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e55c92-811a-4bfb-815e-969328156ebe None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:36.398145 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e55c92-811a-4bfb-815e-969328156ebe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:36.399745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e55c92-811a-4bfb-815e-969328156ebe None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:36.406300 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 451/892] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:40:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:36.412138 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34d3da-9120-478a-ab0e-4fbcad6a027c None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:36.501853 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:36.528560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34d3da-9120-478a-ab0e-4fbcad6a027c None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:36.562450 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b9878-c0cb-437e-9c69-a4779e248891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:36.563115 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b9878-c0cb-437e-9c69-a4779e248891 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:36.563392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b9878-c0cb-437e-9c69-a4779e248891 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:36.563665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b9878-c0cb-437e-9c69-a4779e248891 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:36.564417 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b9878-c0cb-437e-9c69-a4779e248891 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:36.564728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b9878-c0cb-437e-9c69-a4779e248891 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:36.566681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b9878-c0cb-437e-9c69-a4779e248891 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:36.579928 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 442/893] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:40:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:36.586255 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e55c92-811a-4bfb-815e-969328156ebe None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:36.704254 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e55c92-811a-4bfb-815e-969328156ebe None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:36.734965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:36.742924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a7aec-050c-4c0b-89bf-4539b136053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:36.743849 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a7aec-050c-4c0b-89bf-4539b136053c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:36.744373 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a7aec-050c-4c0b-89bf-4539b136053c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:36.744843 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a7aec-050c-4c0b-89bf-4539b136053c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:36.745860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a7aec-050c-4c0b-89bf-4539b136053c None admin] RBAC: Adding query filter params (interface=public, service_id=2a5602ed3fe54058ba9521905cb8b66a, region_id=RegionOne) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:36.746384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a7aec-050c-4c0b-89bf-4539b136053c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:36.747919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a7aec-050c-4c0b-89bf-4539b136053c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:36.754418 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 452/894] 10.222.0.45 () {56 vars in 1251 bytes} [Thu May 26 13:40:36 2022] GET /identity/v3/endpoints?service_id=2a5602ed3fe54058ba9521905cb8b66a&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:36.760216 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b9878-c0cb-437e-9c69-a4779e248891 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:36.870116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b9878-c0cb-437e-9c69-a4779e248891 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:36.905206 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef521fe-1d51-4735-affd-b4609b3aee4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:36.905890 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef521fe-1d51-4735-affd-b4609b3aee4c None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:36.906247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef521fe-1d51-4735-affd-b4609b3aee4c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:36.906439 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef521fe-1d51-4735-affd-b4609b3aee4c None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:36.907098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef521fe-1d51-4735-affd-b4609b3aee4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:36.908456 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef521fe-1d51-4735-affd-b4609b3aee4c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:36.915127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 443/895] 10.222.0.45 () {56 vars in 1087 bytes} [Thu May 26 13:40:36 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:40:37.037012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc32fa-1689-4569-ae36-bc280880dd1c None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:37.037329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc32fa-1689-4569-ae36-bc280880dd1c None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:37.037608 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc32fa-1689-4569-ae36-bc280880dd1c None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:37.039287 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 453/896] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:37.044977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad7543-479b-4a80-a9ee-c0d4c259a8f2 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:37.045317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad7543-479b-4a80-a9ee-c0d4c259a8f2 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:37.045582 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad7543-479b-4a80-a9ee-c0d4c259a8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:37.055210 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:37.068154 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-f0ad7543-479b-4a80-a9ee-c0d4c259a8f2 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:37.069412 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f0ad7543-479b-4a80-a9ee-c0d4c259a8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:37.144807 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 444/897] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:37.167724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc32fa-1689-4569-ae36-bc280880dd1c None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:37.273561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc32fa-1689-4569-ae36-bc280880dd1c None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:37.309463 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e60fed-6bed-47aa-9543-7ed15a8883b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:37.310507 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e60fed-6bed-47aa-9543-7ed15a8883b5 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:37.310933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e60fed-6bed-47aa-9543-7ed15a8883b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:37.311357 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e60fed-6bed-47aa-9543-7ed15a8883b5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:37.321967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e60fed-6bed-47aa-9543-7ed15a8883b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:37.330226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-c6e60fed-6bed-47aa-9543-7ed15a8883b5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 13:40:37.330226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:37.330226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:37.330226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:37.330226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:37.330226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:37.330226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:37.330226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:37.330226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:37.330226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:37.330226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:37.330226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:37.330226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:37.330226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:37.330226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:37.330226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:37.331884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:37.331884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:37.331884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:37.331884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:37.331884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:37.331884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:37.331884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:37.331884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:37.331884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:37.331884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:37.331884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:37.331884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:37.331884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:37.331884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:37.331884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:37.331884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:37.332946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:37.332946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:37.332946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:37.332946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:37.332946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:37.332946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:37.332946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:37.332946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:37.332946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:37.332946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:37.332946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 13:40:37.332946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:37.335313 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 454/898] 10.222.0.45 () {56 vars in 1120 bytes} [Thu May 26 13:40:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:37.341819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad7543-479b-4a80-a9ee-c0d4c259a8f2 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:37.440480 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad7543-479b-4a80-a9ee-c0d4c259a8f2 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:37.473323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:37.480531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74e1f5-f333-43c9-9e5e-f4c066a72cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:37.481573 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74e1f5-f333-43c9-9e5e-f4c066a72cb4 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:37.482068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74e1f5-f333-43c9-9e5e-f4c066a72cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:37.482550 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74e1f5-f333-43c9-9e5e-f4c066a72cb4 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:37.483500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74e1f5-f333-43c9-9e5e-f4c066a72cb4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:37.484000 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74e1f5-f333-43c9-9e5e-f4c066a72cb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:37.485634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74e1f5-f333-43c9-9e5e-f4c066a72cb4 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:37.495509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 445/899] 10.222.0.45 () {56 vars in 1115 bytes} [Thu May 26 13:40:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:37.502366 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e60fed-6bed-47aa-9543-7ed15a8883b5 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:37.566515 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:37.614775 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e60fed-6bed-47aa-9543-7ed15a8883b5 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:37.651704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c08649-67af-4fa9-9519-a2c707d34ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:37.652866 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c08649-67af-4fa9-9519-a2c707d34ddb None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:37.653395 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c08649-67af-4fa9-9519-a2c707d34ddb None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:37.653884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c08649-67af-4fa9-9519-a2c707d34ddb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:37.665109 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c08649-67af-4fa9-9519-a2c707d34ddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:37.666808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c08649-67af-4fa9-9519-a2c707d34ddb None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:37.684289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-22c08649-67af-4fa9-9519-a2c707d34ddb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:37.684289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:37.684289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:37.684289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:37.684289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:37.684289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:37.684289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:37.684289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:37.684289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:37.684289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:37.684289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:37.684289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:37.684289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:37.684289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:37.684289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:37.685212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:37.685212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:37.685212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:37.685212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:37.685212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:37.685212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:37.685212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:37.685212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:37.685212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:37.685212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:37.685212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:37.685212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:37.685212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:37.685212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:37.685212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:37.685212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:37.685212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:37.686313 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:37.686313 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:37.686313 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:37.686313 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:37.686313 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 455/900] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:37.694726 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74e1f5-f333-43c9-9e5e-f4c066a72cb4 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:37.795971 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74e1f5-f333-43c9-9e5e-f4c066a72cb4 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:37.830111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e639cc3-0430-4bd5-bcbd-e3e78ef14b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:37.830697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e639cc3-0430-4bd5-bcbd-e3e78ef14b12 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:37.831504 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e639cc3-0430-4bd5-bcbd-e3e78ef14b12 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:37.831783 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e639cc3-0430-4bd5-bcbd-e3e78ef14b12 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:37.832497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e639cc3-0430-4bd5-bcbd-e3e78ef14b12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:37.832804 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e639cc3-0430-4bd5-bcbd-e3e78ef14b12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:37.834196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e639cc3-0430-4bd5-bcbd-e3e78ef14b12 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:37.846190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 446/901] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:37.851397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c08649-67af-4fa9-9519-a2c707d34ddb None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:37.952959 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c08649-67af-4fa9-9519-a2c707d34ddb None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:37.960591 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:37.989067 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc884db6-9a95-44ed-a9b2-ca03da2eaade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:37.990303 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc884db6-9a95-44ed-a9b2-ca03da2eaade None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:37.990588 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc884db6-9a95-44ed-a9b2-ca03da2eaade None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:37.990862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc884db6-9a95-44ed-a9b2-ca03da2eaade None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:37.998519 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc884db6-9a95-44ed-a9b2-ca03da2eaade None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:37.999934 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc884db6-9a95-44ed-a9b2-ca03da2eaade None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:38.014943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-dc884db6-9a95-44ed-a9b2-ca03da2eaade None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 13:40:38.014943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:38.014943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:38.014943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:38.014943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:38.014943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:38.014943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:38.014943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:38.014943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:38.014943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:38.014943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:38.014943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:38.014943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:38.014943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:38.014943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:38.014943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:38.017218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:38.017218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:38.017218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:38.017218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:38.017218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:38.017218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:38.017218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:38.017218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:38.017218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:38.017218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:38.017218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:38.017218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:38.017218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:38.017218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:38.017218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:38.017218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:38.017218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:38.017218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:38.020178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:38.020178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:38.020178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:38.020178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:38.020178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:38.020178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:38.020178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:38.020178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:38.020178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 13:40:38.020178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:38.020178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 456/902] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 13:40:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:38.025733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e639cc3-0430-4bd5-bcbd-e3e78ef14b12 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:38.083750 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:38.131072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e639cc3-0430-4bd5-bcbd-e3e78ef14b12 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:38.168542 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0571ca-b674-4053-a3dc-bf1562cd0b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:38.169344 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0571ca-b674-4053-a3dc-bf1562cd0b91 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:38.169510 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0571ca-b674-4053-a3dc-bf1562cd0b91 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:38.169764 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0571ca-b674-4053-a3dc-bf1562cd0b91 None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:38.170595 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0571ca-b674-4053-a3dc-bf1562cd0b91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:38.170904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0571ca-b674-4053-a3dc-bf1562cd0b91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:38.172330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0571ca-b674-4053-a3dc-bf1562cd0b91 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:38.191193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 447/903] 10.222.0.45 () {56 vars in 1149 bytes} [Thu May 26 13:40:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:38.196417 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc884db6-9a95-44ed-a9b2-ca03da2eaade None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:38.300358 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc884db6-9a95-44ed-a9b2-ca03da2eaade None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:38.336174 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b877e8-f49f-468b-8d2b-9e8991608dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:38.336745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b877e8-f49f-468b-8d2b-9e8991608dc3 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:38.337020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b877e8-f49f-468b-8d2b-9e8991608dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:38.337355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b877e8-f49f-468b-8d2b-9e8991608dc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:38.372014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:38.407830 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b877e8-f49f-468b-8d2b-9e8991608dc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:38.409936 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b877e8-f49f-468b-8d2b-9e8991608dc3 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:38.521952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 457/904] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:40:38 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 13:40:38.531624 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0571ca-b674-4053-a3dc-bf1562cd0b91 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:38.628203 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21e563-b46d-4d51-952c-2ef388f26d2f None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:38.628203 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21e563-b46d-4d51-952c-2ef388f26d2f None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:38.628203 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21e563-b46d-4d51-952c-2ef388f26d2f None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:38.629909 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 458/905] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:38.634724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4eba9-8d68-4ff0-9c86-9b28a0668087 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:38.635013 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4eba9-8d68-4ff0-9c86-9b28a0668087 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:38.635294 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4eba9-8d68-4ff0-9c86-9b28a0668087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:38.639799 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0571ca-b674-4053-a3dc-bf1562cd0b91 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:38.655672 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:38.657486 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-11c4eba9-8d68-4ff0-9c86-9b28a0668087 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:38.660264 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-11c4eba9-8d68-4ff0-9c86-9b28a0668087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:38.697183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df8e2d-89ad-4716-9614-e857c092a90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:38.698279 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df8e2d-89ad-4716-9614-e857c092a90a None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:38.698561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df8e2d-89ad-4716-9614-e857c092a90a None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:38.698837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df8e2d-89ad-4716-9614-e857c092a90a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:38.712609 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df8e2d-89ad-4716-9614-e857c092a90a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:38.714104 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df8e2d-89ad-4716-9614-e857c092a90a None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:38.732547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-32df8e2d-89ad-4716-9614-e857c092a90a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:38.732547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:38.732547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:38.732547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:38.732547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:38.732547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:38.732547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:38.732547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:38.732547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:38.732547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:38.732547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:38.732547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:38.732547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:38.732547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:38.732547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:38.733535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:38.733535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:38.733535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:38.733535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:38.733535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:38.733535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:38.733535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:38.733535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:38.733535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:38.733535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:38.733535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:38.733535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:38.733535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:38.733535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:38.733535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:38.733535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:38.733535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:38.734643 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:38.734643 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:38.734643 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:38.734643 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:38.737605 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 448/906] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:38.739359 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:38.739766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc616e-12d5-4b53-95ff-0d0902d6704e None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:38.740104 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc616e-12d5-4b53-95ff-0d0902d6704e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:38.740311 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc616e-12d5-4b53-95ff-0d0902d6704e None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:38.745933 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 449/907] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:38.746784 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc616e-12d5-4b53-95ff-0d0902d6704e None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:38.748154 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 459/908] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:38.749298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116877c9-1ee6-41e8-a878-b8c704601ed9 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:38.749628 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116877c9-1ee6-41e8-a878-b8c704601ed9 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:38.749874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116877c9-1ee6-41e8-a878-b8c704601ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:38.780417 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-116877c9-1ee6-41e8-a878-b8c704601ed9 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:38.782003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-116877c9-1ee6-41e8-a878-b8c704601ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:38.852503 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 460/909] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:38.853486 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116877c9-1ee6-41e8-a878-b8c704601ed9 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:38.863912 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc616e-12d5-4b53-95ff-0d0902d6704e None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:38.900109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c038c-d27c-4696-ab73-9fcd11040092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:38.900687 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c038c-d27c-4696-ab73-9fcd11040092 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:38.900969 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c038c-d27c-4696-ab73-9fcd11040092 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:38.901245 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c038c-d27c-4696-ab73-9fcd11040092 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:38.901984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c038c-d27c-4696-ab73-9fcd11040092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:38.902290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c038c-d27c-4696-ab73-9fcd11040092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:38.903659 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c038c-d27c-4696-ab73-9fcd11040092 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:38.919355 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 450/910] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:38.919355 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c038c-d27c-4696-ab73-9fcd11040092 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:38.942633 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:38.970568 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116877c9-1ee6-41e8-a878-b8c704601ed9 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:38.997166 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:39.009962 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92414b7-5171-45d7-a101-486eae4325b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:39.010633 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92414b7-5171-45d7-a101-486eae4325b1 None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:39.010919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92414b7-5171-45d7-a101-486eae4325b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:39.011197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92414b7-5171-45d7-a101-486eae4325b1 None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:39.011922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92414b7-5171-45d7-a101-486eae4325b1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:39.013378 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92414b7-5171-45d7-a101-486eae4325b1 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:39.023187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c038c-d27c-4696-ab73-9fcd11040092 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:39.030194 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 461/911] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 13:40:38 2022] POST /identity/v3/services => generated 241 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:40:39.030963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92414b7-5171-45d7-a101-486eae4325b1 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:39.081593 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94142f4a-4b16-4528-99aa-73e62854731d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:39.082529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94142f4a-4b16-4528-99aa-73e62854731d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:39.082877 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94142f4a-4b16-4528-99aa-73e62854731d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:39.083220 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94142f4a-4b16-4528-99aa-73e62854731d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:39.083950 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94142f4a-4b16-4528-99aa-73e62854731d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:39.085455 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94142f4a-4b16-4528-99aa-73e62854731d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:39.100829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-94142f4a-4b16-4528-99aa-73e62854731d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 13:40:39.100829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:39.100829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:39.100829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:39.100829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:39.100829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:39.100829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:39.100829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:39.100829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 13:40:39.100829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:39.100829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:39.100829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:39.100829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:39.100829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:39.100829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:39.100829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:39.101955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:39.101955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:39.101955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:39.101955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:39.101955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:39.101955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:39.101955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:39.101955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:39.101955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:39.101955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:39.101955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:39.101955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:39.101955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:39.101955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:39.101955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:39.101955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:39.102823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:39.102823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:39.102823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:39.102823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:39.102823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:39.102823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:39.102823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:39.102823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:39.102823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:39.102823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:39.102823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:39.102823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:39.102823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:39.102823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 13:40:39.102823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:39.108085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 451/912] 10.222.0.45 () {56 vars in 1132 bytes} [Thu May 26 13:40:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:39.109238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94142f4a-4b16-4528-99aa-73e62854731d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:39.168128 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92414b7-5171-45d7-a101-486eae4325b1 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:39.204372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96644e66-ca38-4529-81d0-7daa6299bd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:39.205293 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96644e66-ca38-4529-81d0-7daa6299bd95 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:39.205684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96644e66-ca38-4529-81d0-7daa6299bd95 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:39.206036 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96644e66-ca38-4529-81d0-7daa6299bd95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:39.213688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:39.214198 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96644e66-ca38-4529-81d0-7daa6299bd95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:39.215616 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96644e66-ca38-4529-81d0-7daa6299bd95 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:39.232039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-96644e66-ca38-4529-81d0-7daa6299bd95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:39.232039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:39.232039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:39.232039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:39.232039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:39.232039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:39.232039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:39.232039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:39.232039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:39.232039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:39.232039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:39.232039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:39.232039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:39.232039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:39.232039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:39.233038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:39.233038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:39.233038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:39.233038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:39.233038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:39.233038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:39.233038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:39.233038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:39.233038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:39.233038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:39.233038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:39.233038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:39.233038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:39.233038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:39.233038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:39.233038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:39.233038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:39.234024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:39.234024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:39.234024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:39.234024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:39.234024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:39.234024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:39.234024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:39.234024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:39.234024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 462/913] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:39.237442 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94142f4a-4b16-4528-99aa-73e62854731d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:39.239398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96644e66-ca38-4529-81d0-7daa6299bd95 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:39.276040 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62381d09-f784-4924-bc77-845f64c1d53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:39.276705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62381d09-f784-4924-bc77-845f64c1d53b None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:39.276989 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62381d09-f784-4924-bc77-845f64c1d53b None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:39.277284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62381d09-f784-4924-bc77-845f64c1d53b None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:39.277988 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62381d09-f784-4924-bc77-845f64c1d53b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:39.278330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62381d09-f784-4924-bc77-845f64c1d53b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:39.279662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62381d09-f784-4924-bc77-845f64c1d53b None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:39.285104 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 452/914] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 13:40:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:39.292574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:39.292971 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62381d09-f784-4924-bc77-845f64c1d53b None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:39.353467 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96644e66-ca38-4529-81d0-7daa6299bd95 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:39.390740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315778b5-00a2-488a-b0c6-0f87a9f09756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:39.391750 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315778b5-00a2-488a-b0c6-0f87a9f09756 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:39.392334 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315778b5-00a2-488a-b0c6-0f87a9f09756 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:39.392611 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315778b5-00a2-488a-b0c6-0f87a9f09756 None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:39.393951 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315778b5-00a2-488a-b0c6-0f87a9f09756 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:39.394260 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315778b5-00a2-488a-b0c6-0f87a9f09756 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:39.395931 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315778b5-00a2-488a-b0c6-0f87a9f09756 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:39.401309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62381d09-f784-4924-bc77-845f64c1d53b None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:39.413007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 463/915] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:39.413007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f8756-2d53-4b61-8353-2af039b6360c None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:39.413007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f8756-2d53-4b61-8353-2af039b6360c None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:39.413007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f8756-2d53-4b61-8353-2af039b6360c None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:39.413007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 464/916] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:39.416441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f8756-2d53-4b61-8353-2af039b6360c None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:39.445965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaad862-f161-450c-845d-ccb1e70cc0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:39.446672 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaad862-f161-450c-845d-ccb1e70cc0d9 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:39.446965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaad862-f161-450c-845d-ccb1e70cc0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:39.447251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaad862-f161-450c-845d-ccb1e70cc0d9 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:39.447959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaad862-f161-450c-845d-ccb1e70cc0d9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:39.448277 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaad862-f161-450c-845d-ccb1e70cc0d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:39.449678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaad862-f161-450c-845d-ccb1e70cc0d9 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:39.454962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 453/917] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 13:40:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:39.456734 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144fd08-05e6-4dcc-a58b-5108040f5efb None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:39.457024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144fd08-05e6-4dcc-a58b-5108040f5efb None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:39.457329 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144fd08-05e6-4dcc-a58b-5108040f5efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:39.476150 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-2144fd08-05e6-4dcc-a58b-5108040f5efb None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:39.477370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-2144fd08-05e6-4dcc-a58b-5108040f5efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:39.485037 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:39.532120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f8756-2d53-4b61-8353-2af039b6360c None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:39.540480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:39.550567 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 454/918] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:39.560836 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144fd08-05e6-4dcc-a58b-5108040f5efb None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:39.570356 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdf6bb-03e2-4160-b8b5-9bed72eb0dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:39.571020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdf6bb-03e2-4160-b8b5-9bed72eb0dd8 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:39.571357 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdf6bb-03e2-4160-b8b5-9bed72eb0dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:39.571637 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdf6bb-03e2-4160-b8b5-9bed72eb0dd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:39.572862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdf6bb-03e2-4160-b8b5-9bed72eb0dd8 None admin] RBAC: Adding query filter params (role.id=d3712d4d751a4f2f8143138c5280e128, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=135410329e56486c8ccb65b1f2d87aca) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:39.572978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdf6bb-03e2-4160-b8b5-9bed72eb0dd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:39.574399 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdf6bb-03e2-4160-b8b5-9bed72eb0dd8 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:39.580466 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 465/919] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:40:39 2022] GET /identity/v3/role_assignments?user.id=135410329e56486c8ccb65b1f2d87aca&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=d3712d4d751a4f2f8143138c5280e128 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:39.582424 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdf6bb-03e2-4160-b8b5-9bed72eb0dd8 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:39.694971 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144fd08-05e6-4dcc-a58b-5108040f5efb None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:39.733242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdf6bb-03e2-4160-b8b5-9bed72eb0dd8 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:39.744068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25317d20-0fd5-4f7c-919c-908e2d9e1541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:39.744742 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25317d20-0fd5-4f7c-919c-908e2d9e1541 None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:39.745027 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25317d20-0fd5-4f7c-919c-908e2d9e1541 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:39.745330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25317d20-0fd5-4f7c-919c-908e2d9e1541 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:39.746722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25317d20-0fd5-4f7c-919c-908e2d9e1541 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:39.748138 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25317d20-0fd5-4f7c-919c-908e2d9e1541 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:39.765702 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:39.775058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 455/920] 10.222.0.45 () {60 vars in 1144 bytes} [Thu May 26 13:40:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:40:39.808934 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b1d33-b133-414a-8376-c79e5ceaf32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:39.809796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b1d33-b133-414a-8376-c79e5ceaf32c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:39.810076 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b1d33-b133-414a-8376-c79e5ceaf32c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:39.810348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b1d33-b133-414a-8376-c79e5ceaf32c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:39.811051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b1d33-b133-414a-8376-c79e5ceaf32c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:39.812498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b1d33-b133-414a-8376-c79e5ceaf32c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:39.826171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-ec1b1d33-b133-414a-8376-c79e5ceaf32c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 13:40:39.826171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:39.826171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:39.826171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:39.826171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:39.826171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:39.826171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:39.826171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:39.826171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 13:40:39.826171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:39.826171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:39.826171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:39.826171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:39.826171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:39.826171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:39.826171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:39.826171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:39.827446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:39.827446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:39.827446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:39.827446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:39.827446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:39.827446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:39.827446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:39.827446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:39.827446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:39.827446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:39.827446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:39.827446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:39.827446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:39.827446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:39.827446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:39.827446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:39.828494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:39.828494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:39.828494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:39.828494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:39.828494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:39.828494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:39.828494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:39.828494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:39.828494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:39.828494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:39.828494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:39.828494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:39.828494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 13:40:39.828494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:39.828494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 466/921] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:40:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:39.833934 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25317d20-0fd5-4f7c-919c-908e2d9e1541 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:39.949758 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25317d20-0fd5-4f7c-919c-908e2d9e1541 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:39.987030 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fc0ff-2114-4cd2-a624-83133093f91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:39.988144 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fc0ff-2114-4cd2-a624-83133093f91a None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:39.988429 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fc0ff-2114-4cd2-a624-83133093f91a None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:39.988702 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fc0ff-2114-4cd2-a624-83133093f91a None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:39.989441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fc0ff-2114-4cd2-a624-83133093f91a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:39.989745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fc0ff-2114-4cd2-a624-83133093f91a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:39.991186 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fc0ff-2114-4cd2-a624-83133093f91a None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:40.000983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 456/922] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:40:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:40.006326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b1d33-b133-414a-8376-c79e5ceaf32c None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:40.039896 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:40.118614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b1d33-b133-414a-8376-c79e5ceaf32c None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:40.156841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525edcfc-bc89-48e7-9ee5-610c60878503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:40.157543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525edcfc-bc89-48e7-9ee5-610c60878503 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:40.157824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525edcfc-bc89-48e7-9ee5-610c60878503 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:40.158100 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525edcfc-bc89-48e7-9ee5-610c60878503 None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:40.158873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525edcfc-bc89-48e7-9ee5-610c60878503 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:40.159754 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525edcfc-bc89-48e7-9ee5-610c60878503 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:40.162242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525edcfc-bc89-48e7-9ee5-610c60878503 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:40.168556 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 467/923] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 13:40:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:40.174154 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fc0ff-2114-4cd2-a624-83133093f91a None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:40.237606 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:40.282040 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fc0ff-2114-4cd2-a624-83133093f91a None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:40.317721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02a876-a9b8-49f6-9f55-af6309c78366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:40.318623 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02a876-a9b8-49f6-9f55-af6309c78366 None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:40.319097 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02a876-a9b8-49f6-9f55-af6309c78366 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:40.319524 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02a876-a9b8-49f6-9f55-af6309c78366 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:40.320415 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02a876-a9b8-49f6-9f55-af6309c78366 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:40.321942 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02a876-a9b8-49f6-9f55-af6309c78366 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:40.342010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 457/924] 10.222.0.45 () {60 vars in 1144 bytes} [Thu May 26 13:40:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:40:41.374788 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c85bdd-576a-4d6c-9f96-0797f045de02 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:41.375310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c85bdd-576a-4d6c-9f96-0797f045de02 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:41.375410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c85bdd-576a-4d6c-9f96-0797f045de02 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:41.376937 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 468/925] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:41.382481 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac2f37-8d3f-4598-a188-d7f1221e200d None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:41.382890 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac2f37-8d3f-4598-a188-d7f1221e200d None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:41.383054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac2f37-8d3f-4598-a188-d7f1221e200d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:41.402910 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-59ac2f37-8d3f-4598-a188-d7f1221e200d None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:41.404130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-59ac2f37-8d3f-4598-a188-d7f1221e200d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:41.486498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 458/926] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:41.509956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c85bdd-576a-4d6c-9f96-0797f045de02 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:41.614639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:41.623606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c85bdd-576a-4d6c-9f96-0797f045de02 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:41.662259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f8372-3638-45d3-8920-53f1db0a3948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:41.663445 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f8372-3638-45d3-8920-53f1db0a3948 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:41.663974 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f8372-3638-45d3-8920-53f1db0a3948 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:41.664467 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f8372-3638-45d3-8920-53f1db0a3948 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:41.665385 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f8372-3638-45d3-8920-53f1db0a3948 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:41.667013 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f8372-3638-45d3-8920-53f1db0a3948 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:41.680965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-606f8372-3638-45d3-8920-53f1db0a3948 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 13:40:41.680965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:41.680965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:41.680965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:41.680965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:41.680965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:41.680965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:41.680965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:41.680965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 13:40:41.680965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:41.680965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:41.680965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:41.680965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:41.680965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:41.680965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:41.680965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:41.680965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:41.682090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:41.682090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:41.682090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:41.682090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:41.682090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:41.682090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:41.682090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:41.682090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:41.682090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:41.682090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:41.682090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:41.682090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:41.682090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:41.682090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:41.682090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:41.682090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:41.682967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:41.682967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:41.682967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:41.682967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:41.682967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:41.682967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:41.682967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:41.682967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:41.682967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:41.682967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:41.682967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:41.682967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:41.682967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 13:40:41.682967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:41.686609 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 469/927] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 13:40:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:41.692269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac2f37-8d3f-4598-a188-d7f1221e200d None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:41.741712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:41.796242 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac2f37-8d3f-4598-a188-d7f1221e200d None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:41.834537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007cd2b-544a-4cd5-b38c-0fa286a6168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:41.835260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007cd2b-544a-4cd5-b38c-0fa286a6168e None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:41.835547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007cd2b-544a-4cd5-b38c-0fa286a6168e None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:41.835824 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007cd2b-544a-4cd5-b38c-0fa286a6168e None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:41.836587 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007cd2b-544a-4cd5-b38c-0fa286a6168e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:41.836897 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007cd2b-544a-4cd5-b38c-0fa286a6168e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:41.838298 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007cd2b-544a-4cd5-b38c-0fa286a6168e None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:41.841555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac91012-758e-45d7-984a-58b1eec9fdcb None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:41.842069 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac91012-758e-45d7-984a-58b1eec9fdcb None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:41.842579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac91012-758e-45d7-984a-58b1eec9fdcb None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:41.843616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 459/928] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 13:40:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:41.844704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 470/929] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:41.850217 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e96e4b-db94-4fb9-a864-075b0604c517 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:41.850355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac91012-758e-45d7-984a-58b1eec9fdcb None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:41.850454 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e96e4b-db94-4fb9-a864-075b0604c517 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:41.850454 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e96e4b-db94-4fb9-a864-075b0604c517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:41.866776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-26e96e4b-db94-4fb9-a864-075b0604c517 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:41.867964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-26e96e4b-db94-4fb9-a864-075b0604c517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:41.949515 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 460/930] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:41.973223 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e96e4b-db94-4fb9-a864-075b0604c517 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:41.984321 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac91012-758e-45d7-984a-58b1eec9fdcb None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:42.019420 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:42.026239 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a3ede-2d5f-4f46-9d41-f1f8d6900cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:42.027298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a3ede-2d5f-4f46-9d41-f1f8d6900cb1 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:42.027888 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a3ede-2d5f-4f46-9d41-f1f8d6900cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:42.028445 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a3ede-2d5f-4f46-9d41-f1f8d6900cb1 None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:42.029433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a3ede-2d5f-4f46-9d41-f1f8d6900cb1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:42.029945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a3ede-2d5f-4f46-9d41-f1f8d6900cb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:42.031740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a3ede-2d5f-4f46-9d41-f1f8d6900cb1 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:42.043077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 471/931] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 13:40:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:42.044338 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a3ede-2d5f-4f46-9d41-f1f8d6900cb1 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:42.071781 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:42.085826 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e96e4b-db94-4fb9-a864-075b0604c517 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:42.122795 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ac0b0-e576-4d6e-9580-a26253faa9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:42.123138 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac0b0-e576-4d6e-9580-a26253faa9a3 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:42.123345 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac0b0-e576-4d6e-9580-a26253faa9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:42.123611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac0b0-e576-4d6e-9580-a26253faa9a3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:42.135503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ac0b0-e576-4d6e-9580-a26253faa9a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:42.144284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-148ac0b0-e576-4d6e-9580-a26253faa9a3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 13:40:42.144284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:42.144284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:42.144284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:42.144284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:42.144284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:42.144284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:42.144284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:42.144284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:42.144284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:42.144284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:42.144284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:42.144284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:42.144284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:42.144284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:42.144284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:42.145365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:42.145365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:42.145365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:42.145365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:42.145365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:42.145365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:42.145365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:42.145365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:42.145365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:42.145365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:42.145365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:42.145365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:42.145365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:42.145365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:42.145365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:42.145365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:42.146237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:42.146237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:42.146237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:42.146237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:42.146237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:42.146237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:42.146237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:42.146237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:42.146237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:42.146237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:42.146237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 13:40:42.146237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:42.150602 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 461/932] 10.222.0.45 () {56 vars in 1120 bytes} [Thu May 26 13:40:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:42.151536 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ac0b0-e576-4d6e-9580-a26253faa9a3 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:42.161048 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a3ede-2d5f-4f46-9d41-f1f8d6900cb1 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:42.196605 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e6140-eeb2-4edd-bbdd-0911e5df304e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:42.197281 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e6140-eeb2-4edd-bbdd-0911e5df304e None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:42.197579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e6140-eeb2-4edd-bbdd-0911e5df304e None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:42.197862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e6140-eeb2-4edd-bbdd-0911e5df304e None admin] PATH_INFO: `/v3/endpoints` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:42.198650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e6140-eeb2-4edd-bbdd-0911e5df304e None admin] RBAC: Adding query filter params (interface=public, service_id=74d9d2786c004c9a8986d243569c003e, region_id=RegionOne) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:42.198965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e6140-eeb2-4edd-bbdd-0911e5df304e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:42.200367 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e6140-eeb2-4edd-bbdd-0911e5df304e None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:42.209305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 472/933] 10.222.0.45 () {56 vars in 1251 bytes} [Thu May 26 13:40:42 2022] GET /identity/v3/endpoints?service_id=74d9d2786c004c9a8986d243569c003e&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:42.209305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa23327-ff97-4440-9d5f-35a46f28fa0b None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:42.209305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa23327-ff97-4440-9d5f-35a46f28fa0b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:42.209305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa23327-ff97-4440-9d5f-35a46f28fa0b None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:42.209305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 473/934] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:42.214999 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299147bc-9b87-4db5-b507-c6ec8674af0b None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:42.215287 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299147bc-9b87-4db5-b507-c6ec8674af0b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:42.215843 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299147bc-9b87-4db5-b507-c6ec8674af0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:42.233084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-299147bc-9b87-4db5-b507-c6ec8674af0b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:42.234311 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-299147bc-9b87-4db5-b507-c6ec8674af0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:42.260909 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:42.263850 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ac0b0-e576-4d6e-9580-a26253faa9a3 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:42.302187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7419e7-4143-409c-a886-f16603cf91c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:42.302965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7419e7-4143-409c-a886-f16603cf91c7 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:42.303247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7419e7-4143-409c-a886-f16603cf91c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:42.303551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7419e7-4143-409c-a886-f16603cf91c7 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:42.304288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7419e7-4143-409c-a886-f16603cf91c7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:42.304591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7419e7-4143-409c-a886-f16603cf91c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:42.305980 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7419e7-4143-409c-a886-f16603cf91c7 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:42.313305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 474/935] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:42.313305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299147bc-9b87-4db5-b507-c6ec8674af0b None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:42.322019 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 462/936] 10.222.0.45 () {56 vars in 1115 bytes} [Thu May 26 13:40:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:42.326446 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7419e7-4143-409c-a886-f16603cf91c7 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:42.339862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:42.423127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299147bc-9b87-4db5-b507-c6ec8674af0b None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:42.437966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7419e7-4143-409c-a886-f16603cf91c7 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:42.461768 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495706d-2266-46bb-b52c-3028fd5a1ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:42.462359 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495706d-2266-46bb-b52c-3028fd5a1ac8 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:42.462643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495706d-2266-46bb-b52c-3028fd5a1ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:42.462917 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495706d-2266-46bb-b52c-3028fd5a1ac8 None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:42.463603 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495706d-2266-46bb-b52c-3028fd5a1ac8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:42.464973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495706d-2266-46bb-b52c-3028fd5a1ac8 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:42.472556 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 475/937] 10.222.0.45 () {56 vars in 1087 bytes} [Thu May 26 13:40:42 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:40:42.473767 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495706d-2266-46bb-b52c-3028fd5a1ac8 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:42.492725 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a2ee5-b62e-4fe7-b015-e1c085750b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:42.493587 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a2ee5-b62e-4fe7-b015-e1c085750b7f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:42.493871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a2ee5-b62e-4fe7-b015-e1c085750b7f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:42.494148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a2ee5-b62e-4fe7-b015-e1c085750b7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:42.507523 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a2ee5-b62e-4fe7-b015-e1c085750b7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:42.509330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a2ee5-b62e-4fe7-b015-e1c085750b7f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:42.529994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-9a1a2ee5-b62e-4fe7-b015-e1c085750b7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:42.529994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:42.529994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:42.529994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:42.529994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:42.529994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:42.529994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:42.529994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:42.529994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:42.529994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:42.529994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:42.529994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:42.529994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:42.529994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:42.529994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:42.530982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:42.530982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:42.530982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:42.530982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:42.530982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:42.530982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:42.530982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:42.530982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:42.530982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:42.530982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:42.530982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:42.530982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:42.530982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:42.530982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:42.530982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:42.530982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:42.530982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:42.532494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:42.532494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:42.532494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:42.532494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:42.532494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 463/938] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:42.538386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a2ee5-b62e-4fe7-b015-e1c085750b7f None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:42.556054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:42.601318 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:42.629645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495706d-2266-46bb-b52c-3028fd5a1ac8 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:42.657834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a2ee5-b62e-4fe7-b015-e1c085750b7f None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:42.674969 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01423b7-3dd1-489b-92dd-c269dbea0001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:42.676227 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01423b7-3dd1-489b-92dd-c269dbea0001 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:42.676515 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01423b7-3dd1-489b-92dd-c269dbea0001 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:42.676795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01423b7-3dd1-489b-92dd-c269dbea0001 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:42.677496 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01423b7-3dd1-489b-92dd-c269dbea0001 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:42.678889 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01423b7-3dd1-489b-92dd-c269dbea0001 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:42.691783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-e01423b7-3dd1-489b-92dd-c269dbea0001 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 13:40:42.691783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:42.691783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:42.691783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:42.691783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:42.691783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:42.691783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:42.691783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:42.691783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 13:40:42.691783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:42.691783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:42.691783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:42.691783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:42.691783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:42.691783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:42.691783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:42.691783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:42.692796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:42.692796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:42.692796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:42.692796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:42.692796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:42.692796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:42.692796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:42.692796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:42.692796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:42.692796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:42.692796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:42.692796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:42.692796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:42.692796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:42.692796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:42.692796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:42.694808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:42.694808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:42.694808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:42.694808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:42.694808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:42.694808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:42.694808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:42.694808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:42.694808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:42.694808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:42.694808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:42.694808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:42.694808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 13:40:42.694808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:42.695701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 476/939] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:42.697179 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45448353-fd78-4e9a-a8b6-b50622eaf009 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:42.697503 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45448353-fd78-4e9a-a8b6-b50622eaf009 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:42.697894 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45448353-fd78-4e9a-a8b6-b50622eaf009 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:42.699258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 477/940] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:42.700007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45448353-fd78-4e9a-a8b6-b50622eaf009 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:42.703278 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec49734-17bc-4dd1-941c-90dda385f220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:42.703950 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec49734-17bc-4dd1-941c-90dda385f220 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:42.704231 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec49734-17bc-4dd1-941c-90dda385f220 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:42.704508 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec49734-17bc-4dd1-941c-90dda385f220 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:42.705225 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec49734-17bc-4dd1-941c-90dda385f220 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:42.705627 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec49734-17bc-4dd1-941c-90dda385f220 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:42.707002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec49734-17bc-4dd1-941c-90dda385f220 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:42.720665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 464/941] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:42.722780 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e04c4c-fc6a-4865-8fbd-ab0fe3ff90b5 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:42.723066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e04c4c-fc6a-4865-8fbd-ab0fe3ff90b5 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:42.723336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e04c4c-fc6a-4865-8fbd-ab0fe3ff90b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:42.744135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-e1e04c4c-fc6a-4865-8fbd-ab0fe3ff90b5 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:42.745327 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e1e04c4c-fc6a-4865-8fbd-ab0fe3ff90b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:42.820315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 465/942] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:42.820955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e04c4c-fc6a-4865-8fbd-ab0fe3ff90b5 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:42.823399 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:42.829719 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45448353-fd78-4e9a-a8b6-b50622eaf009 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:42.868592 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e53e50-e524-4c3d-b918-6c12093bd012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:42.869166 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e53e50-e524-4c3d-b918-6c12093bd012 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:42.869507 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e53e50-e524-4c3d-b918-6c12093bd012 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:42.869780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e53e50-e524-4c3d-b918-6c12093bd012 None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:42.870493 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e53e50-e524-4c3d-b918-6c12093bd012 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:42.870961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e53e50-e524-4c3d-b918-6c12093bd012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:42.872414 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e53e50-e524-4c3d-b918-6c12093bd012 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:42.882346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 478/943] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 13:40:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:42.882346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e53e50-e524-4c3d-b918-6c12093bd012 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:42.892598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:42.935385 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e04c4c-fc6a-4865-8fbd-ab0fe3ff90b5 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:42.972859 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008094d-2074-43c3-b3a9-4a10fbda804d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:42.973629 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008094d-2074-43c3-b3a9-4a10fbda804d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:42.973910 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008094d-2074-43c3-b3a9-4a10fbda804d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:42.974186 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008094d-2074-43c3-b3a9-4a10fbda804d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:42.981464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008094d-2074-43c3-b3a9-4a10fbda804d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:42.982906 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008094d-2074-43c3-b3a9-4a10fbda804d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:42.988689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e53e50-e524-4c3d-b918-6c12093bd012 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:42.997819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-d008094d-2074-43c3-b3a9-4a10fbda804d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 13:40:42.997819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:42.997819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:42.997819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:42.997819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:42.997819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:42.997819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:42.997819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:42.997819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:42.997819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:42.997819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:42.997819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:42.997819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:42.997819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:42.997819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:42.997819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:42.998811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:42.998811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:42.998811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:42.998811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:42.998811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:42.998811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:42.998811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:42.998811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:42.998811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:42.998811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:42.998811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:42.998811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:42.998811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:42.998811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:42.998811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:42.998811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:42.998811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:42.998811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:42.999782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:42.999782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:42.999782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:42.999782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:42.999782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:42.999782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:42.999782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:42.999782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:42.999782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 13:40:42.999782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:42.999782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 466/944] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 13:40:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:42.999782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008094d-2074-43c3-b3a9-4a10fbda804d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:43.031806 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7a18a-734a-402b-b9d2-8889898d6b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:43.033366 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7a18a-734a-402b-b9d2-8889898d6b9f None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:43.034366 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7a18a-734a-402b-b9d2-8889898d6b9f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:43.034983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7a18a-734a-402b-b9d2-8889898d6b9f None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:43.036189 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7a18a-734a-402b-b9d2-8889898d6b9f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:43.038066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7a18a-734a-402b-b9d2-8889898d6b9f None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:43.040557 dv-cinder-842130-1-smb devstack@keystone.service[91767]: WARNING keystone.server.flask.common [None req-54d7a18a-734a-402b-b9d2-8889898d6b9f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 13:40:43.061627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.sql.core [None req-54d7a18a-734a-402b-b9d2-8889898d6b9f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 13:40:43.061627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 13:40:43.061627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [parameters: {'id': '583282e61c464dfe9c77324e781a11c7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 13:40:43.061627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91767) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 13:40:43.066643 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:43.078035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-54d7a18a-734a-402b-b9d2-8889898d6b9f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 583282e61c464dfe9c77324e781a11c7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 583282e61c464dfe9c77324e781a11c7. May 26 13:40:43.078035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:43.078035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 13:40:43.078035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 13:40:43.078035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 13:40:43.078035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 13:40:43.078035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 13:40:43.078035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application result = self._query(query) May 26 13:40:43.078035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 13:40:43.078035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application conn.query(q) May 26 13:40:43.078035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 13:40:43.078035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 13:40:43.078035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 13:40:43.078938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application result.read() May 26 13:40:43.078938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 13:40:43.078938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 13:40:43.078938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 13:40:43.078938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 13:40:43.078938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 13:40:43.078938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 13:40:43.078938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 13:40:43.078938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 13:40:43.078938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 13:40:43.078938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:43.078938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 13:40:43.078938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:43.078938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:43.078938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 13:40:43.078938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 13:40:43.078938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 13:40:43.078938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 13:40:43.079933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 13:40:43.079933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application next(self.gen) May 26 13:40:43.079933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 13:40:43.079933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application yield resource May 26 13:40:43.079933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 13:40:43.079933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application next(self.gen) May 26 13:40:43.079933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 13:40:43.079933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self.session.rollback() May 26 13:40:43.079933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 13:40:43.079933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self.force_reraise() May 26 13:40:43.079933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 13:40:43.079933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise self.value May 26 13:40:43.079933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 13:40:43.079933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 13:40:43.079933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 13:40:43.079933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application session.commit() May 26 13:40:43.079933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 13:40:43.081468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 13:40:43.081468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 13:40:43.081468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._prepare_impl() May 26 13:40:43.081468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 13:40:43.081468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self.session.flush() May 26 13:40:43.081468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 13:40:43.081468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._flush(objects) May 26 13:40:43.081468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 13:40:43.081468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 13:40:43.081468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 13:40:43.081468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application compat.raise_( May 26 13:40:43.081468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 13:40:43.081468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception May 26 13:40:43.081468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 13:40:43.081468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application flush_context.execute() May 26 13:40:43.081468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 13:40:43.081468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rec.execute(self) May 26 13:40:43.084928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 13:40:43.084928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 13:40:43.084928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 13:40:43.084928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 13:40:43.084928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 13:40:43.084928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 13:40:43.084928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 13:40:43.084928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 13:40:43.084928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 13:40:43.084928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 13:40:43.084928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 13:40:43.084928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 13:40:43.084928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 13:40:43.084928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 13:40:43.084928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 13:40:43.087525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 13:40:43.087525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 13:40:43.087525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception May 26 13:40:43.087525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 13:40:43.087525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 13:40:43.087525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 13:40:43.087525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 13:40:43.087525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 13:40:43.087525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application result = self._query(query) May 26 13:40:43.087525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 13:40:43.087525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application conn.query(q) May 26 13:40:43.087525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 13:40:43.087525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 13:40:43.087525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 13:40:43.087525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application result.read() May 26 13:40:43.087525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 13:40:43.087525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 13:40:43.091115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 13:40:43.091115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 13:40:43.091115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 13:40:43.091115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 13:40:43.091115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 13:40:43.091115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 13:40:43.091115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 13:40:43.091115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 13:40:43.091115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [parameters: {'id': '583282e61c464dfe9c77324e781a11c7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 13:40:43.091115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 13:40:43.091115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:43.091115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:43.091115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:43.091115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:43.091115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 13:40:43.093066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 13:40:43.093066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 13:40:43.093066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 13:40:43.093066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 13:40:43.093066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:43.093066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:43.093066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:43.093066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:43.093066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:43.093066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:43.093066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:43.093066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:43.093066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:43.093066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:43.093066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:43.093066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:43.093066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:43.095607 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:43.095607 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 13:40:43.095607 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 13:40:43.095607 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:43.095607 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:43.095607 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 13:40:43.095607 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 13:40:43.095607 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 583282e61c464dfe9c77324e781a11c7. May 26 13:40:43.095607 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:43.095607 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 479/945] 10.222.0.45 () {60 vars in 1140 bytes} [Thu May 26 13:40:42 2022] POST /identity/v3/projects => generated 262 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:43.095607 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7a18a-734a-402b-b9d2-8889898d6b9f None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:43.108347 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008094d-2074-43c3-b3a9-4a10fbda804d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:43.148929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888b094-64a9-4544-94cc-2503a89b8f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:43.149614 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888b094-64a9-4544-94cc-2503a89b8f8e None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:43.149894 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888b094-64a9-4544-94cc-2503a89b8f8e None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:43.150173 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888b094-64a9-4544-94cc-2503a89b8f8e None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:43.150853 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888b094-64a9-4544-94cc-2503a89b8f8e None admin] RBAC: Adding query filter params (type=compute) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:43.151154 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888b094-64a9-4544-94cc-2503a89b8f8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:43.152496 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888b094-64a9-4544-94cc-2503a89b8f8e None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:43.157078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 467/946] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 13:40:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:43.158788 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:43.170484 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888b094-64a9-4544-94cc-2503a89b8f8e None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:43.206681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7a18a-734a-402b-b9d2-8889898d6b9f None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:43.247014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef528d-fc7c-4c8c-994f-7716365d916a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:43.247968 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef528d-fc7c-4c8c-994f-7716365d916a None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:43.247968 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef528d-fc7c-4c8c-994f-7716365d916a None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:43.248143 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef528d-fc7c-4c8c-994f-7716365d916a None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:43.248980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef528d-fc7c-4c8c-994f-7716365d916a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:43.249346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef528d-fc7c-4c8c-994f-7716365d916a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:43.251026 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef528d-fc7c-4c8c-994f-7716365d916a None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:43.276907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 480/947] 10.222.0.45 () {56 vars in 1149 bytes} [Thu May 26 13:40:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:43.282381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef528d-fc7c-4c8c-994f-7716365d916a None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:43.330925 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888b094-64a9-4544-94cc-2503a89b8f8e None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:43.369981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:43.389223 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac1f9c-7fbc-46fb-b3df-5d2b9e078544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:43.390042 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac1f9c-7fbc-46fb-b3df-5d2b9e078544 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:43.390324 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac1f9c-7fbc-46fb-b3df-5d2b9e078544 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:43.390598 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac1f9c-7fbc-46fb-b3df-5d2b9e078544 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:43.401249 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac1f9c-7fbc-46fb-b3df-5d2b9e078544 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:43.402716 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac1f9c-7fbc-46fb-b3df-5d2b9e078544 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:43.403132 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef528d-fc7c-4c8c-994f-7716365d916a None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:43.421209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-f4ac1f9c-7fbc-46fb-b3df-5d2b9e078544 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:43.421209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:43.421209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:43.421209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:43.421209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:43.421209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:43.421209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:43.421209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:43.421209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:43.421209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:43.421209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:43.421209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:43.421209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:43.421209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:43.421209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:43.422196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:43.422196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:43.422196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:43.422196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:43.422196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:43.422196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:43.422196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:43.422196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:43.422196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:43.422196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:43.422196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:43.422196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:43.422196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:43.422196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:43.422196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:43.422196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:43.422196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:43.423763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:43.423763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:43.423763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:43.423763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:43.423763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:43.423763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:43.423763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:43.423763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:43.423763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 468/948] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:43.429424 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac1f9c-7fbc-46fb-b3df-5d2b9e078544 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:43.432857 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:43.448645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d52a38-cf32-453a-af15-aa9a00dc69a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:43.449761 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d52a38-cf32-453a-af15-aa9a00dc69a6 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:43.450255 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d52a38-cf32-453a-af15-aa9a00dc69a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:43.450744 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d52a38-cf32-453a-af15-aa9a00dc69a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:43.469691 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d52a38-cf32-453a-af15-aa9a00dc69a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:43.472214 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d52a38-cf32-453a-af15-aa9a00dc69a6 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:43.491684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-a7d52a38-cf32-453a-af15-aa9a00dc69a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:43.491684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:43.491684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:43.491684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:43.491684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:43.491684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:43.491684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:43.491684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:43.491684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:43.491684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:43.491684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:43.491684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:43.491684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:43.491684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:43.491684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:43.492620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:43.492620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:43.492620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:43.492620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:43.492620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:43.492620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:43.492620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:43.492620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:43.492620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:43.492620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:43.492620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:43.492620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:43.492620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:43.492620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:43.492620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:43.492620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:43.492620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:43.493574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:43.493574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:43.493574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:43.493574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:43.499951 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 481/949] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:43.501480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d52a38-cf32-453a-af15-aa9a00dc69a6 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:43.553436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac1f9c-7fbc-46fb-b3df-5d2b9e078544 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:43.588529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fea96-77c4-4f83-a413-ee24308792d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:43.589550 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fea96-77c4-4f83-a413-ee24308792d6 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:43.590056 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fea96-77c4-4f83-a413-ee24308792d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:43.590526 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fea96-77c4-4f83-a413-ee24308792d6 None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:43.591476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fea96-77c4-4f83-a413-ee24308792d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:43.591977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fea96-77c4-4f83-a413-ee24308792d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:43.593625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fea96-77c4-4f83-a413-ee24308792d6 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:43.613037 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 469/950] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 13:40:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:43.638227 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d52a38-cf32-453a-af15-aa9a00dc69a6 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:43.688858 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f538f-c256-4e9d-97fc-be11dc1432c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:43.689571 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f538f-c256-4e9d-97fc-be11dc1432c2 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:43.689888 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f538f-c256-4e9d-97fc-be11dc1432c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:43.690169 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f538f-c256-4e9d-97fc-be11dc1432c2 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:43.690912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f538f-c256-4e9d-97fc-be11dc1432c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:43.691220 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f538f-c256-4e9d-97fc-be11dc1432c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:43.692644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f538f-c256-4e9d-97fc-be11dc1432c2 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:43.706362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 482/951] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:43.712285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fea96-77c4-4f83-a413-ee24308792d6 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:43.767260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:43.826287 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fea96-77c4-4f83-a413-ee24308792d6 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:43.864306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fafd6-a4df-4c84-9fc4-4f734d51da3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:43.865186 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fafd6-a4df-4c84-9fc4-4f734d51da3f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:43.865496 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fafd6-a4df-4c84-9fc4-4f734d51da3f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:43.865771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fafd6-a4df-4c84-9fc4-4f734d51da3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:43.873729 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fafd6-a4df-4c84-9fc4-4f734d51da3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:43.875261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fafd6-a4df-4c84-9fc4-4f734d51da3f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:43.890203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-c44fafd6-a4df-4c84-9fc4-4f734d51da3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:43.890203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:43.890203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:43.890203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:43.890203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:43.890203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:43.890203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:43.890203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:43.890203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:43.890203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:43.890203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:43.890203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:43.890203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:43.890203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:43.890203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:43.891270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:43.891270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:43.891270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:43.891270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:43.891270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:43.891270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:43.891270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:43.891270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:43.891270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:43.891270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:43.891270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:43.891270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:43.891270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:43.891270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:43.891270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:43.891270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:43.891270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:43.892378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:43.892378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:43.892378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:43.892378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:43.892378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:43.892378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:43.892378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:43.892378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:43.892378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 470/952] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:43.899100 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f538f-c256-4e9d-97fc-be11dc1432c2 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:43.935196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:44.006106 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f538f-c256-4e9d-97fc-be11dc1432c2 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:44.041044 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16280942-7b19-4c57-9d2b-964d1bbfdf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:44.041742 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16280942-7b19-4c57-9d2b-964d1bbfdf5f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:44.042303 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16280942-7b19-4c57-9d2b-964d1bbfdf5f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:44.042650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16280942-7b19-4c57-9d2b-964d1bbfdf5f None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:44.043506 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16280942-7b19-4c57-9d2b-964d1bbfdf5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:44.043886 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16280942-7b19-4c57-9d2b-964d1bbfdf5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:44.045389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16280942-7b19-4c57-9d2b-964d1bbfdf5f None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:44.058504 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 483/953] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:44.064335 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fafd6-a4df-4c84-9fc4-4f734d51da3f None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:44.167219 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fafd6-a4df-4c84-9fc4-4f734d51da3f None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:44.175255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:44.206366 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843e2c4-d646-42c9-9594-aa4307a6968d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:44.207489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843e2c4-d646-42c9-9594-aa4307a6968d None admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:44.207938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843e2c4-d646-42c9-9594-aa4307a6968d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:44.208369 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843e2c4-d646-42c9-9594-aa4307a6968d None admin] PATH_INFO: `/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/135410329e56486c8ccb65b1f2d87aca/roles/d3712d4d751a4f2f8143138c5280e128` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:44.210751 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843e2c4-d646-42c9-9594-aa4307a6968d None admin] RBAC: Authorizing `identity:create_grant(project_id=095d02b8a79c4915ac8d3c5b81e195a4, user_id=135410329e56486c8ccb65b1f2d87aca, role_id=d3712d4d751a4f2f8143138c5280e128)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:44.212311 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843e2c4-d646-42c9-9594-aa4307a6968d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:44.233634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 471/954] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:40:44 2022] PUT /identity/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/135410329e56486c8ccb65b1f2d87aca/roles/d3712d4d751a4f2f8143138c5280e128 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:40:44.855159 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd4a1c-aa15-40f4-9a57-5a6b35f55eef None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:44.855678 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd4a1c-aa15-40f4-9a57-5a6b35f55eef None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:44.855952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd4a1c-aa15-40f4-9a57-5a6b35f55eef None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:44.857729 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 484/955] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:44.865146 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44330b9b-1660-4f56-b7b5-d92945932b1a None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:44.865593 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44330b9b-1660-4f56-b7b5-d92945932b1a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:44.865931 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44330b9b-1660-4f56-b7b5-d92945932b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:44.883957 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-44330b9b-1660-4f56-b7b5-d92945932b1a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:44.885298 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-44330b9b-1660-4f56-b7b5-d92945932b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:44.954559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 472/956] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:44.977039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd4a1c-aa15-40f4-9a57-5a6b35f55eef None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:45.081495 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd4a1c-aa15-40f4-9a57-5a6b35f55eef None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:45.084341 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:45.117949 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db796d29-f7cc-4c5f-bb09-e5f3f363a630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:45.118753 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db796d29-f7cc-4c5f-bb09-e5f3f363a630 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:45.119035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db796d29-f7cc-4c5f-bb09-e5f3f363a630 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:45.119314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db796d29-f7cc-4c5f-bb09-e5f3f363a630 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:45.119963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db796d29-f7cc-4c5f-bb09-e5f3f363a630 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:45.121327 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db796d29-f7cc-4c5f-bb09-e5f3f363a630 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:45.133310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-db796d29-f7cc-4c5f-bb09-e5f3f363a630 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 13:40:45.133310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:45.133310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:45.133310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:45.133310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:45.133310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:45.133310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:45.133310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:45.133310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 13:40:45.133310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:45.133310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:45.133310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:45.133310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:45.133310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:45.133310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:45.133310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:45.133310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:45.134676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:45.134676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:45.134676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:45.134676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:45.134676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:45.134676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:45.134676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:45.134676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:45.134676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:45.134676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:45.134676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:45.134676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:45.134676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:45.134676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:45.134676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:45.134676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:45.136210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:45.136210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:45.136210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:45.136210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:45.136210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:45.136210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:45.136210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:45.136210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:45.136210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:45.136210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:45.136210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:45.136210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:45.136210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 13:40:45.136210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:45.136210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 485/957] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 13:40:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:45.140996 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44330b9b-1660-4f56-b7b5-d92945932b1a None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:45.236455 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:45.246400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44330b9b-1660-4f56-b7b5-d92945932b1a None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:45.285220 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68301f97-50e4-4746-abb5-39d27d8a9510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:45.286291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68301f97-50e4-4746-abb5-39d27d8a9510 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:45.286774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68301f97-50e4-4746-abb5-39d27d8a9510 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:45.287261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68301f97-50e4-4746-abb5-39d27d8a9510 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:45.288157 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68301f97-50e4-4746-abb5-39d27d8a9510 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:45.288668 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68301f97-50e4-4746-abb5-39d27d8a9510 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:45.290272 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68301f97-50e4-4746-abb5-39d27d8a9510 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:45.295734 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 473/958] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 13:40:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:45.301726 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db796d29-f7cc-4c5f-bb09-e5f3f363a630 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:45.405784 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db796d29-f7cc-4c5f-bb09-e5f3f363a630 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:45.440017 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dd10f-f363-4c0f-9b88-cf1b411da0e6 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:45.440331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dd10f-f363-4c0f-9b88-cf1b411da0e6 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:45.440567 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dd10f-f363-4c0f-9b88-cf1b411da0e6 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:45.442232 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 474/959] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:45.447395 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba1529-ceb1-4d6b-a028-f5f0fc888613 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:45.447682 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba1529-ceb1-4d6b-a028-f5f0fc888613 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:45.447955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba1529-ceb1-4d6b-a028-f5f0fc888613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:45.448321 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e5ea6-fbc8-4008-bb33-9992ceba7395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:45.448993 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e5ea6-fbc8-4008-bb33-9992ceba7395 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:45.449463 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e5ea6-fbc8-4008-bb33-9992ceba7395 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:45.449838 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e5ea6-fbc8-4008-bb33-9992ceba7395 None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:45.450665 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e5ea6-fbc8-4008-bb33-9992ceba7395 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:45.450974 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e5ea6-fbc8-4008-bb33-9992ceba7395 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:45.452441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e5ea6-fbc8-4008-bb33-9992ceba7395 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:45.459124 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 486/960] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 13:40:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:45.464691 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e5ea6-fbc8-4008-bb33-9992ceba7395 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:45.466839 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-51ba1529-ceb1-4d6b-a028-f5f0fc888613 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:45.468092 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-51ba1529-ceb1-4d6b-a028-f5f0fc888613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:45.494647 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:45.549032 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 475/961] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 13:40:45.571604 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba1529-ceb1-4d6b-a028-f5f0fc888613 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:45.582022 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e5ea6-fbc8-4008-bb33-9992ceba7395 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:45.618412 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388166c1-3288-43e3-aa77-e7258bc66396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:45.619079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388166c1-3288-43e3-aa77-e7258bc66396 None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:45.619363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388166c1-3288-43e3-aa77-e7258bc66396 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:45.619642 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388166c1-3288-43e3-aa77-e7258bc66396 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:45.620507 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388166c1-3288-43e3-aa77-e7258bc66396 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:45.622027 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388166c1-3288-43e3-aa77-e7258bc66396 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:45.649353 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 487/962] 10.222.0.45 () {60 vars in 1144 bytes} [Thu May 26 13:40:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:40:45.698262 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:45.710618 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba1529-ceb1-4d6b-a028-f5f0fc888613 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:45.761853 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238536bd-be19-4593-ad2a-8bec9d63b936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:45.762437 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238536bd-be19-4593-ad2a-8bec9d63b936 None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:45.762722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238536bd-be19-4593-ad2a-8bec9d63b936 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:45.762999 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238536bd-be19-4593-ad2a-8bec9d63b936 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:45.763734 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238536bd-be19-4593-ad2a-8bec9d63b936 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:45.765211 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238536bd-be19-4593-ad2a-8bec9d63b936 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:45.781011 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 476/963] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 13:40:45 2022] POST /identity/v3/services => generated 242 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:40:45.933875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a976b-426c-48c3-aaa6-0ea0cbc0deee None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:45.934434 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a976b-426c-48c3-aaa6-0ea0cbc0deee None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:45.934434 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a976b-426c-48c3-aaa6-0ea0cbc0deee None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:45.936062 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 488/964] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:45.942556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748d0bb-5340-4f15-b1d9-13a6db44b6c3 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:45.943093 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748d0bb-5340-4f15-b1d9-13a6db44b6c3 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:45.943093 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748d0bb-5340-4f15-b1d9-13a6db44b6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:45.961211 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-d748d0bb-5340-4f15-b1d9-13a6db44b6c3 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:45.962455 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-d748d0bb-5340-4f15-b1d9-13a6db44b6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:46.047109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 477/965] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:46.071700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a976b-426c-48c3-aaa6-0ea0cbc0deee None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:46.155262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:46.180069 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a976b-426c-48c3-aaa6-0ea0cbc0deee None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:46.219825 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db79cb9-9d40-42d5-95f9-2a61e2a05001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:46.220518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db79cb9-9d40-42d5-95f9-2a61e2a05001 None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:46.220805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db79cb9-9d40-42d5-95f9-2a61e2a05001 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:46.221120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db79cb9-9d40-42d5-95f9-2a61e2a05001 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:46.221874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db79cb9-9d40-42d5-95f9-2a61e2a05001 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:46.223324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db79cb9-9d40-42d5-95f9-2a61e2a05001 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:46.237697 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.sql.core [None req-3db79cb9-9d40-42d5-95f9-2a61e2a05001 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 13:40:46.237697 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 13:40:46.237697 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [parameters: {'user_id': 'e4e05a23d7a84b968ccedb357ed0cb4e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 13:40:46.237697 dv-cinder-842130-1-smb devstack@keystone.service[91767]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91767) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 13:40:46.245544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-3db79cb9-9d40-42d5-95f9-2a61e2a05001 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 13:40:46.245544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:46.245544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 13:40:46.245544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 13:40:46.245544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 13:40:46.245544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 13:40:46.245544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 13:40:46.245544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application result = self._query(query) May 26 13:40:46.245544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 13:40:46.245544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application conn.query(q) May 26 13:40:46.245544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 13:40:46.245544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 13:40:46.245544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 13:40:46.245544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application result.read() May 26 13:40:46.245544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 13:40:46.246408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 13:40:46.246408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 13:40:46.246408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 13:40:46.246408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 13:40:46.246408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 13:40:46.246408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 13:40:46.246408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 13:40:46.246408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 13:40:46.246408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:46.246408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 13:40:46.246408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:46.246408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:46.246408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 13:40:46.246408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 13:40:46.246408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 13:40:46.246408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 13:40:46.246408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 13:40:46.246408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application next(self.gen) May 26 13:40:46.247368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 13:40:46.247368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application yield resource May 26 13:40:46.247368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 13:40:46.247368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application next(self.gen) May 26 13:40:46.247368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 13:40:46.247368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self.session.rollback() May 26 13:40:46.247368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 13:40:46.247368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self.force_reraise() May 26 13:40:46.247368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 13:40:46.247368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise self.value May 26 13:40:46.247368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 13:40:46.247368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 13:40:46.247368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 13:40:46.247368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application session.commit() May 26 13:40:46.247368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 13:40:46.247368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 13:40:46.247368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 13:40:46.248304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._prepare_impl() May 26 13:40:46.248304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 13:40:46.248304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self.session.flush() May 26 13:40:46.248304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 13:40:46.248304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._flush(objects) May 26 13:40:46.248304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 13:40:46.248304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 13:40:46.248304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 13:40:46.248304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application compat.raise_( May 26 13:40:46.248304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 13:40:46.248304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception May 26 13:40:46.248304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 13:40:46.248304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application flush_context.execute() May 26 13:40:46.248304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 13:40:46.248304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rec.execute(self) May 26 13:40:46.248304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 13:40:46.248304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 13:40:46.249218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 13:40:46.249218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 13:40:46.249218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 13:40:46.249218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 13:40:46.249218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 13:40:46.249218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 13:40:46.249218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 13:40:46.249218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 13:40:46.249218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 13:40:46.249218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 13:40:46.249218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 13:40:46.249218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 13:40:46.249218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 13:40:46.249218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 13:40:46.249218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 13:40:46.249218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception May 26 13:40:46.250127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 13:40:46.250127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 13:40:46.250127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 13:40:46.250127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 13:40:46.250127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 13:40:46.250127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application result = self._query(query) May 26 13:40:46.250127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 13:40:46.250127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application conn.query(q) May 26 13:40:46.250127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 13:40:46.250127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 13:40:46.250127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 13:40:46.250127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application result.read() May 26 13:40:46.250127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 13:40:46.250127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 13:40:46.250127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 13:40:46.250127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 13:40:46.250980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 13:40:46.250980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 13:40:46.250980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 13:40:46.250980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 13:40:46.250980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 13:40:46.250980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 13:40:46.250980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e4e05a23d7a84b968ccedb357ed0cb4e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 13:40:46.250980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 13:40:46.250980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:46.250980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:46.250980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:46.250980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:46.250980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:46.250980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:46.250980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:46.251792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:46.251792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:46.251792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:46.251792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:46.251792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:46.251792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:46.251792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:46.251792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 13:40:46.251792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 13:40:46.251792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:46.251792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:46.251792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:46.251792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:46.251792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:46.251792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:46.251792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 13:40:46.251792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 13:40:46.259088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 13:40:46.259088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 13:40:46.259088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 13:40:46.259088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 13:40:46.259088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 13:40:46.259088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:46.259088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 489/966] 10.222.0.45 () {60 vars in 1131 bytes} [Thu May 26 13:40:46 2022] POST /identity/v3/users => generated 160 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:46.260091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748d0bb-5340-4f15-b1d9-13a6db44b6c3 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:46.329045 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:46.360003 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748d0bb-5340-4f15-b1d9-13a6db44b6c3 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:46.395234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1b151-dca2-4b04-9c25-6f18bb8ddacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:46.396025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1b151-dca2-4b04-9c25-6f18bb8ddacc None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:46.396303 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1b151-dca2-4b04-9c25-6f18bb8ddacc None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:46.396577 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1b151-dca2-4b04-9c25-6f18bb8ddacc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:46.403943 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1b151-dca2-4b04-9c25-6f18bb8ddacc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:46.405489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1b151-dca2-4b04-9c25-6f18bb8ddacc None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:46.420044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-d8a1b151-dca2-4b04-9c25-6f18bb8ddacc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 13:40:46.420044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:46.420044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:46.420044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:46.420044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:46.420044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:46.420044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:46.420044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:46.420044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:46.420044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:46.420044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:46.420044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:46.420044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:46.420044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:46.420044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:46.420044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:46.422477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:46.422477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:46.422477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:46.422477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:46.422477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:46.422477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:46.422477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:46.422477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:46.422477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:46.422477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:46.422477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:46.422477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:46.422477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:46.422477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:46.422477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:46.422477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:46.422477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:46.422477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:46.428304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:46.428304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:46.428304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:46.428304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:46.428304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:46.428304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:46.428304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:46.428304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:46.428304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 13:40:46.428304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:46.428304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 478/967] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:40:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:46.429332 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db79cb9-9d40-42d5-95f9-2a61e2a05001 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:46.541991 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db79cb9-9d40-42d5-95f9-2a61e2a05001 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:46.578562 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fd81a-0f62-4267-a992-602700f31776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:46.579283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fd81a-0f62-4267-a992-602700f31776 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:46.579506 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fd81a-0f62-4267-a992-602700f31776 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:46.579782 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fd81a-0f62-4267-a992-602700f31776 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:46.580583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fd81a-0f62-4267-a992-602700f31776 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:46.580887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fd81a-0f62-4267-a992-602700f31776 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:46.582535 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fd81a-0f62-4267-a992-602700f31776 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:46.608363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:46.629721 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 490/968] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 13:40:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:46.645947 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124c73e-3b4e-4a00-888b-cd02e47ae7d4 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:46.645947 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124c73e-3b4e-4a00-888b-cd02e47ae7d4 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:46.645947 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124c73e-3b4e-4a00-888b-cd02e47ae7d4 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:46.646862 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 479/969] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:46.652962 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fd445-b12a-4517-a473-ff3114d69c26 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:46.653260 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fd445-b12a-4517-a473-ff3114d69c26 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:46.653550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fd445-b12a-4517-a473-ff3114d69c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:46.683438 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-767fd445-b12a-4517-a473-ff3114d69c26 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:46.685049 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-767fd445-b12a-4517-a473-ff3114d69c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:46.759271 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 491/970] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:46.782635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124c73e-3b4e-4a00-888b-cd02e47ae7d4 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:46.894817 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124c73e-3b4e-4a00-888b-cd02e47ae7d4 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:46.930676 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:46.941004 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175b3b1-0d1e-4192-b5f5-dedca37aac26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:46.941900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175b3b1-0d1e-4192-b5f5-dedca37aac26 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:46.942179 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175b3b1-0d1e-4192-b5f5-dedca37aac26 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:46.942452 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175b3b1-0d1e-4192-b5f5-dedca37aac26 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:46.954984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175b3b1-0d1e-4192-b5f5-dedca37aac26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:46.963238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-d175b3b1-0d1e-4192-b5f5-dedca37aac26 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 13:40:46.963238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:46.963238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:46.963238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:46.963238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:46.963238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:46.963238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:46.963238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:46.963238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:46.963238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:46.963238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:46.963238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:46.963238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:46.963238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:46.963238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:46.963238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:46.964202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:46.964202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:46.964202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:46.964202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:46.964202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:46.964202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:46.964202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:46.964202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:46.964202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:46.964202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:46.964202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:46.964202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:46.964202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:46.964202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:46.964202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:46.964202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:46.965089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:46.965089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:46.965089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:46.965089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:46.965089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:46.965089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:46.965089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:46.965089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:46.965089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:46.965089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:46.965089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 13:40:46.965089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:46.965089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 480/971] 10.222.0.45 () {56 vars in 1120 bytes} [Thu May 26 13:40:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:46.971701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fd445-b12a-4517-a473-ff3114d69c26 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:47.074415 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fd445-b12a-4517-a473-ff3114d69c26 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:47.102061 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:47.110895 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e881998-a89f-4a90-b2c5-3667f7896e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:47.111580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881998-a89f-4a90-b2c5-3667f7896e24 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:47.111863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881998-a89f-4a90-b2c5-3667f7896e24 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:47.112134 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881998-a89f-4a90-b2c5-3667f7896e24 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:47.112872 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e881998-a89f-4a90-b2c5-3667f7896e24 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:47.113174 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e881998-a89f-4a90-b2c5-3667f7896e24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:47.114544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e881998-a89f-4a90-b2c5-3667f7896e24 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:47.126911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 492/972] 10.222.0.45 () {56 vars in 1115 bytes} [Thu May 26 13:40:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:47.128066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175b3b1-0d1e-4192-b5f5-dedca37aac26 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:47.226903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175b3b1-0d1e-4192-b5f5-dedca37aac26 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:47.259756 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f0e8f-d783-4944-a0bb-99c6cfccf46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:47.260536 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f0e8f-d783-4944-a0bb-99c6cfccf46d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:47.260814 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f0e8f-d783-4944-a0bb-99c6cfccf46d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:47.261086 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f0e8f-d783-4944-a0bb-99c6cfccf46d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:47.271413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f0e8f-d783-4944-a0bb-99c6cfccf46d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:47.272854 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f0e8f-d783-4944-a0bb-99c6cfccf46d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:47.290121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-293f0e8f-d783-4944-a0bb-99c6cfccf46d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:47.290121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:47.290121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:47.290121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:47.290121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:47.290121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:47.290121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:47.290121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:47.290121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:47.290121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:47.290121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:47.290121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:47.290121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:47.290121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:47.290121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:47.291016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:47.291016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:47.291016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:47.291016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:47.291016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:47.291016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:47.291016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:47.291016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:47.291016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:47.291016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:47.291016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:47.291016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:47.291016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:47.291016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:47.291016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:47.291016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:47.291016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:47.298308 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:47.298308 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:47.298308 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:47.298308 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:47.298308 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 481/973] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:47.298665 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e881998-a89f-4a90-b2c5-3667f7896e24 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:47.396800 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e881998-a89f-4a90-b2c5-3667f7896e24 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:47.430434 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fac78-f23a-4591-87c1-49b81e213302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:47.431092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fac78-f23a-4591-87c1-49b81e213302 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:47.431374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fac78-f23a-4591-87c1-49b81e213302 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:47.431649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fac78-f23a-4591-87c1-49b81e213302 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:47.432366 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fac78-f23a-4591-87c1-49b81e213302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:47.432670 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fac78-f23a-4591-87c1-49b81e213302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:47.434042 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fac78-f23a-4591-87c1-49b81e213302 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:47.451048 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 493/974] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:47.452201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f0e8f-d783-4944-a0bb-99c6cfccf46d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:47.498152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:47.555140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f0e8f-d783-4944-a0bb-99c6cfccf46d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:47.588630 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69eb280-cb9b-4f35-aec1-05995c7231c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:47.589476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eb280-cb9b-4f35-aec1-05995c7231c5 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:47.589761 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eb280-cb9b-4f35-aec1-05995c7231c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:47.590037 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eb280-cb9b-4f35-aec1-05995c7231c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:47.597760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69eb280-cb9b-4f35-aec1-05995c7231c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:47.599212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69eb280-cb9b-4f35-aec1-05995c7231c5 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:47.614371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-a69eb280-cb9b-4f35-aec1-05995c7231c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 13:40:47.614371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:47.614371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:47.614371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:47.614371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:47.614371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:47.614371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:47.614371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:47.614371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:47.614371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:47.614371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:47.614371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:47.614371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:47.614371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:47.614371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:47.614371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:47.615330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:47.615330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:47.615330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:47.615330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:47.615330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:47.615330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:47.615330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:47.615330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:47.615330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:47.615330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:47.615330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:47.615330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:47.615330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:47.615330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:47.615330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:47.615330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:47.615330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:47.615330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:47.621371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:47.621371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:47.621371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:47.621371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:47.621371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:47.621371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:47.621371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:47.621371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:47.621371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 13:40:47.621371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:47.621371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 482/975] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 13:40:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:47.621992 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fac78-f23a-4591-87c1-49b81e213302 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:47.680136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:47.732506 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fac78-f23a-4591-87c1-49b81e213302 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:47.766630 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edab02-e538-4a29-b87a-89fc98c2f432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:47.767210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edab02-e538-4a29-b87a-89fc98c2f432 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:47.767487 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edab02-e538-4a29-b87a-89fc98c2f432 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:47.768303 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edab02-e538-4a29-b87a-89fc98c2f432 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:47.769126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edab02-e538-4a29-b87a-89fc98c2f432 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:47.769460 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edab02-e538-4a29-b87a-89fc98c2f432 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:47.770860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edab02-e538-4a29-b87a-89fc98c2f432 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:47.792393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 494/976] 10.222.0.45 () {56 vars in 1149 bytes} [Thu May 26 13:40:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:47.793766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69eb280-cb9b-4f35-aec1-05995c7231c5 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:47.904612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69eb280-cb9b-4f35-aec1-05995c7231c5 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:47.906956 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:47.940108 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565a8de-97c9-4b5e-acca-10124df1ad77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:47.940766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565a8de-97c9-4b5e-acca-10124df1ad77 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:47.941047 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565a8de-97c9-4b5e-acca-10124df1ad77 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:47.941352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565a8de-97c9-4b5e-acca-10124df1ad77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:47.996348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d0667-370e-42a5-9e76-ebb0566f642a None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:47.996878 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d0667-370e-42a5-9e76-ebb0566f642a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:47.996878 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d0667-370e-42a5-9e76-ebb0566f642a None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:47.998298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 495/977] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:40:48.003268 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d223fdc-9a34-41c2-a69d-f90dbdfbadab None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:48.003554 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d223fdc-9a34-41c2-a69d-f90dbdfbadab None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:48.003829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d223fdc-9a34-41c2-a69d-f90dbdfbadab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:48.012395 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565a8de-97c9-4b5e-acca-10124df1ad77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:48.013891 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565a8de-97c9-4b5e-acca-10124df1ad77 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:48.020344 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-5d223fdc-9a34-41c2-a69d-f90dbdfbadab None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:48.021480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-5d223fdc-9a34-41c2-a69d-f90dbdfbadab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:48.094623 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 496/978] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:48.096494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0093b-2f6b-432e-a098-b5db9409b2d8 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:48.096780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0093b-2f6b-432e-a098-b5db9409b2d8 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:48.097060 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0093b-2f6b-432e-a098-b5db9409b2d8 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:48.098524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 497/979] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:48.103759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa414238-c5ae-4f88-8830-26b4eb1f1cba None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:48.104047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa414238-c5ae-4f88-8830-26b4eb1f1cba None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:48.104329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa414238-c5ae-4f88-8830-26b4eb1f1cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:48.119560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 483/980] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:40:47 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 13:40:48.119560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565a8de-97c9-4b5e-acca-10124df1ad77 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:48.121364 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:48.121578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-fa414238-c5ae-4f88-8830-26b4eb1f1cba None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:48.122953 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-fa414238-c5ae-4f88-8830-26b4eb1f1cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:48.151741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:48.188929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 498/981] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:48.189883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa414238-c5ae-4f88-8830-26b4eb1f1cba None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:48.218873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565a8de-97c9-4b5e-acca-10124df1ad77 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:48.253123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b816f15-e689-4ffe-8d03-ebf9a560cd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:48.253939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b816f15-e689-4ffe-8d03-ebf9a560cd32 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:48.254225 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b816f15-e689-4ffe-8d03-ebf9a560cd32 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:48.254485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b816f15-e689-4ffe-8d03-ebf9a560cd32 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:48.255113 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b816f15-e689-4ffe-8d03-ebf9a560cd32 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:48.256458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b816f15-e689-4ffe-8d03-ebf9a560cd32 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:48.268338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-0b816f15-e689-4ffe-8d03-ebf9a560cd32 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 13:40:48.268338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:48.268338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:48.268338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:48.268338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:48.268338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:48.268338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:48.268338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:48.268338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 13:40:48.268338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:48.268338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:48.268338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:48.268338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:48.268338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:48.268338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:48.268338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:48.268338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:48.269553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:48.269553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:48.269553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:48.269553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:48.269553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:48.269553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:48.269553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:48.269553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:48.269553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:48.269553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:48.269553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:48.269553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:48.269553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:48.269553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:48.269553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:48.269553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:48.270626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:48.270626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:48.270626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:48.270626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:48.270626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:48.270626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:48.270626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:48.270626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:48.270626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:48.270626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:48.270626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:48.270626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:48.270626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 13:40:48.270626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:48.270626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 484/982] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 13:40:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:48.271456 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b816f15-e689-4ffe-8d03-ebf9a560cd32 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:48.291080 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa414238-c5ae-4f88-8830-26b4eb1f1cba None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:48.325794 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31d76f-6eb0-4b78-8b42-2906d14cf81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:48.326571 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31d76f-6eb0-4b78-8b42-2906d14cf81f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:48.326850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31d76f-6eb0-4b78-8b42-2906d14cf81f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:48.327122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31d76f-6eb0-4b78-8b42-2906d14cf81f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:48.335798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:48.337757 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31d76f-6eb0-4b78-8b42-2906d14cf81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:48.339181 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31d76f-6eb0-4b78-8b42-2906d14cf81f None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:48.357787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-4d31d76f-6eb0-4b78-8b42-2906d14cf81f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:48.357787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:48.357787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:48.357787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:48.357787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:48.357787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:48.357787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:48.357787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:48.357787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:48.357787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:48.357787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:48.357787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:48.357787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:48.357787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:48.357787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:48.358853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:48.358853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:48.358853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:48.358853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:48.358853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:48.358853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:48.358853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:48.358853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:48.358853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:48.358853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:48.358853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:48.358853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:48.358853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:48.358853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:48.358853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:48.358853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:48.358853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:48.360322 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:48.360322 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:48.360322 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:48.360322 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:48.360322 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 499/983] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:48.360322 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31d76f-6eb0-4b78-8b42-2906d14cf81f None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:48.374218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b816f15-e689-4ffe-8d03-ebf9a560cd32 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:48.380343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:48.407958 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902b524-218f-49a8-8fe5-533bc3a60223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:48.409411 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902b524-218f-49a8-8fe5-533bc3a60223 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:48.409719 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902b524-218f-49a8-8fe5-533bc3a60223 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:48.410001 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902b524-218f-49a8-8fe5-533bc3a60223 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:48.410645 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902b524-218f-49a8-8fe5-533bc3a60223 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:48.412006 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902b524-218f-49a8-8fe5-533bc3a60223 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:48.423638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-6902b524-218f-49a8-8fe5-533bc3a60223 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 13:40:48.423638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:48.423638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:48.423638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:48.423638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:48.423638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:48.423638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:48.423638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:48.423638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 13:40:48.423638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:48.423638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:48.423638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:48.423638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:48.423638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:48.423638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:48.423638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:48.423638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:48.424812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:48.424812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:48.424812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:48.424812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:48.424812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:48.424812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:48.424812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:48.424812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:48.424812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:48.424812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:48.424812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:48.424812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:48.424812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:48.424812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:48.424812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:48.424812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:48.425801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:48.425801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:48.425801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:48.425801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:48.425801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:48.425801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:48.425801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:48.425801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:48.425801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:48.425801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:48.425801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:48.425801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:48.425801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 13:40:48.425801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:48.425801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 485/984] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:48.426621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902b524-218f-49a8-8fe5-533bc3a60223 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:48.462227 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31d76f-6eb0-4b78-8b42-2906d14cf81f None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:48.495618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bbc5e-37ea-495e-aba2-86b3f19d944d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:48.496297 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bbc5e-37ea-495e-aba2-86b3f19d944d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:48.496580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bbc5e-37ea-495e-aba2-86b3f19d944d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:48.496858 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bbc5e-37ea-495e-aba2-86b3f19d944d None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:48.497590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bbc5e-37ea-495e-aba2-86b3f19d944d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:48.497898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bbc5e-37ea-495e-aba2-86b3f19d944d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:48.499239 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bbc5e-37ea-495e-aba2-86b3f19d944d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:48.504190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 500/985] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 13:40:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:48.504807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bbc5e-37ea-495e-aba2-86b3f19d944d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:48.526982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902b524-218f-49a8-8fe5-533bc3a60223 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:48.555540 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:48.560926 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675ea5e-1e2f-4e81-85f0-d1892ba57110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:48.561626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675ea5e-1e2f-4e81-85f0-d1892ba57110 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:48.561911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675ea5e-1e2f-4e81-85f0-d1892ba57110 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:48.562190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675ea5e-1e2f-4e81-85f0-d1892ba57110 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:48.562908 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675ea5e-1e2f-4e81-85f0-d1892ba57110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:48.563220 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675ea5e-1e2f-4e81-85f0-d1892ba57110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:48.564610 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675ea5e-1e2f-4e81-85f0-d1892ba57110 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:48.576263 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 486/986] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:48.577144 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675ea5e-1e2f-4e81-85f0-d1892ba57110 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:48.588623 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:48.604300 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bbc5e-37ea-495e-aba2-86b3f19d944d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:48.638620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea991d-afbf-4880-9b25-6c820965418c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:48.639362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea991d-afbf-4880-9b25-6c820965418c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:48.639651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea991d-afbf-4880-9b25-6c820965418c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:48.639930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea991d-afbf-4880-9b25-6c820965418c None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:48.640634 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea991d-afbf-4880-9b25-6c820965418c None admin] RBAC: Adding query filter params (name=compute) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:48.640946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea991d-afbf-4880-9b25-6c820965418c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:48.642331 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea991d-afbf-4880-9b25-6c820965418c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:48.647582 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 501/987] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 13:40:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:48.648357 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea991d-afbf-4880-9b25-6c820965418c None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:48.683453 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675ea5e-1e2f-4e81-85f0-d1892ba57110 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:48.717134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adeebc3-eca5-4a3e-be3f-1fa3f532f5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:48.717824 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeebc3-eca5-4a3e-be3f-1fa3f532f5fb None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:48.718105 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeebc3-eca5-4a3e-be3f-1fa3f532f5fb None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:48.718378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeebc3-eca5-4a3e-be3f-1fa3f532f5fb None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:48.719069 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adeebc3-eca5-4a3e-be3f-1fa3f532f5fb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:48.719378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adeebc3-eca5-4a3e-be3f-1fa3f532f5fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:48.721295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adeebc3-eca5-4a3e-be3f-1fa3f532f5fb None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:48.726747 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 487/988] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 13:40:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:48.727949 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adeebc3-eca5-4a3e-be3f-1fa3f532f5fb None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:48.746264 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea991d-afbf-4880-9b25-6c820965418c None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:48.779935 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f9097-67d3-46a2-a265-b013771fe9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:48.780647 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f9097-67d3-46a2-a265-b013771fe9b0 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:48.780933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f9097-67d3-46a2-a265-b013771fe9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:48.781211 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f9097-67d3-46a2-a265-b013771fe9b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:48.787102 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:48.788373 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f9097-67d3-46a2-a265-b013771fe9b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:48.790112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f9097-67d3-46a2-a265-b013771fe9b0 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:48.804453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-488f9097-67d3-46a2-a265-b013771fe9b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:48.804453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:48.804453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:48.804453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:48.804453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:48.804453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:48.804453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:48.804453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:48.804453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:48.804453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:48.804453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:48.804453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:48.804453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:48.804453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:48.804453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:48.805537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:48.805537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:48.805537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:48.805537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:48.805537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:48.805537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:48.805537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:48.805537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:48.805537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:48.805537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:48.805537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:48.805537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:48.805537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:48.805537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:48.805537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:48.805537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:48.805537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:48.806474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:48.806474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:48.806474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:48.806474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:48.806474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:48.806474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:48.806474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:48.806474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:48.806474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 502/989] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:48.806979 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f9097-67d3-46a2-a265-b013771fe9b0 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:48.817890 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:48.831716 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adeebc3-eca5-4a3e-be3f-1fa3f532f5fb None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:48.867797 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc493a2-a5d3-4012-81e3-ebaa13cd64c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:48.868461 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc493a2-a5d3-4012-81e3-ebaa13cd64c6 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:48.868739 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc493a2-a5d3-4012-81e3-ebaa13cd64c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:48.869013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc493a2-a5d3-4012-81e3-ebaa13cd64c6 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:48.869743 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc493a2-a5d3-4012-81e3-ebaa13cd64c6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:48.870047 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc493a2-a5d3-4012-81e3-ebaa13cd64c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:48.871400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc493a2-a5d3-4012-81e3-ebaa13cd64c6 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:48.876276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 488/990] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 13:40:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:48.876877 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc493a2-a5d3-4012-81e3-ebaa13cd64c6 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:48.908685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f9097-67d3-46a2-a265-b013771fe9b0 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:48.941072 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f46c63-afb9-437a-8da8-25d45db13190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:48.941752 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f46c63-afb9-437a-8da8-25d45db13190 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:48.942030 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f46c63-afb9-437a-8da8-25d45db13190 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:48.942309 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f46c63-afb9-437a-8da8-25d45db13190 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:48.943099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f46c63-afb9-437a-8da8-25d45db13190 None admin] RBAC: Adding query filter params (interface=admin, service_id=74d9d2786c004c9a8986d243569c003e, region_id=RegionOne) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:48.943410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f46c63-afb9-437a-8da8-25d45db13190 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:48.944767 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f46c63-afb9-437a-8da8-25d45db13190 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:48.949907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 503/991] 10.222.0.45 () {56 vars in 1249 bytes} [Thu May 26 13:40:48 2022] GET /identity/v3/endpoints?service_id=74d9d2786c004c9a8986d243569c003e&interface=admin®ion_id=RegionOne => generated 193 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:48.950529 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f46c63-afb9-437a-8da8-25d45db13190 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:48.976873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc493a2-a5d3-4012-81e3-ebaa13cd64c6 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:48.997142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:49.011572 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c7a01-8fb8-47ad-9556-72dbb75c6922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:49.012215 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c7a01-8fb8-47ad-9556-72dbb75c6922 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:49.012494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c7a01-8fb8-47ad-9556-72dbb75c6922 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:49.013035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c7a01-8fb8-47ad-9556-72dbb75c6922 None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:49.013557 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c7a01-8fb8-47ad-9556-72dbb75c6922 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:49.013860 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c7a01-8fb8-47ad-9556-72dbb75c6922 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:49.015270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c7a01-8fb8-47ad-9556-72dbb75c6922 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:49.017913 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:49.027558 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 489/992] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:49.028343 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c7a01-8fb8-47ad-9556-72dbb75c6922 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:49.050615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f46c63-afb9-437a-8da8-25d45db13190 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:49.083203 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbbb95-68e7-45a1-93e3-d0a61b122228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:49.083851 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbbb95-68e7-45a1-93e3-d0a61b122228 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:49.084131 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbbb95-68e7-45a1-93e3-d0a61b122228 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:49.084410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbbb95-68e7-45a1-93e3-d0a61b122228 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:49.085196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbbb95-68e7-45a1-93e3-d0a61b122228 None admin] RBAC: Adding query filter params (interface=public, service_id=f9a40af211474293aa1bcc5ade7a71d1, region_id=RegionOne) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:49.085541 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbbb95-68e7-45a1-93e3-d0a61b122228 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:49.086911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbbb95-68e7-45a1-93e3-d0a61b122228 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:49.092030 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 504/993] 10.222.0.45 () {56 vars in 1251 bytes} [Thu May 26 13:40:48 2022] GET /identity/v3/endpoints?service_id=f9a40af211474293aa1bcc5ade7a71d1&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:49.092798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbbb95-68e7-45a1-93e3-d0a61b122228 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:49.130879 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c7a01-8fb8-47ad-9556-72dbb75c6922 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:49.164232 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89527e-5892-4020-90cd-906b108c5fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:49.164888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89527e-5892-4020-90cd-906b108c5fbd None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:49.165167 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89527e-5892-4020-90cd-906b108c5fbd None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:49.165482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89527e-5892-4020-90cd-906b108c5fbd None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:49.166320 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89527e-5892-4020-90cd-906b108c5fbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:49.167521 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89527e-5892-4020-90cd-906b108c5fbd None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:49.173624 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 490/994] 10.222.0.45 () {56 vars in 1087 bytes} [Thu May 26 13:40:49 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:40:49.174386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89527e-5892-4020-90cd-906b108c5fbd None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:49.194115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbbb95-68e7-45a1-93e3-d0a61b122228 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:49.226152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:49.232526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2050d-634d-4f7d-9c25-80578fec4615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:49.233199 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2050d-634d-4f7d-9c25-80578fec4615 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:49.233511 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2050d-634d-4f7d-9c25-80578fec4615 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:49.233786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2050d-634d-4f7d-9c25-80578fec4615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:49.234681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2050d-634d-4f7d-9c25-80578fec4615 None admin] RBAC: Adding query filter params (role.id=d3712d4d751a4f2f8143138c5280e128, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=135410329e56486c8ccb65b1f2d87aca) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:49.234995 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2050d-634d-4f7d-9c25-80578fec4615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:49.236530 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2050d-634d-4f7d-9c25-80578fec4615 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:49.239950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:49.253882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 505/995] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:40:49 2022] GET /identity/v3/role_assignments?user.id=135410329e56486c8ccb65b1f2d87aca&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=d3712d4d751a4f2f8143138c5280e128 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:49.292763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89527e-5892-4020-90cd-906b108c5fbd None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:49.332556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8f99d-b084-4f9f-af43-774fc887bf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:49.333152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8f99d-b084-4f9f-af43-774fc887bf5f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:49.333466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8f99d-b084-4f9f-af43-774fc887bf5f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:49.333743 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8f99d-b084-4f9f-af43-774fc887bf5f None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:49.334437 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8f99d-b084-4f9f-af43-774fc887bf5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:49.335879 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8f99d-b084-4f9f-af43-774fc887bf5f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:49.349594 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 491/996] 10.222.0.45 () {56 vars in 1087 bytes} [Thu May 26 13:40:49 2022] GET /identity/v3/services => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:40:51.398390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebe0f9-e92c-4bf7-84ad-5fb260f40864 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:51.398923 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebe0f9-e92c-4bf7-84ad-5fb260f40864 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:51.398923 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebe0f9-e92c-4bf7-84ad-5fb260f40864 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:51.400475 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 506/997] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:51.405937 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b9353-a0ee-4317-bf14-057640243f9f None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:51.406374 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b9353-a0ee-4317-bf14-057640243f9f None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:51.406547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b9353-a0ee-4317-bf14-057640243f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:51.424209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a81b9353-a0ee-4317-bf14-057640243f9f None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:51.425434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a81b9353-a0ee-4317-bf14-057640243f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:51.493300 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 492/998] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:51.516441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebe0f9-e92c-4bf7-84ad-5fb260f40864 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:51.534081 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5c999-1c00-452e-a7c7-599c582f2aec None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:51.534375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5c999-1c00-452e-a7c7-599c582f2aec None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:51.534660 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5c999-1c00-452e-a7c7-599c582f2aec None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:51.536034 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 493/999] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:40:51.541137 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c550d-b3ba-466e-8d34-c9e49c38c92b None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:51.541461 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c550d-b3ba-466e-8d34-c9e49c38c92b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:51.541749 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c550d-b3ba-466e-8d34-c9e49c38c92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:51.559752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-9c0c550d-b3ba-466e-8d34-c9e49c38c92b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:51.560944 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9c0c550d-b3ba-466e-8d34-c9e49c38c92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:51.591607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:51.623794 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebe0f9-e92c-4bf7-84ad-5fb260f40864 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:51.630491 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 494/1000] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 13:40:51.632693 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbcbe5-fc1a-4311-9ac4-58e6e38a99aa None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:51.632994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbcbe5-fc1a-4311-9ac4-58e6e38a99aa None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:51.633563 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbcbe5-fc1a-4311-9ac4-58e6e38a99aa None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:51.634832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 495/1001] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:51.642662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb8ac7-15f1-4f61-a2d5-6fb1dd18f848 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:51.643206 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb8ac7-15f1-4f61-a2d5-6fb1dd18f848 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:51.643206 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb8ac7-15f1-4f61-a2d5-6fb1dd18f848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:51.659853 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-3fdb8ac7-15f1-4f61-a2d5-6fb1dd18f848 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:51.660006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff14daf-13ef-4f7f-991d-22187251d6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:51.660800 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff14daf-13ef-4f7f-991d-22187251d6f2 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:51.660951 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-3fdb8ac7-15f1-4f61-a2d5-6fb1dd18f848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:51.661082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff14daf-13ef-4f7f-991d-22187251d6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:51.661389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff14daf-13ef-4f7f-991d-22187251d6f2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:51.662046 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff14daf-13ef-4f7f-991d-22187251d6f2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:51.664338 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff14daf-13ef-4f7f-991d-22187251d6f2 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:51.679025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-0ff14daf-13ef-4f7f-991d-22187251d6f2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 13:40:51.679025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:51.679025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:51.679025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:51.679025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:51.679025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:51.679025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:51.679025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:51.679025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 13:40:51.679025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:51.679025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:51.679025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:51.679025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:51.679025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:51.679025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:51.679025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:51.679025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:51.680077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:51.680077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:51.680077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:51.680077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:51.680077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:51.680077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:51.680077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:51.680077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:51.680077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:51.680077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:51.680077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:51.680077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:51.680077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:51.680077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:51.680077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:51.680077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:51.680964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:51.680964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:51.680964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:51.680964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:51.680964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:51.680964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:51.680964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:51.680964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:51.680964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:51.680964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:51.680964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:51.680964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:51.680964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 13:40:51.680964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:51.680964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 507/1002] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 13:40:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:51.681841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff14daf-13ef-4f7f-991d-22187251d6f2 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:51.730574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 496/1003] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 13:40:51.731454 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb8ac7-15f1-4f61-a2d5-6fb1dd18f848 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:51.743795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:51.785196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff14daf-13ef-4f7f-991d-22187251d6f2 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:51.818538 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7a2b6-2a11-44ea-9c1e-43cc0ea64edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:51.819321 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7a2b6-2a11-44ea-9c1e-43cc0ea64edf None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:51.819608 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7a2b6-2a11-44ea-9c1e-43cc0ea64edf None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:51.819883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7a2b6-2a11-44ea-9c1e-43cc0ea64edf None admin] PATH_INFO: `/v3/services/image` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:51.820530 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7a2b6-2a11-44ea-9c1e-43cc0ea64edf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:51.821924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7a2b6-2a11-44ea-9c1e-43cc0ea64edf None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:51.832934 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:51.833296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-58f7a2b6-2a11-44ea-9c1e-43cc0ea64edf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 13:40:51.833296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:51.833296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:51.833296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:51.833296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:51.833296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:51.833296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:51.833296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:51.833296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 13:40:51.833296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:51.833296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:51.833296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:51.833296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:51.833296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:51.833296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:51.833296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:51.833296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:51.834273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:51.834273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:51.834273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:51.834273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:51.834273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:51.834273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:51.834273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:51.834273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:51.834273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:51.834273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:51.834273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:51.834273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:51.834273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:51.834273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:51.834273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:51.834273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:51.835133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:51.835133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:51.835133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:51.835133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:51.835133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:51.835133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:51.835133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:51.835133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:51.835133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:51.835133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:51.835133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:51.835133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:51.835133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 13:40:51.835133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:51.835133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 508/1004] 10.222.0.45 () {56 vars in 1105 bytes} [Thu May 26 13:40:51 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:51.835942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7a2b6-2a11-44ea-9c1e-43cc0ea64edf None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:51.839456 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb8ac7-15f1-4f61-a2d5-6fb1dd18f848 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:51.873598 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05416d1e-4d5f-4c6e-8a59-d4a0fef32187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:51.874263 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05416d1e-4d5f-4c6e-8a59-d4a0fef32187 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:51.874545 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05416d1e-4d5f-4c6e-8a59-d4a0fef32187 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:51.874820 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05416d1e-4d5f-4c6e-8a59-d4a0fef32187 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:51.875516 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05416d1e-4d5f-4c6e-8a59-d4a0fef32187 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:51.875822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05416d1e-4d5f-4c6e-8a59-d4a0fef32187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:51.877208 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05416d1e-4d5f-4c6e-8a59-d4a0fef32187 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:51.881938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 497/1005] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 13:40:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:51.882702 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05416d1e-4d5f-4c6e-8a59-d4a0fef32187 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:51.938298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7a2b6-2a11-44ea-9c1e-43cc0ea64edf None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:51.963183 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:51.971628 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef9c7a-9c7e-48fd-8cd2-9457a1d1edc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:51.972418 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef9c7a-9c7e-48fd-8cd2-9457a1d1edc7 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:51.972699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef9c7a-9c7e-48fd-8cd2-9457a1d1edc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:51.972972 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef9c7a-9c7e-48fd-8cd2-9457a1d1edc7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:51.973648 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef9c7a-9c7e-48fd-8cd2-9457a1d1edc7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:51.974994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef9c7a-9c7e-48fd-8cd2-9457a1d1edc7 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:51.982752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05416d1e-4d5f-4c6e-8a59-d4a0fef32187 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:51.986716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-dcef9c7a-9c7e-48fd-8cd2-9457a1d1edc7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 13:40:51.986716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:51.986716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:51.986716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:51.986716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:51.986716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:51.986716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:51.986716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:51.986716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 13:40:51.986716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:51.986716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:51.986716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:51.986716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:51.986716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:51.986716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:51.986716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:51.986716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:51.987695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:51.987695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:51.987695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:51.987695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:51.987695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:51.987695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:51.987695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:51.987695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:51.987695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:51.987695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:51.987695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:51.987695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:51.987695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:51.987695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:51.987695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:51.987695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:51.988542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:51.988542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:51.988542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:51.988542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:51.988542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:51.988542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:51.988542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:51.988542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:51.988542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:51.988542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:51.988542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:51.988542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:51.988542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 13:40:51.988542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:51.988542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 509/1006] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:51.989397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef9c7a-9c7e-48fd-8cd2-9457a1d1edc7 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:52.021731 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fa870-01b9-46a5-94c6-80b2b2b649ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:52.022390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fa870-01b9-46a5-94c6-80b2b2b649ff None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:52.022674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fa870-01b9-46a5-94c6-80b2b2b649ff None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:52.022950 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fa870-01b9-46a5-94c6-80b2b2b649ff None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:52.023638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fa870-01b9-46a5-94c6-80b2b2b649ff None admin] RBAC: Adding query filter params (name=image) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:52.023943 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fa870-01b9-46a5-94c6-80b2b2b649ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:52.025326 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fa870-01b9-46a5-94c6-80b2b2b649ff None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:52.030163 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 498/1007] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:52.030774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fa870-01b9-46a5-94c6-80b2b2b649ff None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:52.062029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:52.090251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef9c7a-9c7e-48fd-8cd2-9457a1d1edc7 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:52.125846 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178c8d2-dd44-4404-9c0c-3162079a0c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:52.126496 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178c8d2-dd44-4404-9c0c-3162079a0c66 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:52.126780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178c8d2-dd44-4404-9c0c-3162079a0c66 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:52.127054 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178c8d2-dd44-4404-9c0c-3162079a0c66 None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:52.127745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178c8d2-dd44-4404-9c0c-3162079a0c66 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:52.128057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178c8d2-dd44-4404-9c0c-3162079a0c66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:52.129422 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178c8d2-dd44-4404-9c0c-3162079a0c66 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:52.134344 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 510/1008] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 13:40:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:52.135114 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178c8d2-dd44-4404-9c0c-3162079a0c66 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:52.137452 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fa870-01b9-46a5-94c6-80b2b2b649ff None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:52.172102 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec9fde-0510-4955-9102-2e55efd6776c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:52.172762 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec9fde-0510-4955-9102-2e55efd6776c None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:52.173047 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec9fde-0510-4955-9102-2e55efd6776c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:52.173349 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec9fde-0510-4955-9102-2e55efd6776c None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:52.174071 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec9fde-0510-4955-9102-2e55efd6776c None admin] RBAC: Adding query filter params (name=compute) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:52.174375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec9fde-0510-4955-9102-2e55efd6776c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:52.175739 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec9fde-0510-4955-9102-2e55efd6776c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:52.180665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 499/1009] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 13:40:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:52.181437 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec9fde-0510-4955-9102-2e55efd6776c None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:52.193325 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:52.237152 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178c8d2-dd44-4404-9c0c-3162079a0c66 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:52.272131 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a8908-05ef-4f65-aa80-afbd80261696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:52.272544 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:52.272790 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a8908-05ef-4f65-aa80-afbd80261696 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:52.273082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a8908-05ef-4f65-aa80-afbd80261696 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:52.273398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a8908-05ef-4f65-aa80-afbd80261696 None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:52.274146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a8908-05ef-4f65-aa80-afbd80261696 None admin] RBAC: Adding query filter params (type=image) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:52.274452 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a8908-05ef-4f65-aa80-afbd80261696 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:52.275953 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a8908-05ef-4f65-aa80-afbd80261696 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:52.280392 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 511/1010] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:52.281164 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a8908-05ef-4f65-aa80-afbd80261696 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:52.292634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec9fde-0510-4955-9102-2e55efd6776c None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:52.333837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9edc3-5667-4403-bcd9-cb7059b51a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:52.334931 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9edc3-5667-4403-bcd9-cb7059b51a8c None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:52.335386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9edc3-5667-4403-bcd9-cb7059b51a8c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:52.335647 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9edc3-5667-4403-bcd9-cb7059b51a8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:52.336412 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9edc3-5667-4403-bcd9-cb7059b51a8c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:52.337871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9edc3-5667-4403-bcd9-cb7059b51a8c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:52.355302 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 500/1011] 10.222.0.45 () {60 vars in 1144 bytes} [Thu May 26 13:40:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:40:52.409012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a8908-05ef-4f65-aa80-afbd80261696 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:52.434333 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:52.460862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ec8fc-1f95-4a91-a9a4-7dbea61cb8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:52.461506 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ec8fc-1f95-4a91-a9a4-7dbea61cb8cc None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:52.461843 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ec8fc-1f95-4a91-a9a4-7dbea61cb8cc None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:52.462123 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ec8fc-1f95-4a91-a9a4-7dbea61cb8cc None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:52.462880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ec8fc-1f95-4a91-a9a4-7dbea61cb8cc None admin] RBAC: Adding query filter params (type=compute) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:52.463194 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ec8fc-1f95-4a91-a9a4-7dbea61cb8cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:52.464654 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ec8fc-1f95-4a91-a9a4-7dbea61cb8cc None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:52.470741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 512/1012] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 13:40:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:52.476619 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9edc3-5667-4403-bcd9-cb7059b51a8c None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:52.586002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9edc3-5667-4403-bcd9-cb7059b51a8c None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:52.620105 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d849ec3-001c-4959-8354-ca3b28c32048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:52.620768 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d849ec3-001c-4959-8354-ca3b28c32048 None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:52.621052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d849ec3-001c-4959-8354-ca3b28c32048 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:52.621358 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d849ec3-001c-4959-8354-ca3b28c32048 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:52.622108 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d849ec3-001c-4959-8354-ca3b28c32048 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:52.623506 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d849ec3-001c-4959-8354-ca3b28c32048 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:52.643509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 501/1013] 10.222.0.45 () {60 vars in 1144 bytes} [Thu May 26 13:40:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:40:54.509137 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc654c-e72f-4ee5-83c9-5755188976cc None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:54.509704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc654c-e72f-4ee5-83c9-5755188976cc None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:54.509704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc654c-e72f-4ee5-83c9-5755188976cc None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:54.511381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 513/1014] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:54.516520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fdcee-9691-47bb-abef-f1721b7ebb97 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:54.516973 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fdcee-9691-47bb-abef-f1721b7ebb97 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:54.517728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fdcee-9691-47bb-abef-f1721b7ebb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:54.529047 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:54.535484 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-8a6fdcee-9691-47bb-abef-f1721b7ebb97 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:54.537216 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-8a6fdcee-9691-47bb-abef-f1721b7ebb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:54.610446 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 502/1015] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:54 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:54.614086 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b81c7f-e59a-41c8-920d-3a983598c058 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:54.614379 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b81c7f-e59a-41c8-920d-3a983598c058 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:54.614661 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b81c7f-e59a-41c8-920d-3a983598c058 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:54.616158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 514/1016] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:54.620988 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4d1a8-ebec-42c3-84aa-33918f46b1e9 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:54.622105 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4d1a8-ebec-42c3-84aa-33918f46b1e9 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:54.622105 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4d1a8-ebec-42c3-84aa-33918f46b1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:54.635834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b81c7f-e59a-41c8-920d-3a983598c058 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:54.638834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-91e4d1a8-ebec-42c3-84aa-33918f46b1e9 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:54.640010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-91e4d1a8-ebec-42c3-84aa-33918f46b1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:54.725979 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 503/1017] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:54 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 13:40:54.749501 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4d1a8-ebec-42c3-84aa-33918f46b1e9 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:54.771269 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b81c7f-e59a-41c8-920d-3a983598c058 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:54.810923 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb158f-099b-488b-bcf1-43dd94be70e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:54.811911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb158f-099b-488b-bcf1-43dd94be70e2 None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:54.812349 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb158f-099b-488b-bcf1-43dd94be70e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:54.812588 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:54.812696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb158f-099b-488b-bcf1-43dd94be70e2 None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:54.813376 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb158f-099b-488b-bcf1-43dd94be70e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:54.815868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb158f-099b-488b-bcf1-43dd94be70e2 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:54.833427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 515/1018] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 13:40:54 2022] POST /identity/v3/services => generated 242 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:40:54.862603 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4d1a8-ebec-42c3-84aa-33918f46b1e9 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:54.906617 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb1ed3-233d-4ba4-88e6-801f62bce022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:54.907340 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb1ed3-233d-4ba4-88e6-801f62bce022 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:54.907618 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb1ed3-233d-4ba4-88e6-801f62bce022 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:54.908425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb1ed3-233d-4ba4-88e6-801f62bce022 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:54.909640 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb1ed3-233d-4ba4-88e6-801f62bce022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:54.911122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb1ed3-233d-4ba4-88e6-801f62bce022 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:54.913008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 504/1019] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:54.918673 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb158f-099b-488b-bcf1-43dd94be70e2 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:54.944378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c31e5-4021-40f9-82e4-7cf649741b7e None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:54.944665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c31e5-4021-40f9-82e4-7cf649741b7e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:54.944949 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c31e5-4021-40f9-82e4-7cf649741b7e None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:54.946465 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 505/1020] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:40:54.952539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94b96e-4e4f-425e-ab60-857e71d24999 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:54.952820 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94b96e-4e4f-425e-ab60-857e71d24999 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:54.953113 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94b96e-4e4f-425e-ab60-857e71d24999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:54.966964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:54.975011 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-ed94b96e-4e4f-425e-ab60-857e71d24999 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:54.976486 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ed94b96e-4e4f-425e-ab60-857e71d24999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:55.030683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb158f-099b-488b-bcf1-43dd94be70e2 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:55.051462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 506/1021] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 13:40:55.067469 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7d140-3a9b-49ab-ae60-6de5e8c65600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:55.068136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7d140-3a9b-49ab-ae60-6de5e8c65600 None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:55.068422 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7d140-3a9b-49ab-ae60-6de5e8c65600 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:55.068702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7d140-3a9b-49ab-ae60-6de5e8c65600 None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:55.069463 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7d140-3a9b-49ab-ae60-6de5e8c65600 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:55.070878 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7d140-3a9b-49ab-ae60-6de5e8c65600 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:55.074793 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94b96e-4e4f-425e-ab60-857e71d24999 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:55.102033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 516/1022] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 13:40:54 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:40:55.138654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:55.190955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94b96e-4e4f-425e-ab60-857e71d24999 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:55.227954 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b0d92-19ab-4044-83d4-f8c086cdf606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:55.228781 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b0d92-19ab-4044-83d4-f8c086cdf606 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:55.229116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b0d92-19ab-4044-83d4-f8c086cdf606 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:55.229424 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b0d92-19ab-4044-83d4-f8c086cdf606 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:55.241160 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b0d92-19ab-4044-83d4-f8c086cdf606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:55.249537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-8b8b0d92-19ab-4044-83d4-f8c086cdf606 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 13:40:55.249537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:55.249537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:55.249537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:55.249537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:55.249537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:55.249537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:55.249537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:55.249537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:55.249537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:55.249537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:55.249537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:55.249537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:55.249537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:55.249537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:55.249537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:55.250547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:55.250547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:55.250547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:55.250547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:55.250547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:55.250547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:55.250547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:55.250547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:55.250547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:55.250547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:55.250547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:55.250547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:55.250547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:55.250547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:55.250547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:55.250547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:55.251578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:55.251578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:55.251578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:55.251578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:55.251578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:55.251578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:55.251578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:55.251578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:55.251578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:55.251578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:55.251578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 13:40:55.251578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:55.251578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 507/1023] 10.222.0.45 () {56 vars in 1120 bytes} [Thu May 26 13:40:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:55.259804 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7d140-3a9b-49ab-ae60-6de5e8c65600 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:55.355891 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:55.366524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7d140-3a9b-49ab-ae60-6de5e8c65600 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:55.402883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10592ac7-2534-4f64-b955-c2bfee27780c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:55.403547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10592ac7-2534-4f64-b955-c2bfee27780c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:55.403825 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10592ac7-2534-4f64-b955-c2bfee27780c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:55.404095 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10592ac7-2534-4f64-b955-c2bfee27780c None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:55.404822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10592ac7-2534-4f64-b955-c2bfee27780c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:55.405122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10592ac7-2534-4f64-b955-c2bfee27780c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:55.406484 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10592ac7-2534-4f64-b955-c2bfee27780c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:55.415313 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 517/1024] 10.222.0.45 () {56 vars in 1115 bytes} [Thu May 26 13:40:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:55.421080 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b0d92-19ab-4044-83d4-f8c086cdf606 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:55.523815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b0d92-19ab-4044-83d4-f8c086cdf606 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:55.543465 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:55.564774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198b489-9dda-42a7-a08b-1d7573d64e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:55.565637 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198b489-9dda-42a7-a08b-1d7573d64e54 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:55.565914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198b489-9dda-42a7-a08b-1d7573d64e54 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:55.566184 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198b489-9dda-42a7-a08b-1d7573d64e54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:55.577011 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198b489-9dda-42a7-a08b-1d7573d64e54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:55.578520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198b489-9dda-42a7-a08b-1d7573d64e54 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:55.595981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-1198b489-9dda-42a7-a08b-1d7573d64e54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:55.595981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:55.595981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:55.595981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:55.595981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:55.595981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:55.595981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:55.595981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:55.595981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:55.595981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:55.595981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:55.595981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:55.595981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:55.595981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:55.595981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:55.596916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:55.596916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:55.596916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:55.596916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:55.596916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:55.596916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:55.596916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:55.596916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:55.596916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:55.596916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:55.596916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:55.596916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:55.596916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:55.596916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:55.596916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:55.596916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:55.596916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:55.598664 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:55.598664 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:55.598664 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:55.598664 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:55.598664 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 508/1025] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:55.604982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10592ac7-2534-4f64-b955-c2bfee27780c None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:55.714402 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10592ac7-2534-4f64-b955-c2bfee27780c None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:55.747698 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503855b-7f15-4283-9979-bebc23b0b4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:55.748355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503855b-7f15-4283-9979-bebc23b0b4f3 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:55.748632 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503855b-7f15-4283-9979-bebc23b0b4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:55.748903 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503855b-7f15-4283-9979-bebc23b0b4f3 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:55.749635 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503855b-7f15-4283-9979-bebc23b0b4f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:55.749940 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503855b-7f15-4283-9979-bebc23b0b4f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:55.751283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503855b-7f15-4283-9979-bebc23b0b4f3 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:55.763146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 518/1026] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:55.768483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198b489-9dda-42a7-a08b-1d7573d64e54 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:55.870610 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198b489-9dda-42a7-a08b-1d7573d64e54 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:55.904269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db44238-e0af-44e7-b92f-b6d8034d1302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:55.905050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db44238-e0af-44e7-b92f-b6d8034d1302 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:55.905356 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db44238-e0af-44e7-b92f-b6d8034d1302 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:55.905632 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db44238-e0af-44e7-b92f-b6d8034d1302 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:55.913786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db44238-e0af-44e7-b92f-b6d8034d1302 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:55.915237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db44238-e0af-44e7-b92f-b6d8034d1302 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:55.929120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-2db44238-e0af-44e7-b92f-b6d8034d1302 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 13:40:55.929120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:55.929120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:55.929120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:55.929120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:55.929120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:55.929120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:55.929120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:55.929120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:55.929120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:55.929120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:55.929120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:55.929120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:40:55.929120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:40:55.929120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:40:55.929120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:40:55.930269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:55.930269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:55.930269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:40:55.930269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:55.930269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:40:55.930269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:40:55.930269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:55.930269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:55.930269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:55.930269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:55.930269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:55.930269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:55.930269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:55.930269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:55.930269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:55.930269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:55.930269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:55.930269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:55.935856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:55.935856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:55.935856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:40:55.935856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:40:55.935856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:40:55.935856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:40:55.935856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:40:55.935856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:40:55.935856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 13:40:55.935856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:55.935856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 509/1027] 10.222.0.45 () {56 vars in 1093 bytes} [Thu May 26 13:40:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:55.936497 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503855b-7f15-4283-9979-bebc23b0b4f3 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:55.952114 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:56.040971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503855b-7f15-4283-9979-bebc23b0b4f3 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:56.078349 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f3909-f62e-494f-b9e6-dc43a64750b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:56.079020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f3909-f62e-494f-b9e6-dc43a64750b1 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:56.079297 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f3909-f62e-494f-b9e6-dc43a64750b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:56.080108 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f3909-f62e-494f-b9e6-dc43a64750b1 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:56.080928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f3909-f62e-494f-b9e6-dc43a64750b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:56.081238 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f3909-f62e-494f-b9e6-dc43a64750b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:56.082678 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f3909-f62e-494f-b9e6-dc43a64750b1 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:56.100330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 519/1028] 10.222.0.45 () {56 vars in 1133 bytes} [Thu May 26 13:40:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:56.106468 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db44238-e0af-44e7-b92f-b6d8034d1302 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:56.134901 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:56.206810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db44238-e0af-44e7-b92f-b6d8034d1302 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:56.238930 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618eb25-ec28-439a-9ed1-e262a9a106d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:56.239568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618eb25-ec28-439a-9ed1-e262a9a106d9 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:56.239846 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618eb25-ec28-439a-9ed1-e262a9a106d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:56.240118 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618eb25-ec28-439a-9ed1-e262a9a106d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:56.309492 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618eb25-ec28-439a-9ed1-e262a9a106d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:56.310939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618eb25-ec28-439a-9ed1-e262a9a106d9 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:56.338163 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:56.416743 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 510/1029] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:40:56 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 13:40:56.418261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f3909-f62e-494f-b9e6-dc43a64750b1 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:56.489160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:56.519627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f3909-f62e-494f-b9e6-dc43a64750b1 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:56.553358 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eda305-c640-43cf-aae3-9f370fc62be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:56.554150 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eda305-c640-43cf-aae3-9f370fc62be6 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:56.554510 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eda305-c640-43cf-aae3-9f370fc62be6 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:56.554695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eda305-c640-43cf-aae3-9f370fc62be6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:56.564669 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eda305-c640-43cf-aae3-9f370fc62be6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:56.566134 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eda305-c640-43cf-aae3-9f370fc62be6 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:56.584051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-71eda305-c640-43cf-aae3-9f370fc62be6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:56.584051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:56.584051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:56.584051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:56.584051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:56.584051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:56.584051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:56.584051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:56.584051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:56.584051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:56.584051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:56.584051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:56.584051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:40:56.584051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:40:56.584051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:40:56.584994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:40:56.584994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:56.584994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:56.584994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:56.584994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:56.584994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:56.584994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:56.584994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:56.584994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:56.584994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:56.584994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:56.584994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:56.584994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:56.584994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:56.584994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:56.584994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:56.584994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:56.586016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:40:56.586016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:40:56.586016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:40:56.586016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:56.586016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 520/1030] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:56.591839 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618eb25-ec28-439a-9ed1-e262a9a106d9 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:56.698939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618eb25-ec28-439a-9ed1-e262a9a106d9 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:56.727894 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:56.736830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e94dc-2723-4ce7-b966-7ed57b037c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:56.737523 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e94dc-2723-4ce7-b966-7ed57b037c4c None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:56.737808 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e94dc-2723-4ce7-b966-7ed57b037c4c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:56.738084 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e94dc-2723-4ce7-b966-7ed57b037c4c None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:56.738795 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e94dc-2723-4ce7-b966-7ed57b037c4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:56.739098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e94dc-2723-4ce7-b966-7ed57b037c4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:56.740515 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e94dc-2723-4ce7-b966-7ed57b037c4c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:56.756592 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 511/1031] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:56.758275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eda305-c640-43cf-aae3-9f370fc62be6 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:56.860064 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eda305-c640-43cf-aae3-9f370fc62be6 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:56.884205 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:56.896709 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef6d5e-7973-4098-922c-9e3367172c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:56.897532 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef6d5e-7973-4098-922c-9e3367172c3d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:56.897819 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef6d5e-7973-4098-922c-9e3367172c3d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:56.898095 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef6d5e-7973-4098-922c-9e3367172c3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:56.905128 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef6d5e-7973-4098-922c-9e3367172c3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:56.906590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef6d5e-7973-4098-922c-9e3367172c3d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:56.921014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-49ef6d5e-7973-4098-922c-9e3367172c3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:56.921014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:56.921014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:56.921014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:56.921014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:56.921014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:56.921014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:56.921014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:56.921014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:56.921014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:56.921014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:56.921014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:56.921014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:40:56.921014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:40:56.921014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:40:56.921965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:40:56.921965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:56.921965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:56.921965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:56.921965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:56.921965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:56.921965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:56.921965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:56.921965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:56.921965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:56.921965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:56.921965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:56.921965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:56.921965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:56.921965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:56.921965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:56.921965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:56.922970 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:40:56.922970 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:40:56.922970 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:40:56.922970 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:40:56.922970 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:40:56.922970 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:40:56.922970 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:40:56.922970 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:56.922970 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 521/1032] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:40:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:40:56.929415 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e94dc-2723-4ce7-b966-7ed57b037c4c None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:57.037447 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e94dc-2723-4ce7-b966-7ed57b037c4c None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:57.071100 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b1d9c-421a-4db1-871b-838ffc77d161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:57.071767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b1d9c-421a-4db1-871b-838ffc77d161 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:57.072045 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b1d9c-421a-4db1-871b-838ffc77d161 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:57.072319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b1d9c-421a-4db1-871b-838ffc77d161 None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:57.073102 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b1d9c-421a-4db1-871b-838ffc77d161 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:57.073515 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b1d9c-421a-4db1-871b-838ffc77d161 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:57.074874 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b1d9c-421a-4db1-871b-838ffc77d161 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:57.092585 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 512/1033] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:40:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:57.093837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef6d5e-7973-4098-922c-9e3367172c3d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:57.172616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef7172-3d1f-4c4c-a9ca-7e5e97a7ea16 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:57.172906 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef7172-3d1f-4c4c-a9ca-7e5e97a7ea16 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:57.177104 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef7172-3d1f-4c4c-a9ca-7e5e97a7ea16 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:57.179974 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 513/1034] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:40:57.186717 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f5030-5b05-4d86-a506-f5a9cdc7e01b None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:57.187048 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f5030-5b05-4d86-a506-f5a9cdc7e01b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:57.187282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f5030-5b05-4d86-a506-f5a9cdc7e01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:57.201028 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef6d5e-7973-4098-922c-9e3367172c3d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:57.210108 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-9a9f5030-5b05-4d86-a506-f5a9cdc7e01b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:57.211347 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9a9f5030-5b05-4d86-a506-f5a9cdc7e01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:57.244286 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5a8c4-1003-4bf5-a6c1-d5fb53dc2cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:57.245827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5a8c4-1003-4bf5-a6c1-d5fb53dc2cba None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:57.246299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5a8c4-1003-4bf5-a6c1-d5fb53dc2cba None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:57.246759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5a8c4-1003-4bf5-a6c1-d5fb53dc2cba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:57.247768 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5a8c4-1003-4bf5-a6c1-d5fb53dc2cba None admin] RBAC: Adding query filter params (role.id=d3712d4d751a4f2f8143138c5280e128, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=1994043a81bb454297c208839794a479) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:57.248293 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5a8c4-1003-4bf5-a6c1-d5fb53dc2cba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:57.250874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5a8c4-1003-4bf5-a6c1-d5fb53dc2cba None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:57.258648 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 522/1035] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:40:57 2022] GET /identity/v3/role_assignments?user.id=1994043a81bb454297c208839794a479&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=d3712d4d751a4f2f8143138c5280e128 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:57.260032 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:57.293431 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 514/1036] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:57.314873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5a8c4-1003-4bf5-a6c1-d5fb53dc2cba None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:57.377988 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:57.393205 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78d4a4-06f8-4832-9e6a-e1c82e44c527 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:57.393600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78d4a4-06f8-4832-9e6a-e1c82e44c527 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:57.393983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78d4a4-06f8-4832-9e6a-e1c82e44c527 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:57.395373 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 515/1037] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:57.401046 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d2ee1-1877-4067-bd3a-5f3eb64fde47 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:57.401362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d2ee1-1877-4067-bd3a-5f3eb64fde47 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:57.401636 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d2ee1-1877-4067-bd3a-5f3eb64fde47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:57.418864 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-670d2ee1-1877-4067-bd3a-5f3eb64fde47 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:57.420079 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-670d2ee1-1877-4067-bd3a-5f3eb64fde47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:57.443004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5a8c4-1003-4bf5-a6c1-d5fb53dc2cba None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:57.483502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc4e35-3449-4930-8ed4-64e4c9a147be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:57.484570 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc4e35-3449-4930-8ed4-64e4c9a147be None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:57.484855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc4e35-3449-4930-8ed4-64e4c9a147be None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:57.485138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc4e35-3449-4930-8ed4-64e4c9a147be None admin] PATH_INFO: `/v3/services/image` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:57.486511 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc4e35-3449-4930-8ed4-64e4c9a147be None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:57.488443 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc4e35-3449-4930-8ed4-64e4c9a147be None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:57.495374 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 516/1038] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 13:40:57.500807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-d1bc4e35-3449-4930-8ed4-64e4c9a147be None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 13:40:57.500807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:57.500807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:40:57.500807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:40:57.500807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:40:57.500807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:40:57.500807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:40:57.500807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:57.500807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 13:40:57.500807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:57.500807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:40:57.500807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:57.500807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:57.500807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:57.500807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:57.500807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:57.500807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:57.502380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:57.502380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:57.502380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:57.502380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:57.502380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:57.502380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:57.502380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:40:57.502380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:40:57.502380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:40:57.502380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:40:57.502380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:57.502380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:57.502380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:57.502380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:57.502380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:57.502380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:57.503234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:57.503234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:40:57.503234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:57.503234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:57.503234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:57.503234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:57.503234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:57.503234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:57.503234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:57.503234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:57.503234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:40:57.503234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:40:57.503234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 13:40:57.503234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:40:57.504609 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 523/1039] 10.222.0.45 () {56 vars in 1105 bytes} [Thu May 26 13:40:57 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:57.508678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d2ee1-1877-4067-bd3a-5f3eb64fde47 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:57.518821 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc4e35-3449-4930-8ed4-64e4c9a147be None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:57.613765 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d2ee1-1877-4067-bd3a-5f3eb64fde47 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:57.624500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:57.629991 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc4e35-3449-4930-8ed4-64e4c9a147be None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:57.644320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:57.653648 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153032f2-6960-44ae-917a-b2cd168bfea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:57.654304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153032f2-6960-44ae-917a-b2cd168bfea4 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:57.654589 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153032f2-6960-44ae-917a-b2cd168bfea4 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:57.654874 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153032f2-6960-44ae-917a-b2cd168bfea4 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:57.655550 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153032f2-6960-44ae-917a-b2cd168bfea4 None admin] RBAC: Adding query filter params (name=image) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:57.655966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153032f2-6960-44ae-917a-b2cd168bfea4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:57.657196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153032f2-6960-44ae-917a-b2cd168bfea4 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:57.666554 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 517/1040] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:57.666942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160681c6-15ee-4252-953e-51ce5d9c9392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:57.667551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153032f2-6960-44ae-917a-b2cd168bfea4 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:57.667666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160681c6-15ee-4252-953e-51ce5d9c9392 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:57.667980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160681c6-15ee-4252-953e-51ce5d9c9392 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:57.668580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160681c6-15ee-4252-953e-51ce5d9c9392 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:57.672551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160681c6-15ee-4252-953e-51ce5d9c9392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:57.672551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160681c6-15ee-4252-953e-51ce5d9c9392 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:57.673011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 524/1041] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:57.678752 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160681c6-15ee-4252-953e-51ce5d9c9392 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:57.777855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153032f2-6960-44ae-917a-b2cd168bfea4 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:57.786683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160681c6-15ee-4252-953e-51ce5d9c9392 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:57.815014 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e060031-4435-4262-a125-213ed0c5acc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:57.815702 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e060031-4435-4262-a125-213ed0c5acc8 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:57.815984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e060031-4435-4262-a125-213ed0c5acc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:57.816260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e060031-4435-4262-a125-213ed0c5acc8 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:57.817044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e060031-4435-4262-a125-213ed0c5acc8 None admin] RBAC: Adding query filter params (type=image) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:57.817376 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e060031-4435-4262-a125-213ed0c5acc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:57.818829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e060031-4435-4262-a125-213ed0c5acc8 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:57.823755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 518/1042] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:57.829258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348db866-d863-4cbd-abcc-9d0679bc3662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:57.829450 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e060031-4435-4262-a125-213ed0c5acc8 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:57.829971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348db866-d863-4cbd-abcc-9d0679bc3662 None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:57.830258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348db866-d863-4cbd-abcc-9d0679bc3662 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:57.830533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348db866-d863-4cbd-abcc-9d0679bc3662 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:57.831238 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348db866-d863-4cbd-abcc-9d0679bc3662 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:57.832734 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348db866-d863-4cbd-abcc-9d0679bc3662 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:57.854792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 525/1043] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 13:40:57 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:40:57.869715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:57.944441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e060031-4435-4262-a125-213ed0c5acc8 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:57.980957 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627cfce-1138-450d-a163-41f97bd1a16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:57.981666 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627cfce-1138-450d-a163-41f97bd1a16c None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:57.981949 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627cfce-1138-450d-a163-41f97bd1a16c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:57.982221 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627cfce-1138-450d-a163-41f97bd1a16c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:57.983023 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627cfce-1138-450d-a163-41f97bd1a16c None admin] RBAC: Adding query filter params (interface=public, service_id=449caa943d104e9787c7e9de10cfa526, region_id=RegionOne) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:57.983334 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627cfce-1138-450d-a163-41f97bd1a16c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:57.984766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627cfce-1138-450d-a163-41f97bd1a16c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:57.995662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 519/1044] 10.222.0.45 () {56 vars in 1251 bytes} [Thu May 26 13:40:57 2022] GET /identity/v3/endpoints?service_id=449caa943d104e9787c7e9de10cfa526&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:40:57.996928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348db866-d863-4cbd-abcc-9d0679bc3662 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:58.048215 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:58.116505 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348db866-d863-4cbd-abcc-9d0679bc3662 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:58.150997 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d099097-1d95-4695-9a6c-901a5ed64d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:58.151587 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d099097-1d95-4695-9a6c-901a5ed64d43 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:58.151868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d099097-1d95-4695-9a6c-901a5ed64d43 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:58.152139 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d099097-1d95-4695-9a6c-901a5ed64d43 None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:58.152810 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d099097-1d95-4695-9a6c-901a5ed64d43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:58.154204 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d099097-1d95-4695-9a6c-901a5ed64d43 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:58.161313 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 526/1045] 10.222.0.45 () {56 vars in 1087 bytes} [Thu May 26 13:40:57 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:40:59.473552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab20c8d-bb94-410e-ae3e-b7d8c5550204 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:59.474074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab20c8d-bb94-410e-ae3e-b7d8c5550204 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:59.474179 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab20c8d-bb94-410e-ae3e-b7d8c5550204 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:59.475604 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 520/1046] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:40:59.480752 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2320a-12e2-4a09-9359-99897edc314c None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:59.481132 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2320a-12e2-4a09-9359-99897edc314c None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:59.481356 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2320a-12e2-4a09-9359-99897edc314c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:59.498334 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-3cd2320a-12e2-4a09-9359-99897edc314c None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:59.499535 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-3cd2320a-12e2-4a09-9359-99897edc314c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:59.571915 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 527/1047] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:40:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:40:59.594548 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab20c8d-bb94-410e-ae3e-b7d8c5550204 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:59.700371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:59.705310 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab20c8d-bb94-410e-ae3e-b7d8c5550204 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:59.740339 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f9dea-acf3-44a3-a219-d6d3649bb1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:59.741072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f9dea-acf3-44a3-a219-d6d3649bb1ff None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:59.741381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f9dea-acf3-44a3-a219-d6d3649bb1ff None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:59.741658 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f9dea-acf3-44a3-a219-d6d3649bb1ff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:59.752584 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f9dea-acf3-44a3-a219-d6d3649bb1ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:40:59.761061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-1b8f9dea-acf3-44a3-a219-d6d3649bb1ff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 13:40:59.761061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:40:59.761061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:40:59.761061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:40:59.761061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:40:59.761061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:40:59.761061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:40:59.761061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:40:59.761061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:40:59.761061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:40:59.761061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:40:59.761061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:40:59.761061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:40:59.761061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:40:59.761061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:40:59.761061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:40:59.762165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:40:59.762165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:40:59.762165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:40:59.762165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:40:59.762165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:40:59.762165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:40:59.762165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:40:59.762165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:40:59.762165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:40:59.762165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:40:59.762165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:40:59.762165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:40:59.762165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:40:59.762165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:40:59.762165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:40:59.762165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:40:59.763022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:40:59.763022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:40:59.763022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:40:59.763022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:40:59.763022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:40:59.763022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:40:59.763022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:40:59.763022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:40:59.763022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:40:59.763022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:40:59.763022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 13:40:59.763022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:40:59.765584 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 521/1048] 10.222.0.45 () {56 vars in 1120 bytes} [Thu May 26 13:40:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:40:59.768395 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2320a-12e2-4a09-9359-99897edc314c None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:59.799082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:59.869926 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2320a-12e2-4a09-9359-99897edc314c None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:59.903863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71574e64-c55a-45d2-aec5-d5885daafb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:59.904541 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71574e64-c55a-45d2-aec5-d5885daafb3e None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:59.904825 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71574e64-c55a-45d2-aec5-d5885daafb3e None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:59.905104 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71574e64-c55a-45d2-aec5-d5885daafb3e None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:59.905881 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71574e64-c55a-45d2-aec5-d5885daafb3e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:40:59.906193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71574e64-c55a-45d2-aec5-d5885daafb3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:59.907572 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71574e64-c55a-45d2-aec5-d5885daafb3e None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:59.920421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 528/1049] 10.222.0.45 () {56 vars in 1115 bytes} [Thu May 26 13:40:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:40:59.921810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f9dea-acf3-44a3-a219-d6d3649bb1ff None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:00.026420 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f9dea-acf3-44a3-a219-d6d3649bb1ff None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:00.060584 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18487a-f9e9-4b4c-aaee-09a68b81fe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:00.061410 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18487a-f9e9-4b4c-aaee-09a68b81fe10 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:00.061693 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18487a-f9e9-4b4c-aaee-09a68b81fe10 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:00.061967 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18487a-f9e9-4b4c-aaee-09a68b81fe10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:00.072652 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18487a-f9e9-4b4c-aaee-09a68b81fe10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:00.074133 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18487a-f9e9-4b4c-aaee-09a68b81fe10 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:00.091235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-8d18487a-f9e9-4b4c-aaee-09a68b81fe10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:41:00.091235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:00.091235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:00.091235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:00.091235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:00.091235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:00.091235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:00.091235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:00.091235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:00.091235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:00.091235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:00.091235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:00.091235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:41:00.091235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:41:00.091235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:41:00.092174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:41:00.092174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:00.092174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:00.092174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:00.092174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:00.092174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:00.092174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:00.092174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:00.092174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:41:00.092174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:00.092174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:00.092174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:00.092174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:00.092174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:00.092174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:00.092174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:00.092174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:00.098110 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:41:00.098110 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:41:00.098110 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:41:00.098110 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:41:00.098110 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 522/1050] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:41:00.099981 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71574e64-c55a-45d2-aec5-d5885daafb3e None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:00.120773 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146b44f-e003-47d7-922f-190827eb8e2c None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:00.121073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146b44f-e003-47d7-922f-190827eb8e2c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:00.121384 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146b44f-e003-47d7-922f-190827eb8e2c None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:00.122868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 523/1051] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:41:00.127862 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bed0e9-67aa-48a0-861d-43cbba84a604 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:00.128151 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bed0e9-67aa-48a0-861d-43cbba84a604 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:00.128434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bed0e9-67aa-48a0-861d-43cbba84a604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:00.145821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-07bed0e9-67aa-48a0-861d-43cbba84a604 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:00.147104 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-07bed0e9-67aa-48a0-861d-43cbba84a604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:00.156856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:00.207177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:00.217536 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71574e64-c55a-45d2-aec5-d5885daafb3e None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:00.229623 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 524/1052] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 13:41:00.253362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bed0e9-67aa-48a0-861d-43cbba84a604 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:00.257088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385d3db-5167-4943-b317-54ddae9bea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:00.258049 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385d3db-5167-4943-b317-54ddae9bea48 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:00.258335 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385d3db-5167-4943-b317-54ddae9bea48 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:00.258612 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385d3db-5167-4943-b317-54ddae9bea48 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:00.259332 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385d3db-5167-4943-b317-54ddae9bea48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:00.259641 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385d3db-5167-4943-b317-54ddae9bea48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:00.261004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385d3db-5167-4943-b317-54ddae9bea48 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:00.275024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 529/1053] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:00.280314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385d3db-5167-4943-b317-54ddae9bea48 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:00.362062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bed0e9-67aa-48a0-861d-43cbba84a604 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:00.381468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385d3db-5167-4943-b317-54ddae9bea48 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:00.396398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208579a-232f-4115-989d-dc1098fef594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:00.397181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208579a-232f-4115-989d-dc1098fef594 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:00.397488 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208579a-232f-4115-989d-dc1098fef594 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:00.397764 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208579a-232f-4115-989d-dc1098fef594 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:00.408121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208579a-232f-4115-989d-dc1098fef594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:41:00.415018 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913886b-ed50-4f52-abd5-bfa2c4ee1c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:00.415722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-6208579a-232f-4115-989d-dc1098fef594 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:41:00.415722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:00.415722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:00.415722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:00.415722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:00.415722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:00.415722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:00.415722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:00.415722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:00.415722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:00.415722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:00.415722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:00.415722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:41:00.415722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:41:00.415722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:41:00.415722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:41:00.416813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:41:00.416813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:41:00.416813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:41:00.416813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:41:00.416813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:00.416813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:00.416813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:00.416813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:00.416813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:00.416813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:00.416813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:00.416813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:41:00.416813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:00.416813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:00.416813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:00.416813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:00.417718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:00.417718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:00.417718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:00.417718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:00.417718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:41:00.417718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:41:00.417718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:41:00.417718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:41:00.417718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:41:00.417718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:41:00.417718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:41:00.417718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:41:00.418375 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913886b-ed50-4f52-abd5-bfa2c4ee1c5e None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:00.418375 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913886b-ed50-4f52-abd5-bfa2c4ee1c5e None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:00.418375 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913886b-ed50-4f52-abd5-bfa2c4ee1c5e None admin] PATH_INFO: `/v3/users/nova` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:00.418564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 525/1054] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:41:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:41:00.418564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34f5ce-c596-475b-80a3-534e9c793bf9 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:00.418564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34f5ce-c596-475b-80a3-534e9c793bf9 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:00.418828 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34f5ce-c596-475b-80a3-534e9c793bf9 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:00.419842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 526/1055] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:00.422711 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34f5ce-c596-475b-80a3-534e9c793bf9 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:00.426860 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:00.429631 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913886b-ed50-4f52-abd5-bfa2c4ee1c5e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:00.431035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913886b-ed50-4f52-abd5-bfa2c4ee1c5e None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:00.446930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-1913886b-ed50-4f52-abd5-bfa2c4ee1c5e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 13:41:00.446930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:00.446930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:00.446930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:00.446930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:00.446930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:00.446930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:00.446930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:00.446930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:00.446930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:00.446930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:00.446930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:00.446930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:41:00.446930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:41:00.446930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:41:00.446930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:41:00.447978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:00.447978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:00.447978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:41:00.447978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:41:00.447978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:41:00.447978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:41:00.447978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:00.447978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:00.447978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:00.447978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:00.447978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:00.447978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:41:00.447978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:00.447978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:00.447978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:00.447978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:00.447978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:00.447978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:00.448982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:00.448982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:00.448982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:41:00.448982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:41:00.448982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:41:00.448982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:41:00.448982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:41:00.448982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:41:00.448982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 13:41:00.448982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:41:00.449587 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 530/1056] 10.222.0.45 () {56 vars in 1093 bytes} [Thu May 26 13:41:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:41:00.451068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb9a64-f8d0-4397-96b0-ac9d84ecb681 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:00.451788 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb9a64-f8d0-4397-96b0-ac9d84ecb681 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:00.452075 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb9a64-f8d0-4397-96b0-ac9d84ecb681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:00.469082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-c5bb9a64-f8d0-4397-96b0-ac9d84ecb681 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:00.470858 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-c5bb9a64-f8d0-4397-96b0-ac9d84ecb681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:00.478423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:00.529708 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34f5ce-c596-475b-80a3-534e9c793bf9 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:00.536935 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 531/1057] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:41:00.537648 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb9a64-f8d0-4397-96b0-ac9d84ecb681 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:00.563907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0b1a6-bcd9-4d50-a8c9-22b0ba2be2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:00.564573 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0b1a6-bcd9-4d50-a8c9-22b0ba2be2c7 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:00.564852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0b1a6-bcd9-4d50-a8c9-22b0ba2be2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:00.565125 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0b1a6-bcd9-4d50-a8c9-22b0ba2be2c7 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:00.565884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0b1a6-bcd9-4d50-a8c9-22b0ba2be2c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:00.566190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0b1a6-bcd9-4d50-a8c9-22b0ba2be2c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:00.567551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0b1a6-bcd9-4d50-a8c9-22b0ba2be2c7 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:00.576127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 527/1058] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:41:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:41:00.577008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0b1a6-bcd9-4d50-a8c9-22b0ba2be2c7 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:00.638341 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:00.647950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb9a64-f8d0-4397-96b0-ac9d84ecb681 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:00.678764 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0b1a6-bcd9-4d50-a8c9-22b0ba2be2c7 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:00.681008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd2e6b-8899-4152-8098-1acd643c71c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:00.681715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd2e6b-8899-4152-8098-1acd643c71c9 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:00.681997 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd2e6b-8899-4152-8098-1acd643c71c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:00.682278 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd2e6b-8899-4152-8098-1acd643c71c9 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:00.683113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd2e6b-8899-4152-8098-1acd643c71c9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:00.683421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd2e6b-8899-4152-8098-1acd643c71c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:00.684824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd2e6b-8899-4152-8098-1acd643c71c9 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:00.698864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:00.702883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 532/1059] 10.222.0.45 () {56 vars in 1133 bytes} [Thu May 26 13:41:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:00.703635 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd2e6b-8899-4152-8098-1acd643c71c9 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:00.717467 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f66945-45ac-4f2c-9657-d33ac8ee69fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:00.718466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f66945-45ac-4f2c-9657-d33ac8ee69fc None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:00.718746 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f66945-45ac-4f2c-9657-d33ac8ee69fc None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:00.719020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f66945-45ac-4f2c-9657-d33ac8ee69fc None admin] PATH_INFO: `/v3/services/image` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:00.719661 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f66945-45ac-4f2c-9657-d33ac8ee69fc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:00.721588 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f66945-45ac-4f2c-9657-d33ac8ee69fc None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:00.732769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-b0f66945-45ac-4f2c-9657-d33ac8ee69fc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 13:41:00.732769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:00.732769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:41:00.732769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:41:00.732769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:41:00.732769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:41:00.732769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:41:00.732769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:41:00.732769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 13:41:00.732769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:41:00.732769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:41:00.732769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:41:00.732769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:00.732769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:00.732769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:00.732769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:00.732769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:00.733779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:00.733779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:00.733779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:00.733779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:00.733779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:00.733779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:00.733779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:41:00.733779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:41:00.733779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:41:00.733779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:41:00.733779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:00.733779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:00.733779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:00.733779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:00.733779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:00.733779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:00.734644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:00.734644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:41:00.734644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:00.734644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:00.734644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:00.734644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:00.734644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:00.734644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:00.734644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:00.734644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:00.734644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:41:00.734644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:41:00.734644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 13:41:00.734644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:41:00.734644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 528/1060] 10.222.0.45 () {56 vars in 1105 bytes} [Thu May 26 13:41:00 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:41:00.735511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f66945-45ac-4f2c-9657-d33ac8ee69fc None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:00.807036 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd2e6b-8899-4152-8098-1acd643c71c9 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:00.831549 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f66945-45ac-4f2c-9657-d33ac8ee69fc None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:00.839990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911598dd-5814-4e93-a562-76d99793505a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:00.840851 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911598dd-5814-4e93-a562-76d99793505a None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:00.841135 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911598dd-5814-4e93-a562-76d99793505a None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:00.841447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911598dd-5814-4e93-a562-76d99793505a None admin] PATH_INFO: `/v3/users/99e599bb39bc4c30908f2e81142b9462` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:00.855290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911598dd-5814-4e93-a562-76d99793505a None admin] RBAC: Authorizing `identity:get_user(user_id=99e599bb39bc4c30908f2e81142b9462)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:00.856711 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911598dd-5814-4e93-a562-76d99793505a None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:00.856863 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:00.858398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 533/1061] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:41:00 2022] GET /identity/v3/users/99e599bb39bc4c30908f2e81142b9462 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:00.859252 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911598dd-5814-4e93-a562-76d99793505a None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:00.866699 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44eb1d-f4ee-40d1-b06b-6eb77a2bbc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:00.867481 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44eb1d-f4ee-40d1-b06b-6eb77a2bbc98 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:00.867759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44eb1d-f4ee-40d1-b06b-6eb77a2bbc98 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:00.868030 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44eb1d-f4ee-40d1-b06b-6eb77a2bbc98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:00.879762 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44eb1d-f4ee-40d1-b06b-6eb77a2bbc98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:00.881190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44eb1d-f4ee-40d1-b06b-6eb77a2bbc98 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:00.898239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-2c44eb1d-f4ee-40d1-b06b-6eb77a2bbc98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:41:00.898239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:00.898239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:00.898239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:00.898239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:00.898239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:00.898239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:00.898239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:00.898239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:00.898239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:00.898239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:00.898239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:00.898239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:41:00.898239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:41:00.898239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:41:00.899359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:41:00.899359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:00.899359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:00.899359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:00.899359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:00.899359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:00.899359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:00.899359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:00.899359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:41:00.899359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:00.899359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:00.899359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:00.899359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:00.899359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:00.899359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:00.899359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:00.899359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:00.900469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:41:00.900469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:41:00.900469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:41:00.900469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:41:00.900469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 529/1062] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:41:00.900469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44eb1d-f4ee-40d1-b06b-6eb77a2bbc98 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:00.924791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:00.964341 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911598dd-5814-4e93-a562-76d99793505a None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:00.997863 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44eb1d-f4ee-40d1-b06b-6eb77a2bbc98 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:00.998640 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde78ff-b8ab-47da-9a13-241000d8c3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:00.999303 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde78ff-b8ab-47da-9a13-241000d8c3a0 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:00.999589 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde78ff-b8ab-47da-9a13-241000d8c3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:00.999871 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde78ff-b8ab-47da-9a13-241000d8c3a0 None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:01.000581 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde78ff-b8ab-47da-9a13-241000d8c3a0 None admin] RBAC: Adding query filter params (name=image) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:01.000887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde78ff-b8ab-47da-9a13-241000d8c3a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:01.002324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde78ff-b8ab-47da-9a13-241000d8c3a0 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:01.011857 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 534/1063] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:41:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:01.011857 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde78ff-b8ab-47da-9a13-241000d8c3a0 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:01.031047 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9a0bc-0bff-4a6d-befb-b3d23841c12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:01.031689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9a0bc-0bff-4a6d-befb-b3d23841c12c None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:01.031973 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9a0bc-0bff-4a6d-befb-b3d23841c12c None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:01.032252 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9a0bc-0bff-4a6d-befb-b3d23841c12c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:01.082349 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:01.101238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9a0bc-0bff-4a6d-befb-b3d23841c12c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:01.102727 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9a0bc-0bff-4a6d-befb-b3d23841c12c None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:01.106233 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde78ff-b8ab-47da-9a13-241000d8c3a0 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:01.128303 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:01.140419 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436601fc-789f-404a-9741-0cf147cf4f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:01.141073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436601fc-789f-404a-9741-0cf147cf4f74 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:01.141379 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436601fc-789f-404a-9741-0cf147cf4f74 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:01.142190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436601fc-789f-404a-9741-0cf147cf4f74 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:01.142901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436601fc-789f-404a-9741-0cf147cf4f74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:01.143212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436601fc-789f-404a-9741-0cf147cf4f74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:01.144543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436601fc-789f-404a-9741-0cf147cf4f74 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:01.155538 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 535/1064] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:01.156491 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436601fc-789f-404a-9741-0cf147cf4f74 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:01.205581 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 530/1065] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:41:00 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 13:41:01.206551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9a0bc-0bff-4a6d-befb-b3d23841c12c None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:01.255143 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436601fc-789f-404a-9741-0cf147cf4f74 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:01.284507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:01.289219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470a594-4ff9-42c3-ad66-7aac77955940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:01.289903 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470a594-4ff9-42c3-ad66-7aac77955940 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:01.290184 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470a594-4ff9-42c3-ad66-7aac77955940 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:01.290460 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470a594-4ff9-42c3-ad66-7aac77955940 None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:01.291160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470a594-4ff9-42c3-ad66-7aac77955940 None admin] RBAC: Adding query filter params (type=image) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:01.291466 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470a594-4ff9-42c3-ad66-7aac77955940 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:01.292803 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470a594-4ff9-42c3-ad66-7aac77955940 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:01.297602 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 536/1066] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:41:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:01.298402 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470a594-4ff9-42c3-ad66-7aac77955940 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:01.303674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9a0bc-0bff-4a6d-befb-b3d23841c12c None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:01.336920 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa82ef-6032-4149-9e55-9cd80de9fbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:01.337654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa82ef-6032-4149-9e55-9cd80de9fbce None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:01.337932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa82ef-6032-4149-9e55-9cd80de9fbce None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:01.338203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa82ef-6032-4149-9e55-9cd80de9fbce None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:01.344607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa82ef-6032-4149-9e55-9cd80de9fbce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:01.345573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:01.346653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa82ef-6032-4149-9e55-9cd80de9fbce None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:01.360904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-ddfa82ef-6032-4149-9e55-9cd80de9fbce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:41:01.360904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:01.360904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:01.360904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:01.360904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:01.360904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:01.360904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:01.360904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:01.360904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:01.360904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:01.360904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:01.360904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:01.360904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:41:01.360904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:41:01.360904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:41:01.361929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:41:01.361929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:01.361929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:01.361929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:01.361929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:01.361929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:01.361929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:01.361929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:01.361929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:41:01.361929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:01.361929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:01.361929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:01.361929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:01.361929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:01.361929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:01.361929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:01.361929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:01.362852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:41:01.362852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:41:01.362852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:41:01.362852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:41:01.362852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:41:01.362852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:41:01.362852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:41:01.362852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:41:01.362852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 531/1067] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:41:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:41:01.363348 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa82ef-6032-4149-9e55-9cd80de9fbce None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:01.400914 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470a594-4ff9-42c3-ad66-7aac77955940 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:01.435046 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff4dab-11c0-4263-92d4-6345fc4e8beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:01.435898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff4dab-11c0-4263-92d4-6345fc4e8beb None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:01.436178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff4dab-11c0-4263-92d4-6345fc4e8beb None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:01.436453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff4dab-11c0-4263-92d4-6345fc4e8beb None admin] PATH_INFO: `/v3/projects/5f7ca70b221c408eaea2c1b5b904aaeb` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:01.437634 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff4dab-11c0-4263-92d4-6345fc4e8beb None admin] RBAC: Authorizing `identity:get_project(project_id=5f7ca70b221c408eaea2c1b5b904aaeb)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:01.439574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff4dab-11c0-4263-92d4-6345fc4e8beb None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:01.441283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 537/1068] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:41:01 2022] GET /identity/v3/projects/5f7ca70b221c408eaea2c1b5b904aaeb => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:01.442046 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff4dab-11c0-4263-92d4-6345fc4e8beb None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:01.467144 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa82ef-6032-4149-9e55-9cd80de9fbce None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:01.502883 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c9270-50dd-415b-95b9-729be06a661d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:01.503532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c9270-50dd-415b-95b9-729be06a661d None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:01.503807 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c9270-50dd-415b-95b9-729be06a661d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:01.504078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c9270-50dd-415b-95b9-729be06a661d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:01.504795 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c9270-50dd-415b-95b9-729be06a661d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:01.506178 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c9270-50dd-415b-95b9-729be06a661d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:01.513984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:01.525685 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 532/1069] 10.222.0.45 () {60 vars in 1144 bytes} [Thu May 26 13:41:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:41:01.526709 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c9270-50dd-415b-95b9-729be06a661d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:01.567413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff4dab-11c0-4263-92d4-6345fc4e8beb None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:01.584018 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:01.616935 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa7117-0fd4-44a8-a253-0ba2146fc9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:01.617533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa7117-0fd4-44a8-a253-0ba2146fc9e9 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:01.617811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa7117-0fd4-44a8-a253-0ba2146fc9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:01.618085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa7117-0fd4-44a8-a253-0ba2146fc9e9 None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:01.618878 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa7117-0fd4-44a8-a253-0ba2146fc9e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:01.619194 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa7117-0fd4-44a8-a253-0ba2146fc9e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:01.620622 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa7117-0fd4-44a8-a253-0ba2146fc9e9 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:01.634968 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 538/1070] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:41:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:01.640892 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa7117-0fd4-44a8-a253-0ba2146fc9e9 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:01.642426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c9270-50dd-415b-95b9-729be06a661d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:01.686538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0411b5-05d2-4622-a747-218cda3641fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:01.687203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0411b5-05d2-4622-a747-218cda3641fc None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:01.687479 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0411b5-05d2-4622-a747-218cda3641fc None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:01.687751 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0411b5-05d2-4622-a747-218cda3641fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:01.689127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0411b5-05d2-4622-a747-218cda3641fc None admin] RBAC: Adding query filter params (role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.project.id=5f7ca70b221c408eaea2c1b5b904aaeb, user.id=99e599bb39bc4c30908f2e81142b9462) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:01.689626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0411b5-05d2-4622-a747-218cda3641fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:01.691083 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0411b5-05d2-4622-a747-218cda3641fc None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:01.698478 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 533/1071] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:41:01 2022] GET /identity/v3/role_assignments?user.id=99e599bb39bc4c30908f2e81142b9462&scope.project.id=5f7ca70b221c408eaea2c1b5b904aaeb&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:01.765517 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa7117-0fd4-44a8-a253-0ba2146fc9e9 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:01.806498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045db211-8190-4b9a-b4eb-71ae20e7150e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:01.807410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045db211-8190-4b9a-b4eb-71ae20e7150e None admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:01.807696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045db211-8190-4b9a-b4eb-71ae20e7150e None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:01.807975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045db211-8190-4b9a-b4eb-71ae20e7150e None admin] PATH_INFO: `/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/1994043a81bb454297c208839794a479/roles/d3712d4d751a4f2f8143138c5280e128` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:01.810351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045db211-8190-4b9a-b4eb-71ae20e7150e None admin] RBAC: Authorizing `identity:create_grant(project_id=095d02b8a79c4915ac8d3c5b81e195a4, user_id=1994043a81bb454297c208839794a479, role_id=d3712d4d751a4f2f8143138c5280e128)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:01.811888 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045db211-8190-4b9a-b4eb-71ae20e7150e None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:01.827056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 539/1072] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:41:01 2022] PUT /identity/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/1994043a81bb454297c208839794a479/roles/d3712d4d751a4f2f8143138c5280e128 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:41:03.777106 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2262b-f85d-4aad-b665-d3bbf87c39fd None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:03.777690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2262b-f85d-4aad-b665-d3bbf87c39fd None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:03.777690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2262b-f85d-4aad-b665-d3bbf87c39fd None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:03.779226 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 534/1073] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:03.784233 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cee8e4-a291-422b-bea9-095389b5ef9d None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:03.784653 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cee8e4-a291-422b-bea9-095389b5ef9d None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:03.784838 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cee8e4-a291-422b-bea9-095389b5ef9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:03.801850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-64cee8e4-a291-422b-bea9-095389b5ef9d None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:03.803020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-64cee8e4-a291-422b-bea9-095389b5ef9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:03.830110 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:03.879721 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 540/1074] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:41:03.891171 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4765514-2f0a-4906-8699-809824730696 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:03.892043 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4765514-2f0a-4906-8699-809824730696 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:03.892303 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4765514-2f0a-4906-8699-809824730696 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:03.893861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 535/1075] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:03.898791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f9f1c-9343-48cd-85c9-5114053b1db5 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:03.899087 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f9f1c-9343-48cd-85c9-5114053b1db5 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:03.899368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f9f1c-9343-48cd-85c9-5114053b1db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:03.902314 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4765514-2f0a-4906-8699-809824730696 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:03.916308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-706f9f1c-9343-48cd-85c9-5114053b1db5 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:03.917530 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-706f9f1c-9343-48cd-85c9-5114053b1db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:03.984844 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:03.985037 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 541/1076] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:41:04.008098 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f9f1c-9343-48cd-85c9-5114053b1db5 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:04.031976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4765514-2f0a-4906-8699-809824730696 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:04.065373 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4847ff-a59d-40c5-a81f-3d3d392569de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:04.066010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4847ff-a59d-40c5-a81f-3d3d392569de None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:04.066288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4847ff-a59d-40c5-a81f-3d3d392569de None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:04.066567 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4847ff-a59d-40c5-a81f-3d3d392569de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:04.095793 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:04.106287 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f9f1c-9343-48cd-85c9-5114053b1db5 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:04.134532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4847ff-a59d-40c5-a81f-3d3d392569de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:04.136019 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4847ff-a59d-40c5-a81f-3d3d392569de None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:04.140203 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc9123-184b-4367-b27a-67ba570dcc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:04.140991 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc9123-184b-4367-b27a-67ba570dcc3f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:04.141304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc9123-184b-4367-b27a-67ba570dcc3f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:04.141576 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc9123-184b-4367-b27a-67ba570dcc3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:04.151404 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc9123-184b-4367-b27a-67ba570dcc3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:41:04.159006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-18bc9123-184b-4367-b27a-67ba570dcc3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:41:04.159006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:04.159006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:04.159006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:04.159006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:04.159006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:04.159006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:04.159006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:04.159006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:04.159006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:04.159006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:04.159006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:04.159006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:41:04.159006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:41:04.159006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:41:04.159006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:41:04.160082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:41:04.160082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:41:04.160082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:41:04.160082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:41:04.160082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:04.160082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:04.160082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:04.160082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:04.160082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:04.160082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:04.160082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:04.160082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:41:04.160082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:04.160082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:04.160082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:04.160082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:04.166112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:04.166112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:04.166112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:04.166112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:04.166112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:41:04.166112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:41:04.166112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:41:04.166112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:41:04.166112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:41:04.166112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:41:04.166112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:41:04.166112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:41:04.166112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 542/1077] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:41:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:41:04.166112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d97052-23a1-49e7-9ef7-f8ba0f23e501 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:04.166943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d97052-23a1-49e7-9ef7-f8ba0f23e501 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:04.166943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d97052-23a1-49e7-9ef7-f8ba0f23e501 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:04.166943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 543/1078] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:04.168305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d97052-23a1-49e7-9ef7-f8ba0f23e501 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:04.193103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:04.238455 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 536/1079] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:41:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 13:41:04.240143 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893e0ae-3a7c-496e-ad7d-4cb104aae3b1 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:04.240430 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893e0ae-3a7c-496e-ad7d-4cb104aae3b1 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:04.240707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893e0ae-3a7c-496e-ad7d-4cb104aae3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:04.258322 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-0893e0ae-3a7c-496e-ad7d-4cb104aae3b1 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:04.259514 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-0893e0ae-3a7c-496e-ad7d-4cb104aae3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:04.274737 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d97052-23a1-49e7-9ef7-f8ba0f23e501 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:04.306988 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0126a6-5092-4537-a200-9dbcbebe39df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:04.307644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0126a6-5092-4537-a200-9dbcbebe39df None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:04.307927 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0126a6-5092-4537-a200-9dbcbebe39df None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:04.308198 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0126a6-5092-4537-a200-9dbcbebe39df None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:04.308929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0126a6-5092-4537-a200-9dbcbebe39df None admin] RBAC: Adding query filter params (name=admin) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:04.309235 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0126a6-5092-4537-a200-9dbcbebe39df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:04.310613 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0126a6-5092-4537-a200-9dbcbebe39df None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:04.319747 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 544/1080] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:41:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:04.320407 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0126a6-5092-4537-a200-9dbcbebe39df None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:04.332056 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 537/1081] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:41:04.332891 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893e0ae-3a7c-496e-ad7d-4cb104aae3b1 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:04.334319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:04.419654 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0126a6-5092-4537-a200-9dbcbebe39df None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:04.423909 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:04.434328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893e0ae-3a7c-496e-ad7d-4cb104aae3b1 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:04.453835 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0704d9-c72f-4c8b-9544-cc6eeb36786b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:04.454685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0704d9-c72f-4c8b-9544-cc6eeb36786b None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:04.454966 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0704d9-c72f-4c8b-9544-cc6eeb36786b None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:04.455239 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0704d9-c72f-4c8b-9544-cc6eeb36786b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:04.466420 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0704d9-c72f-4c8b-9544-cc6eeb36786b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:04.468178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0704d9-c72f-4c8b-9544-cc6eeb36786b None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:04.468354 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906d04c-6d28-4633-a43e-752d5d29cfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:04.469292 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906d04c-6d28-4633-a43e-752d5d29cfaa None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:04.470098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906d04c-6d28-4633-a43e-752d5d29cfaa None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:04.470410 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906d04c-6d28-4633-a43e-752d5d29cfaa None admin] PATH_INFO: `/v3/users/99e599bb39bc4c30908f2e81142b9462` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:04.471598 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906d04c-6d28-4633-a43e-752d5d29cfaa None admin] RBAC: Authorizing `identity:get_user(user_id=99e599bb39bc4c30908f2e81142b9462)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:04.473006 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906d04c-6d28-4633-a43e-752d5d29cfaa None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:04.474647 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 538/1082] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:41:04 2022] GET /identity/v3/users/99e599bb39bc4c30908f2e81142b9462 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:04.475404 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906d04c-6d28-4633-a43e-752d5d29cfaa None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:04.491068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-4b0704d9-c72f-4c8b-9544-cc6eeb36786b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:41:04.491068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:04.491068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:04.491068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:04.491068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:04.491068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:04.491068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:04.491068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:04.491068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:04.491068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:04.491068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:04.491068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:04.491068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:41:04.491068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:41:04.491068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:41:04.492187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:41:04.492187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:04.492187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:04.492187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:04.492187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:04.492187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:04.492187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:04.492187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:04.492187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:41:04.492187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:04.492187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:04.492187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:04.492187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:04.492187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:04.492187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:04.492187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:04.492187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:04.493388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:41:04.493388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:41:04.493388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:41:04.493388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:41:04.493388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 545/1083] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:41:04.493388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0704d9-c72f-4c8b-9544-cc6eeb36786b None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:04.555850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:04.574443 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906d04c-6d28-4633-a43e-752d5d29cfaa None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:04.592465 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0704d9-c72f-4c8b-9544-cc6eeb36786b None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:04.608305 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481d45b-2d8f-4764-bd1d-d6212353030e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:04.609104 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481d45b-2d8f-4764-bd1d-d6212353030e None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:04.609423 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481d45b-2d8f-4764-bd1d-d6212353030e None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:04.609696 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481d45b-2d8f-4764-bd1d-d6212353030e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:04.620532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481d45b-2d8f-4764-bd1d-d6212353030e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:41:04.626169 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c28883-0eaf-4341-b6ee-71782df9fdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:04.627013 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c28883-0eaf-4341-b6ee-71782df9fdf7 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:04.627292 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c28883-0eaf-4341-b6ee-71782df9fdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:04.627565 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c28883-0eaf-4341-b6ee-71782df9fdf7 None admin] PATH_INFO: `/v3/projects/5f7ca70b221c408eaea2c1b5b904aaeb` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:04.628723 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c28883-0eaf-4341-b6ee-71782df9fdf7 None admin] RBAC: Authorizing `identity:get_project(project_id=5f7ca70b221c408eaea2c1b5b904aaeb)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:04.628833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-2481d45b-2d8f-4764-bd1d-d6212353030e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 13:41:04.628833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:04.628833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:04.628833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:04.628833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:04.628833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:04.628833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:04.628833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:04.628833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:04.628833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:04.628833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:04.628833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:04.628833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:41:04.628833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:41:04.628833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:41:04.628833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:41:04.629952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:41:04.629952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:41:04.629952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:41:04.629952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:41:04.629952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:04.629952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:04.629952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:04.629952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:04.629952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:04.629952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:04.629952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:04.629952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:41:04.629952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:04.629952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:04.629952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:04.629952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:04.631016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:04.631016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:04.631016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:04.631016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:04.631016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:41:04.631016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:41:04.631016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:41:04.631016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:41:04.631016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:41:04.631016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:41:04.631016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 13:41:04.631016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:41:04.631682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c28883-0eaf-4341-b6ee-71782df9fdf7 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:04.631890 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 546/1084] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:41:04 2022] GET /identity/v3/projects/5f7ca70b221c408eaea2c1b5b904aaeb => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:04.632875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c28883-0eaf-4341-b6ee-71782df9fdf7 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:04.635200 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 539/1085] 10.222.0.45 () {56 vars in 1120 bytes} [Thu May 26 13:41:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:41:04.636481 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481d45b-2d8f-4764-bd1d-d6212353030e None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:04.654876 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:04.732781 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c28883-0eaf-4341-b6ee-71782df9fdf7 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:04.739581 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481d45b-2d8f-4764-bd1d-d6212353030e None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:04.761795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:04.767685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4f3d-d716-4235-935f-e85fd7c26684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:04.768340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4f3d-d716-4235-935f-e85fd7c26684 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:04.768621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4f3d-d716-4235-935f-e85fd7c26684 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:04.768896 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4f3d-d716-4235-935f-e85fd7c26684 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:04.769640 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b4f3d-d716-4235-935f-e85fd7c26684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:04.769950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b4f3d-d716-4235-935f-e85fd7c26684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:04.771294 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b4f3d-d716-4235-935f-e85fd7c26684 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:04.772344 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc79ac3-d6f1-4060-aa80-33cb9914a992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:04.772995 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc79ac3-d6f1-4060-aa80-33cb9914a992 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:04.773292 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc79ac3-d6f1-4060-aa80-33cb9914a992 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:04.773566 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc79ac3-d6f1-4060-aa80-33cb9914a992 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:04.774292 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc79ac3-d6f1-4060-aa80-33cb9914a992 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:04.774595 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc79ac3-d6f1-4060-aa80-33cb9914a992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:04.775926 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc79ac3-d6f1-4060-aa80-33cb9914a992 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:04.782805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 547/1086] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:04.783568 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4f3d-d716-4235-935f-e85fd7c26684 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:04.788754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 540/1087] 10.222.0.45 () {56 vars in 1115 bytes} [Thu May 26 13:41:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:41:04.794918 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc79ac3-d6f1-4060-aa80-33cb9914a992 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:04.892598 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:04.910748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4f3d-d716-4235-935f-e85fd7c26684 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:04.913909 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc79ac3-d6f1-4060-aa80-33cb9914a992 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:04.948892 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fed9f-126b-4273-9aa5-36d846c2d5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:04.949318 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001dbea-254b-4d8c-a67a-158e0c27e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:04.949847 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fed9f-126b-4273-9aa5-36d846c2d5a5 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:04.950134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fed9f-126b-4273-9aa5-36d846c2d5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:04.950241 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001dbea-254b-4d8c-a67a-158e0c27e62d None admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:04.950408 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fed9f-126b-4273-9aa5-36d846c2d5a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:04.950566 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001dbea-254b-4d8c-a67a-158e0c27e62d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:04.950809 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001dbea-254b-4d8c-a67a-158e0c27e62d None admin] PATH_INFO: `/v3/projects/5f7ca70b221c408eaea2c1b5b904aaeb/users/99e599bb39bc4c30908f2e81142b9462/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:04.952792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001dbea-254b-4d8c-a67a-158e0c27e62d None admin] RBAC: Authorizing `identity:create_grant(project_id=5f7ca70b221c408eaea2c1b5b904aaeb, user_id=99e599bb39bc4c30908f2e81142b9462, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:04.954801 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001dbea-254b-4d8c-a67a-158e0c27e62d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:04.963205 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fed9f-126b-4273-9aa5-36d846c2d5a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:04.964674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fed9f-126b-4273-9aa5-36d846c2d5a5 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:04.968805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 548/1088] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:41:04 2022] PUT /identity/v3/projects/5f7ca70b221c408eaea2c1b5b904aaeb/users/99e599bb39bc4c30908f2e81142b9462/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:41:04.984318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-271fed9f-126b-4273-9aa5-36d846c2d5a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:41:04.984318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:04.984318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:04.984318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:04.984318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:04.984318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:04.984318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:04.984318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:04.984318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:04.984318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:04.984318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:04.984318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:04.984318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:41:04.984318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:41:04.984318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:41:04.985616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:41:04.985616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:04.985616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:04.985616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:04.985616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:04.985616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:04.985616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:04.985616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:04.985616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:41:04.985616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:04.985616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:04.985616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:04.985616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:04.985616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:04.985616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:04.985616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:04.985616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:04.986902 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:41:04.986902 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:41:04.986902 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:41:04.986902 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:41:04.986902 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 541/1089] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:41:04.991873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001dbea-254b-4d8c-a67a-158e0c27e62d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:05.053105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:05.108733 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001dbea-254b-4d8c-a67a-158e0c27e62d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:05.146783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15dbd51-d979-437c-b2ed-efee2b48fd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:05.147452 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dbd51-d979-437c-b2ed-efee2b48fd9d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:05.147736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dbd51-d979-437c-b2ed-efee2b48fd9d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:05.148012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dbd51-d979-437c-b2ed-efee2b48fd9d None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:05.148742 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15dbd51-d979-437c-b2ed-efee2b48fd9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:05.149051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15dbd51-d979-437c-b2ed-efee2b48fd9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:05.150446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15dbd51-d979-437c-b2ed-efee2b48fd9d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:05.164032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 549/1090] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:41:05.169913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fed9f-126b-4273-9aa5-36d846c2d5a5 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:05.270186 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fed9f-126b-4273-9aa5-36d846c2d5a5 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:05.298226 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:05.303209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee118bf3-d8f0-4b5d-b900-8b9827e3c29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:05.303932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee118bf3-d8f0-4b5d-b900-8b9827e3c29d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:05.304216 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee118bf3-d8f0-4b5d-b900-8b9827e3c29d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:05.304493 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee118bf3-d8f0-4b5d-b900-8b9827e3c29d None admin] PATH_INFO: `/v3/users/nova` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:05.312181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee118bf3-d8f0-4b5d-b900-8b9827e3c29d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:05.314191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee118bf3-d8f0-4b5d-b900-8b9827e3c29d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:05.328021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-ee118bf3-d8f0-4b5d-b900-8b9827e3c29d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 13:41:05.328021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:05.328021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:05.328021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:05.328021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:05.328021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:05.328021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:05.328021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:05.328021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:05.328021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:05.328021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:05.328021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:05.328021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:41:05.328021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:41:05.328021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:41:05.328021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:41:05.329755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:05.329755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:05.329755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:41:05.329755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:41:05.329755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:41:05.329755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:41:05.329755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:05.329755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:05.329755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:05.329755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:05.329755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:05.329755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:41:05.329755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:05.329755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:05.329755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:05.329755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:05.329755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:05.329755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:05.330782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:05.330782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:05.330782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:41:05.330782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:41:05.330782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:41:05.330782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:41:05.330782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:41:05.330782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:41:05.330782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 13:41:05.330782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:41:05.330782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 542/1091] 10.222.0.45 () {56 vars in 1093 bytes} [Thu May 26 13:41:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:41:05.335553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15dbd51-d979-437c-b2ed-efee2b48fd9d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:05.432542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15dbd51-d979-437c-b2ed-efee2b48fd9d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:05.446261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:05.467971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cade373-43b4-4f7c-8e85-4646b6046601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:05.468641 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cade373-43b4-4f7c-8e85-4646b6046601 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:05.468924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cade373-43b4-4f7c-8e85-4646b6046601 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:05.469203 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cade373-43b4-4f7c-8e85-4646b6046601 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:05.470123 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cade373-43b4-4f7c-8e85-4646b6046601 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:05.470436 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cade373-43b4-4f7c-8e85-4646b6046601 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:05.471867 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cade373-43b4-4f7c-8e85-4646b6046601 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:05.488718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 550/1092] 10.222.0.45 () {56 vars in 1133 bytes} [Thu May 26 13:41:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:05.494436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee118bf3-d8f0-4b5d-b900-8b9827e3c29d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:05.593025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee118bf3-d8f0-4b5d-b900-8b9827e3c29d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:05.629122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa8f83-0c08-43ef-bec1-9cdaaecc8612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:05.629808 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa8f83-0c08-43ef-bec1-9cdaaecc8612 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:05.630093 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa8f83-0c08-43ef-bec1-9cdaaecc8612 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:05.630369 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa8f83-0c08-43ef-bec1-9cdaaecc8612 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:05.691360 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:05.701287 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa8f83-0c08-43ef-bec1-9cdaaecc8612 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:05.702743 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa8f83-0c08-43ef-bec1-9cdaaecc8612 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:05.800963 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 543/1093] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:41:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 13:41:05.806880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cade373-43b4-4f7c-8e85-4646b6046601 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:05.905961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cade373-43b4-4f7c-8e85-4646b6046601 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:05.939199 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0239a62-13a8-4ee3-a0ae-1c1ae63eddde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:05.939976 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0239a62-13a8-4ee3-a0ae-1c1ae63eddde None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:05.940259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0239a62-13a8-4ee3-a0ae-1c1ae63eddde None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:05.940537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0239a62-13a8-4ee3-a0ae-1c1ae63eddde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:05.950281 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0239a62-13a8-4ee3-a0ae-1c1ae63eddde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:05.951711 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0239a62-13a8-4ee3-a0ae-1c1ae63eddde None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:05.969193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-a0239a62-13a8-4ee3-a0ae-1c1ae63eddde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:41:05.969193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:05.969193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:05.969193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:05.969193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:05.969193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:05.969193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:05.969193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:05.969193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:05.969193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:05.969193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:05.969193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:05.969193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:41:05.969193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:41:05.969193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:41:05.970262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:41:05.970262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:05.970262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:05.970262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:05.970262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:05.970262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:05.970262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:05.970262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:05.970262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:41:05.970262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:05.970262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:05.970262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:05.970262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:05.970262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:05.970262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:05.970262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:05.970262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:05.971220 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:41:05.971220 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:41:05.971220 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:41:05.971220 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:41:05.971220 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 551/1094] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:41:05.976080 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa8f83-0c08-43ef-bec1-9cdaaecc8612 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:06.062443 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:06.071890 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa8f83-0c08-43ef-bec1-9cdaaecc8612 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:06.107313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae799228-5a1a-49a8-ae4e-97832f9daaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:06.107966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae799228-5a1a-49a8-ae4e-97832f9daaf3 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:06.108243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae799228-5a1a-49a8-ae4e-97832f9daaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:06.108513 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae799228-5a1a-49a8-ae4e-97832f9daaf3 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:06.109216 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae799228-5a1a-49a8-ae4e-97832f9daaf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:06.109547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae799228-5a1a-49a8-ae4e-97832f9daaf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:06.111437 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae799228-5a1a-49a8-ae4e-97832f9daaf3 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:06.122329 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 544/1095] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:06.128177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0239a62-13a8-4ee3-a0ae-1c1ae63eddde None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:06.152200 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:06.225915 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0239a62-13a8-4ee3-a0ae-1c1ae63eddde None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:06.259412 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c001d4-1723-43a6-95df-14c36c8c2b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:06.260190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c001d4-1723-43a6-95df-14c36c8c2b2b None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:06.260476 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c001d4-1723-43a6-95df-14c36c8c2b2b None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:06.260752 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c001d4-1723-43a6-95df-14c36c8c2b2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:06.267839 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c001d4-1723-43a6-95df-14c36c8c2b2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:06.269254 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c001d4-1723-43a6-95df-14c36c8c2b2b None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:06.282740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-a7c001d4-1723-43a6-95df-14c36c8c2b2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:41:06.282740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:06.282740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:06.282740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:06.282740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:06.282740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:06.282740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:06.282740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:06.282740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:06.282740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:06.282740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:06.282740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:06.282740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:41:06.282740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:41:06.282740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:41:06.283822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:41:06.283822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:06.283822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:06.283822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:06.283822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:06.283822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:06.283822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:06.283822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:06.283822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:41:06.283822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:06.283822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:06.283822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:06.283822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:06.283822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:06.283822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:06.283822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:06.283822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:06.284745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:41:06.284745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:41:06.284745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:41:06.284745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:41:06.284745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:41:06.284745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:41:06.284745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:41:06.284745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:41:06.284745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 552/1096] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:41:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:41:06.289752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae799228-5a1a-49a8-ae4e-97832f9daaf3 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:06.386326 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae799228-5a1a-49a8-ae4e-97832f9daaf3 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:06.417998 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a787cd-4a5d-4aa9-8cb9-f4237c0e42c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:06.418640 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a787cd-4a5d-4aa9-8cb9-f4237c0e42c9 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:06.418918 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a787cd-4a5d-4aa9-8cb9-f4237c0e42c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:06.419188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a787cd-4a5d-4aa9-8cb9-f4237c0e42c9 None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:06.419953 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a787cd-4a5d-4aa9-8cb9-f4237c0e42c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:06.420256 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a787cd-4a5d-4aa9-8cb9-f4237c0e42c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:06.421705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a787cd-4a5d-4aa9-8cb9-f4237c0e42c9 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:06.433713 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 545/1097] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:41:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:06.440402 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c001d4-1723-43a6-95df-14c36c8c2b2b None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:06.520240 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:06.537975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c001d4-1723-43a6-95df-14c36c8c2b2b None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:06.571114 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8e831-531a-4602-af4f-ff72ff2fa22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:06.571767 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8e831-531a-4602-af4f-ff72ff2fa22f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:06.572052 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8e831-531a-4602-af4f-ff72ff2fa22f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:06.572332 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8e831-531a-4602-af4f-ff72ff2fa22f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:06.573154 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8e831-531a-4602-af4f-ff72ff2fa22f None admin] RBAC: Adding query filter params (role.id=d3712d4d751a4f2f8143138c5280e128, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=1994043a81bb454297c208839794a479) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:06.573499 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8e831-531a-4602-af4f-ff72ff2fa22f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:06.574907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8e831-531a-4602-af4f-ff72ff2fa22f None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:06.581179 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 553/1098] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:41:06 2022] GET /identity/v3/role_assignments?user.id=1994043a81bb454297c208839794a479&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=d3712d4d751a4f2f8143138c5280e128 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:07.209664 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984b4ea-0c80-42d2-9b86-1042dc811167 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:07.210180 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984b4ea-0c80-42d2-9b86-1042dc811167 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:07.210275 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984b4ea-0c80-42d2-9b86-1042dc811167 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:07.211552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 546/1099] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:07.216808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191a971-ac0f-443a-9915-e071cbdcc0c9 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:07.217239 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191a971-ac0f-443a-9915-e071cbdcc0c9 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:07.217403 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191a971-ac0f-443a-9915-e071cbdcc0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:07.234785 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-0191a971-ac0f-443a-9915-e071cbdcc0c9 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:07.236445 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0191a971-ac0f-443a-9915-e071cbdcc0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:07.308747 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 554/1100] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:41:07.332704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984b4ea-0c80-42d2-9b86-1042dc811167 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:07.347871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:07.434914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984b4ea-0c80-42d2-9b86-1042dc811167 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:07.468170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f09b8-cb97-4e97-ba09-914009d54deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:07.468893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f09b8-cb97-4e97-ba09-914009d54deb None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:07.469176 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f09b8-cb97-4e97-ba09-914009d54deb None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:07.469987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f09b8-cb97-4e97-ba09-914009d54deb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:07.479800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f09b8-cb97-4e97-ba09-914009d54deb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:41:07.488059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-4b9f09b8-cb97-4e97-ba09-914009d54deb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:41:07.488059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:07.488059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:07.488059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:07.488059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:07.488059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:07.488059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:07.488059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:07.488059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:07.488059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:07.488059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:07.488059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:07.488059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:41:07.488059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:41:07.488059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:41:07.488059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:41:07.489317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:41:07.489317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:41:07.489317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:41:07.489317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:41:07.489317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:07.489317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:07.489317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:07.489317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:07.489317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:07.489317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:07.489317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:07.489317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:41:07.489317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:07.489317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:07.489317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:07.489317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:07.490495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:07.490495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:07.490495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:07.490495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:07.490495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:41:07.490495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:41:07.490495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:41:07.490495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:41:07.490495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:41:07.490495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:41:07.490495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:41:07.490495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:41:07.490495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 547/1101] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:41:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:41:07.495208 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191a971-ac0f-443a-9915-e071cbdcc0c9 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:07.567270 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:07.589575 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191a971-ac0f-443a-9915-e071cbdcc0c9 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:07.625307 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b843f-cbfd-4af0-893e-19859369537b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:07.625991 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b843f-cbfd-4af0-893e-19859369537b None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:07.626269 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b843f-cbfd-4af0-893e-19859369537b None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:07.626542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b843f-cbfd-4af0-893e-19859369537b None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:07.627276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b843f-cbfd-4af0-893e-19859369537b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:07.627580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b843f-cbfd-4af0-893e-19859369537b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:07.628978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b843f-cbfd-4af0-893e-19859369537b None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:07.637063 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 555/1102] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:41:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:07.642954 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f09b8-cb97-4e97-ba09-914009d54deb None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:07.711421 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:07.741619 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f09b8-cb97-4e97-ba09-914009d54deb None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:07.773348 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5b906-90eb-47ef-9317-a3ebc5b63fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:07.774202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5b906-90eb-47ef-9317-a3ebc5b63fec None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:07.774480 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5b906-90eb-47ef-9317-a3ebc5b63fec None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:07.774749 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5b906-90eb-47ef-9317-a3ebc5b63fec None admin] PATH_INFO: `/v3/users/99e599bb39bc4c30908f2e81142b9462` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:07.775913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5b906-90eb-47ef-9317-a3ebc5b63fec None admin] RBAC: Authorizing `identity:get_user(user_id=99e599bb39bc4c30908f2e81142b9462)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:07.777364 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5b906-90eb-47ef-9317-a3ebc5b63fec None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:07.778960 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 548/1103] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:41:07 2022] GET /identity/v3/users/99e599bb39bc4c30908f2e81142b9462 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:07.785212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b843f-cbfd-4af0-893e-19859369537b None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:07.882235 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b843f-cbfd-4af0-893e-19859369537b None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:07.914647 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf049e3-f7db-4ef6-9e06-8516e21f158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:07.915271 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf049e3-f7db-4ef6-9e06-8516e21f158e None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:07.915548 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf049e3-f7db-4ef6-9e06-8516e21f158e None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:07.915819 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf049e3-f7db-4ef6-9e06-8516e21f158e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:07.923750 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:07.980200 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf049e3-f7db-4ef6-9e06-8516e21f158e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:07.981652 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf049e3-f7db-4ef6-9e06-8516e21f158e None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:08.073350 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 556/1104] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:41:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 13:41:08.079686 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5b906-90eb-47ef-9317-a3ebc5b63fec None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:08.175582 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5b906-90eb-47ef-9317-a3ebc5b63fec None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:08.208523 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b41e0-245d-4f14-ba28-3afed83b815d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:08.209398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b41e0-245d-4f14-ba28-3afed83b815d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:08.209676 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b41e0-245d-4f14-ba28-3afed83b815d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:08.209943 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b41e0-245d-4f14-ba28-3afed83b815d None admin] PATH_INFO: `/v3/projects/5f7ca70b221c408eaea2c1b5b904aaeb` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:08.211101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b41e0-245d-4f14-ba28-3afed83b815d None admin] RBAC: Authorizing `identity:get_project(project_id=5f7ca70b221c408eaea2c1b5b904aaeb)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:08.212519 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b41e0-245d-4f14-ba28-3afed83b815d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:08.214195 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 549/1105] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:41:08 2022] GET /identity/v3/projects/5f7ca70b221c408eaea2c1b5b904aaeb => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:08.220251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf049e3-f7db-4ef6-9e06-8516e21f158e None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:08.258126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:08.315939 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf049e3-f7db-4ef6-9e06-8516e21f158e None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:08.348392 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc2a01-e5ad-42c0-8de0-eca43e3bd91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:08.349059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc2a01-e5ad-42c0-8de0-eca43e3bd91a None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:08.349372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc2a01-e5ad-42c0-8de0-eca43e3bd91a None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:08.349650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc2a01-e5ad-42c0-8de0-eca43e3bd91a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:08.350462 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc2a01-e5ad-42c0-8de0-eca43e3bd91a None admin] RBAC: Adding query filter params (role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.project.id=5f7ca70b221c408eaea2c1b5b904aaeb, user.id=99e599bb39bc4c30908f2e81142b9462) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:08.350771 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc2a01-e5ad-42c0-8de0-eca43e3bd91a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:08.352165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc2a01-e5ad-42c0-8de0-eca43e3bd91a None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:08.357849 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 557/1106] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:41:08 2022] GET /identity/v3/role_assignments?user.id=99e599bb39bc4c30908f2e81142b9462&scope.project.id=5f7ca70b221c408eaea2c1b5b904aaeb&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:10.564284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6906d5-8a86-4143-8367-d84d4a9dd883 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:10.564882 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6906d5-8a86-4143-8367-d84d4a9dd883 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:10.564882 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6906d5-8a86-4143-8367-d84d4a9dd883 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:10.566219 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 550/1107] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:10.571523 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbe875-9db5-485d-9fac-f18521efce8c None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:10.571935 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbe875-9db5-485d-9fac-f18521efce8c None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:10.572083 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbe875-9db5-485d-9fac-f18521efce8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:10.588764 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-a9bbe875-9db5-485d-9fac-f18521efce8c None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:10.589968 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-a9bbe875-9db5-485d-9fac-f18521efce8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:10.653704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 558/1108] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 13:41:10.678102 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6906d5-8a86-4143-8367-d84d4a9dd883 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:10.689906 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:10.778584 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6906d5-8a86-4143-8367-d84d4a9dd883 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:10.810921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d997bc-46fc-40ad-bb87-b4bf90ba4695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:10.811700 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d997bc-46fc-40ad-bb87-b4bf90ba4695 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:10.811984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d997bc-46fc-40ad-bb87-b4bf90ba4695 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:10.812263 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d997bc-46fc-40ad-bb87-b4bf90ba4695 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:10.813967 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d997bc-46fc-40ad-bb87-b4bf90ba4695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:10.815440 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d997bc-46fc-40ad-bb87-b4bf90ba4695 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:10.816976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 551/1109] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:41:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:10.822654 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbe875-9db5-485d-9fac-f18521efce8c None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:10.851390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:10.916662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbe875-9db5-485d-9fac-f18521efce8c None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:10.948970 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4a950-bff4-41e2-ad65-6a962ffcc538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:10.949645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4a950-bff4-41e2-ad65-6a962ffcc538 None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:10.949924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4a950-bff4-41e2-ad65-6a962ffcc538 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:10.950194 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4a950-bff4-41e2-ad65-6a962ffcc538 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:10.950889 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4a950-bff4-41e2-ad65-6a962ffcc538 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:10.952308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4a950-bff4-41e2-ad65-6a962ffcc538 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:10.970855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 559/1110] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 13:41:10 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:41:13.223066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58d13d-1797-4c58-9c71-fd232429883c None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:13.223591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58d13d-1797-4c58-9c71-fd232429883c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:13.223591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58d13d-1797-4c58-9c71-fd232429883c None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:13.224953 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 552/1111] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:13.230279 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b66487-4cc9-44f4-9e48-5c07238968c7 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:13.230702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b66487-4cc9-44f4-9e48-5c07238968c7 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:13.230834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b66487-4cc9-44f4-9e48-5c07238968c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:13.247258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-e8b66487-4cc9-44f4-9e48-5c07238968c7 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:13.248437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e8b66487-4cc9-44f4-9e48-5c07238968c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:13.311784 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 560/1112] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:41:13.335073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58d13d-1797-4c58-9c71-fd232429883c None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:13.411070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:13.435157 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58d13d-1797-4c58-9c71-fd232429883c None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:13.467985 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907bf7a-3036-4464-b11b-6803feddb51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:13.468820 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907bf7a-3036-4464-b11b-6803feddb51b None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:13.469097 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907bf7a-3036-4464-b11b-6803feddb51b None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:13.469402 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907bf7a-3036-4464-b11b-6803feddb51b None admin] PATH_INFO: `/v3/roles/e6b3c27ed485430a88f59247935bfa08` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:13.470834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907bf7a-3036-4464-b11b-6803feddb51b None admin] RBAC: Authorizing `identity:get_role(role_id=e6b3c27ed485430a88f59247935bfa08)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:13.472179 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907bf7a-3036-4464-b11b-6803feddb51b None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:13.473603 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 553/1113] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:41:13 2022] GET /identity/v3/roles/e6b3c27ed485430a88f59247935bfa08 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:13.479234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b66487-4cc9-44f4-9e48-5c07238968c7 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:13.496757 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:13.576332 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b66487-4cc9-44f4-9e48-5c07238968c7 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:13.608618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780596bd-0ac7-4b71-8b21-327054046049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:13.609519 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780596bd-0ac7-4b71-8b21-327054046049 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:13.609807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780596bd-0ac7-4b71-8b21-327054046049 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:13.610086 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780596bd-0ac7-4b71-8b21-327054046049 None admin] PATH_INFO: `/v3/users/c6eff51d9e0b48b284faac6112fe804d` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:13.622460 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780596bd-0ac7-4b71-8b21-327054046049 None admin] RBAC: Authorizing `identity:get_user(user_id=c6eff51d9e0b48b284faac6112fe804d)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:13.623882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780596bd-0ac7-4b71-8b21-327054046049 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:13.626069 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 561/1114] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:41:13 2022] GET /identity/v3/users/c6eff51d9e0b48b284faac6112fe804d => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:13.631585 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907bf7a-3036-4464-b11b-6803feddb51b None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:13.730454 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907bf7a-3036-4464-b11b-6803feddb51b None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:13.763772 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a0c38-be69-4db9-837a-4854fb1bbccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:13.764400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a0c38-be69-4db9-837a-4854fb1bbccd None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:13.764677 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a0c38-be69-4db9-837a-4854fb1bbccd None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:13.764949 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a0c38-be69-4db9-837a-4854fb1bbccd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:13.779042 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:13.829575 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a0c38-be69-4db9-837a-4854fb1bbccd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:13.831013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a0c38-be69-4db9-837a-4854fb1bbccd None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:13.923679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 554/1115] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:41:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 13:41:13.929582 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780596bd-0ac7-4b71-8b21-327054046049 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:14.005793 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:14.029104 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780596bd-0ac7-4b71-8b21-327054046049 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:14.061628 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07415eef-4801-41b4-bbf7-fb6bb32a20d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:14.062472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07415eef-4801-41b4-bbf7-fb6bb32a20d6 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:14.062778 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07415eef-4801-41b4-bbf7-fb6bb32a20d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:14.063051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07415eef-4801-41b4-bbf7-fb6bb32a20d6 None admin] PATH_INFO: `/v3/projects/5f7ca70b221c408eaea2c1b5b904aaeb` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:14.064194 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07415eef-4801-41b4-bbf7-fb6bb32a20d6 None admin] RBAC: Authorizing `identity:get_project(project_id=5f7ca70b221c408eaea2c1b5b904aaeb)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:14.065614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07415eef-4801-41b4-bbf7-fb6bb32a20d6 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:14.067291 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 562/1116] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:41:13 2022] GET /identity/v3/projects/5f7ca70b221c408eaea2c1b5b904aaeb => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:14.073502 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a0c38-be69-4db9-837a-4854fb1bbccd None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:14.116864 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:14.168457 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a0c38-be69-4db9-837a-4854fb1bbccd None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:14.201132 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10f2ea-2dd6-408b-bb24-e12b982d551e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:14.201793 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10f2ea-2dd6-408b-bb24-e12b982d551e None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:14.202072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10f2ea-2dd6-408b-bb24-e12b982d551e None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:14.202344 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10f2ea-2dd6-408b-bb24-e12b982d551e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:14.203141 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10f2ea-2dd6-408b-bb24-e12b982d551e None admin] RBAC: Adding query filter params (role.id=e6b3c27ed485430a88f59247935bfa08, scope.project.id=5f7ca70b221c408eaea2c1b5b904aaeb, user.id=c6eff51d9e0b48b284faac6112fe804d) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:14.203482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10f2ea-2dd6-408b-bb24-e12b982d551e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:14.204886 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10f2ea-2dd6-408b-bb24-e12b982d551e None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:14.210217 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 555/1117] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:41:14 2022] GET /identity/v3/role_assignments?user.id=c6eff51d9e0b48b284faac6112fe804d&scope.project.id=5f7ca70b221c408eaea2c1b5b904aaeb&role.id=e6b3c27ed485430a88f59247935bfa08 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:16.361928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd856d4d-3089-40c2-a737-2c305090be5d None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:16.362458 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd856d4d-3089-40c2-a737-2c305090be5d None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:16.362458 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd856d4d-3089-40c2-a737-2c305090be5d None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:16.363858 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 563/1118] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:16.369081 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e0a3f-51e0-47ca-94e0-9f128eb2bccd None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:16.369653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e0a3f-51e0-47ca-94e0-9f128eb2bccd None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:16.369653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e0a3f-51e0-47ca-94e0-9f128eb2bccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:16.386703 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-1a7e0a3f-51e0-47ca-94e0-9f128eb2bccd None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:16.387868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1a7e0a3f-51e0-47ca-94e0-9f128eb2bccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:16.451018 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 556/1119] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:41:16.473893 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd856d4d-3089-40c2-a737-2c305090be5d None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:16.571487 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd856d4d-3089-40c2-a737-2c305090be5d None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:16.603778 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255e86d-0e9f-4a42-9f70-8dcd45351c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:16.604614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255e86d-0e9f-4a42-9f70-8dcd45351c7e None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:16.604898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255e86d-0e9f-4a42-9f70-8dcd45351c7e None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:16.605175 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255e86d-0e9f-4a42-9f70-8dcd45351c7e None admin] PATH_INFO: `/v3/roles/e6b3c27ed485430a88f59247935bfa08` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:16.606655 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255e86d-0e9f-4a42-9f70-8dcd45351c7e None admin] RBAC: Authorizing `identity:get_role(role_id=e6b3c27ed485430a88f59247935bfa08)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:16.608003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255e86d-0e9f-4a42-9f70-8dcd45351c7e None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:16.609911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 564/1120] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:41:16 2022] GET /identity/v3/roles/e6b3c27ed485430a88f59247935bfa08 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:16.615435 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e0a3f-51e0-47ca-94e0-9f128eb2bccd None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:16.652983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:16.710661 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e0a3f-51e0-47ca-94e0-9f128eb2bccd None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:16.743636 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecd6ec-2956-4cea-bc44-d773417e87a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:16.744490 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecd6ec-2956-4cea-bc44-d773417e87a0 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:16.744775 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecd6ec-2956-4cea-bc44-d773417e87a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:16.745055 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecd6ec-2956-4cea-bc44-d773417e87a0 None admin] PATH_INFO: `/v3/users/c6eff51d9e0b48b284faac6112fe804d` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:16.746247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecd6ec-2956-4cea-bc44-d773417e87a0 None admin] RBAC: Authorizing `identity:get_user(user_id=c6eff51d9e0b48b284faac6112fe804d)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:16.747667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecd6ec-2956-4cea-bc44-d773417e87a0 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:16.749288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 557/1121] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:41:16 2022] GET /identity/v3/users/c6eff51d9e0b48b284faac6112fe804d => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:16.755063 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255e86d-0e9f-4a42-9f70-8dcd45351c7e None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:16.769805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:16.851944 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255e86d-0e9f-4a42-9f70-8dcd45351c7e None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:16.884427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd5c15-90de-4f40-ad1b-71a27361ee28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:16.885214 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd5c15-90de-4f40-ad1b-71a27361ee28 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:16.885524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd5c15-90de-4f40-ad1b-71a27361ee28 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:16.885802 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd5c15-90de-4f40-ad1b-71a27361ee28 None admin] PATH_INFO: `/v3/projects/5f7ca70b221c408eaea2c1b5b904aaeb` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:16.886957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd5c15-90de-4f40-ad1b-71a27361ee28 None admin] RBAC: Authorizing `identity:get_project(project_id=5f7ca70b221c408eaea2c1b5b904aaeb)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:16.888366 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd5c15-90de-4f40-ad1b-71a27361ee28 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:16.890066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 565/1122] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:41:16 2022] GET /identity/v3/projects/5f7ca70b221c408eaea2c1b5b904aaeb => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:16.896285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecd6ec-2956-4cea-bc44-d773417e87a0 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:16.992271 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecd6ec-2956-4cea-bc44-d773417e87a0 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:16.999278 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:17.025733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51439a99-e381-4d6c-b831-afacc0d64667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:17.026606 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51439a99-e381-4d6c-b831-afacc0d64667 None admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:17.026891 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51439a99-e381-4d6c-b831-afacc0d64667 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:17.027164 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51439a99-e381-4d6c-b831-afacc0d64667 None admin] PATH_INFO: `/v3/projects/5f7ca70b221c408eaea2c1b5b904aaeb/users/c6eff51d9e0b48b284faac6112fe804d/roles/e6b3c27ed485430a88f59247935bfa08` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:17.029312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51439a99-e381-4d6c-b831-afacc0d64667 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f7ca70b221c408eaea2c1b5b904aaeb, user_id=c6eff51d9e0b48b284faac6112fe804d, role_id=e6b3c27ed485430a88f59247935bfa08)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:17.030727 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51439a99-e381-4d6c-b831-afacc0d64667 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:17.043322 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 558/1123] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:41:16 2022] PUT /identity/v3/projects/5f7ca70b221c408eaea2c1b5b904aaeb/users/c6eff51d9e0b48b284faac6112fe804d/roles/e6b3c27ed485430a88f59247935bfa08 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:41:19.213227 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb00c51-f7e1-46b4-9e79-2532f65b6bf3 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:19.213789 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb00c51-f7e1-46b4-9e79-2532f65b6bf3 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:19.213789 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb00c51-f7e1-46b4-9e79-2532f65b6bf3 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:19.215168 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 566/1124] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:19.221061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a05d14-8e88-4e5c-a42f-3d5574dcfdb1 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:19.221515 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a05d14-8e88-4e5c-a42f-3d5574dcfdb1 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:19.221648 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a05d14-8e88-4e5c-a42f-3d5574dcfdb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:19.238750 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-f2a05d14-8e88-4e5c-a42f-3d5574dcfdb1 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:19.239933 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f2a05d14-8e88-4e5c-a42f-3d5574dcfdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:19.304464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 559/1125] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:41:19.327006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb00c51-f7e1-46b4-9e79-2532f65b6bf3 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:19.408459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:19.428179 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb00c51-f7e1-46b4-9e79-2532f65b6bf3 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:19.461058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489e0ee-e04b-4cd7-8990-4690a23a38b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:19.461927 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489e0ee-e04b-4cd7-8990-4690a23a38b6 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:19.462211 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489e0ee-e04b-4cd7-8990-4690a23a38b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:19.462488 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489e0ee-e04b-4cd7-8990-4690a23a38b6 None admin] PATH_INFO: `/v3/roles/e6b3c27ed485430a88f59247935bfa08` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:19.463977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489e0ee-e04b-4cd7-8990-4690a23a38b6 None admin] RBAC: Authorizing `identity:get_role(role_id=e6b3c27ed485430a88f59247935bfa08)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:19.465287 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489e0ee-e04b-4cd7-8990-4690a23a38b6 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:19.466664 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 567/1126] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:41:19 2022] GET /identity/v3/roles/e6b3c27ed485430a88f59247935bfa08 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:19.472452 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a05d14-8e88-4e5c-a42f-3d5574dcfdb1 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:19.560412 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:19.567795 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a05d14-8e88-4e5c-a42f-3d5574dcfdb1 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:19.600806 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe931a7-a8c3-4630-94c2-909d4624e7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:19.601686 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe931a7-a8c3-4630-94c2-909d4624e7d4 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:19.601967 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe931a7-a8c3-4630-94c2-909d4624e7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:19.602240 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe931a7-a8c3-4630-94c2-909d4624e7d4 None admin] PATH_INFO: `/v3/users/c6eff51d9e0b48b284faac6112fe804d` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:19.603403 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe931a7-a8c3-4630-94c2-909d4624e7d4 None admin] RBAC: Authorizing `identity:get_user(user_id=c6eff51d9e0b48b284faac6112fe804d)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:19.604821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe931a7-a8c3-4630-94c2-909d4624e7d4 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:19.606429 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 560/1127] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:41:19 2022] GET /identity/v3/users/c6eff51d9e0b48b284faac6112fe804d => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:19.611994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489e0ee-e04b-4cd7-8990-4690a23a38b6 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:19.715089 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489e0ee-e04b-4cd7-8990-4690a23a38b6 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:19.748244 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53046eb-ee9c-4826-8508-9b544aba9fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:19.748931 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53046eb-ee9c-4826-8508-9b544aba9fbf None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:19.749213 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53046eb-ee9c-4826-8508-9b544aba9fbf None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:19.749513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53046eb-ee9c-4826-8508-9b544aba9fbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:19.767852 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:19.815759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53046eb-ee9c-4826-8508-9b544aba9fbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:19.817382 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53046eb-ee9c-4826-8508-9b544aba9fbf None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:19.910264 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 568/1128] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:41:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 13:41:19.916162 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe931a7-a8c3-4630-94c2-909d4624e7d4 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:20.012193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe931a7-a8c3-4630-94c2-909d4624e7d4 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:20.045061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449eb6e-a494-444e-aec0-39c51ad1bf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:20.045926 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449eb6e-a494-444e-aec0-39c51ad1bf84 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:20.046208 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449eb6e-a494-444e-aec0-39c51ad1bf84 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:20.046483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449eb6e-a494-444e-aec0-39c51ad1bf84 None admin] PATH_INFO: `/v3/projects/5f7ca70b221c408eaea2c1b5b904aaeb` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:20.048260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449eb6e-a494-444e-aec0-39c51ad1bf84 None admin] RBAC: Authorizing `identity:get_project(project_id=5f7ca70b221c408eaea2c1b5b904aaeb)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:20.049714 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449eb6e-a494-444e-aec0-39c51ad1bf84 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:20.051387 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 561/1129] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:41:19 2022] GET /identity/v3/projects/5f7ca70b221c408eaea2c1b5b904aaeb => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:20.057458 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53046eb-ee9c-4826-8508-9b544aba9fbf None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:20.103995 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:20.153639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53046eb-ee9c-4826-8508-9b544aba9fbf None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:20.186188 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112b08b-b47d-4de3-9422-d4a0deeeebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:20.186822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112b08b-b47d-4de3-9422-d4a0deeeebbc None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:20.187105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112b08b-b47d-4de3-9422-d4a0deeeebbc None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:20.187906 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112b08b-b47d-4de3-9422-d4a0deeeebbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:20.188724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112b08b-b47d-4de3-9422-d4a0deeeebbc None admin] RBAC: Adding query filter params (role.id=e6b3c27ed485430a88f59247935bfa08, scope.project.id=5f7ca70b221c408eaea2c1b5b904aaeb, user.id=c6eff51d9e0b48b284faac6112fe804d) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:20.189034 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112b08b-b47d-4de3-9422-d4a0deeeebbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:20.190462 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112b08b-b47d-4de3-9422-d4a0deeeebbc None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:20.196075 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 569/1130] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:41:20 2022] GET /identity/v3/role_assignments?user.id=c6eff51d9e0b48b284faac6112fe804d&scope.project.id=5f7ca70b221c408eaea2c1b5b904aaeb&role.id=e6b3c27ed485430a88f59247935bfa08 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:22.364529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835430f-4def-44d2-abcf-90d3a853c611 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:22.365082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835430f-4def-44d2-abcf-90d3a853c611 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:22.365082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835430f-4def-44d2-abcf-90d3a853c611 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:22.366465 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 562/1131] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:22.371612 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caefbc-4638-4f10-bd7a-f8e157fe9e4b None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:22.372037 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caefbc-4638-4f10-bd7a-f8e157fe9e4b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:22.372152 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caefbc-4638-4f10-bd7a-f8e157fe9e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:22.389468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-36caefbc-4638-4f10-bd7a-f8e157fe9e4b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:22.390684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-36caefbc-4638-4f10-bd7a-f8e157fe9e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:22.455302 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 570/1132] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:41:22.478535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835430f-4def-44d2-abcf-90d3a853c611 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:22.510802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:22.579941 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835430f-4def-44d2-abcf-90d3a853c611 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:22.613034 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609f3e3-d8ff-4ab0-8923-a716184e0dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:22.613836 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609f3e3-d8ff-4ab0-8923-a716184e0dd4 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:22.614120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609f3e3-d8ff-4ab0-8923-a716184e0dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:22.614395 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609f3e3-d8ff-4ab0-8923-a716184e0dd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:22.615601 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609f3e3-d8ff-4ab0-8923-a716184e0dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:22.616977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609f3e3-d8ff-4ab0-8923-a716184e0dd4 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:22.618578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 563/1133] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:41:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:22.624261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36caefbc-4638-4f10-bd7a-f8e157fe9e4b None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:22.666444 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:22.722531 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36caefbc-4638-4f10-bd7a-f8e157fe9e4b None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:22.755447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6461ef-a8f7-4675-9497-bf48beaa4a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:22.756099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6461ef-a8f7-4675-9497-bf48beaa4a12 None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:22.756384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6461ef-a8f7-4675-9497-bf48beaa4a12 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:22.756664 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6461ef-a8f7-4675-9497-bf48beaa4a12 None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:22.757664 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6461ef-a8f7-4675-9497-bf48beaa4a12 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:22.759072 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6461ef-a8f7-4675-9497-bf48beaa4a12 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:22.783614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 571/1134] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 13:41:22 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:41:24.978401 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c5964-7834-4a6e-b0c1-596e37a8dd6e None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:24.978921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c5964-7834-4a6e-b0c1-596e37a8dd6e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:24.978921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c5964-7834-4a6e-b0c1-596e37a8dd6e None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:24.980225 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 564/1135] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:24.985496 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97806735-42f4-4a42-9e19-dbbc35dc5044 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:24.985915 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97806735-42f4-4a42-9e19-dbbc35dc5044 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:24.986062 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97806735-42f4-4a42-9e19-dbbc35dc5044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:25.002862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-97806735-42f4-4a42-9e19-dbbc35dc5044 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:25.004053 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-97806735-42f4-4a42-9e19-dbbc35dc5044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:25.069112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 572/1136] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:41:25.093419 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c5964-7834-4a6e-b0c1-596e37a8dd6e None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:25.186074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:25.191051 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c5964-7834-4a6e-b0c1-596e37a8dd6e None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:25.222554 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87b17e-ebe9-431b-b1c5-7848ad1e08f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:25.223318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b17e-ebe9-431b-b1c5-7848ad1e08f9 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:25.223596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b17e-ebe9-431b-b1c5-7848ad1e08f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:25.223869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b17e-ebe9-431b-b1c5-7848ad1e08f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:25.225002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87b17e-ebe9-431b-b1c5-7848ad1e08f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:25.226450 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87b17e-ebe9-431b-b1c5-7848ad1e08f9 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:25.228014 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 565/1137] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:41:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:25.234251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97806735-42f4-4a42-9e19-dbbc35dc5044 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:25.258426 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:25.330112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97806735-42f4-4a42-9e19-dbbc35dc5044 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:25.362026 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdda03-bf62-4a9d-895d-28f37cd8aa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:25.362674 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdda03-bf62-4a9d-895d-28f37cd8aa39 None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:25.362952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdda03-bf62-4a9d-895d-28f37cd8aa39 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:25.363225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdda03-bf62-4a9d-895d-28f37cd8aa39 None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:25.363917 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdda03-bf62-4a9d-895d-28f37cd8aa39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:25.365354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdda03-bf62-4a9d-895d-28f37cd8aa39 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:25.385478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 573/1138] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 13:41:25 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:41:27.585037 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5edbfb-9600-4f56-b22c-2d9cb5cc2a95 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:27.585600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5edbfb-9600-4f56-b22c-2d9cb5cc2a95 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:27.585600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5edbfb-9600-4f56-b22c-2d9cb5cc2a95 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:27.586947 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 566/1139] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:27.592274 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52d864-b7fa-4f2d-98ab-b57ffbe9b754 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:27.592675 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52d864-b7fa-4f2d-98ab-b57ffbe9b754 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:27.592833 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52d864-b7fa-4f2d-98ab-b57ffbe9b754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:27.609649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-ab52d864-b7fa-4f2d-98ab-b57ffbe9b754 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:27.610836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ab52d864-b7fa-4f2d-98ab-b57ffbe9b754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:27.674327 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 574/1140] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:41:27.697878 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5edbfb-9600-4f56-b22c-2d9cb5cc2a95 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:27.801838 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5edbfb-9600-4f56-b22c-2d9cb5cc2a95 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:27.833540 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c47ef-0c63-4f48-aa9b-819386b3b57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:27.834312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c47ef-0c63-4f48-aa9b-819386b3b57f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:27.834592 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c47ef-0c63-4f48-aa9b-819386b3b57f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:27.834867 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c47ef-0c63-4f48-aa9b-819386b3b57f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:27.845143 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c47ef-0c63-4f48-aa9b-819386b3b57f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:41:27.852733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-507c47ef-0c63-4f48-aa9b-819386b3b57f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:41:27.852733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:27.852733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:27.852733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:27.852733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:27.852733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:27.852733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:27.852733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:27.852733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:27.852733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:27.852733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:27.852733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:27.852733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:41:27.852733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:41:27.852733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:41:27.852733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:41:27.853884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:41:27.853884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:41:27.853884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:41:27.853884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:41:27.853884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:27.853884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:27.853884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:27.853884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:27.853884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:27.853884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:27.853884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:27.853884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:41:27.853884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:27.853884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:27.853884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:27.853884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:27.854959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:27.854959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:27.854959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:27.854959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:27.854959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:41:27.854959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:41:27.854959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:41:27.854959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:41:27.854959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:41:27.854959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:41:27.854959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:41:27.854959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:41:27.854959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 567/1141] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:41:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:41:27.860441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52d864-b7fa-4f2d-98ab-b57ffbe9b754 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:27.871620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:27.955888 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52d864-b7fa-4f2d-98ab-b57ffbe9b754 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:27.988632 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec01d4-7c82-455a-af6b-e844035cadc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:27.989311 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec01d4-7c82-455a-af6b-e844035cadc2 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:27.989591 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec01d4-7c82-455a-af6b-e844035cadc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:27.989865 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec01d4-7c82-455a-af6b-e844035cadc2 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:27.990596 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec01d4-7c82-455a-af6b-e844035cadc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:27.990901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec01d4-7c82-455a-af6b-e844035cadc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:27.992233 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec01d4-7c82-455a-af6b-e844035cadc2 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:27.999956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 575/1142] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:41:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:28.005697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c47ef-0c63-4f48-aa9b-819386b3b57f None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:28.034382 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:28.103504 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c47ef-0c63-4f48-aa9b-819386b3b57f None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:28.135237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dadb9-81d0-4306-b1ac-268e26a2f441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:28.136081 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dadb9-81d0-4306-b1ac-268e26a2f441 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:28.136355 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dadb9-81d0-4306-b1ac-268e26a2f441 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:28.136625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dadb9-81d0-4306-b1ac-268e26a2f441 None admin] PATH_INFO: `/v3/users/c890f63d3e2347d0a4493793e9bed9a1` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:28.149698 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204dadb9-81d0-4306-b1ac-268e26a2f441 None admin] RBAC: Authorizing `identity:get_user(user_id=c890f63d3e2347d0a4493793e9bed9a1)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:28.151119 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204dadb9-81d0-4306-b1ac-268e26a2f441 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:28.152694 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 568/1143] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:41:28 2022] GET /identity/v3/users/c890f63d3e2347d0a4493793e9bed9a1 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:28.158871 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec01d4-7c82-455a-af6b-e844035cadc2 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:28.225140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:28.253819 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec01d4-7c82-455a-af6b-e844035cadc2 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:28.286251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ae4cd-ad49-42ba-88b6-1c84e6aee26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:28.286875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ae4cd-ad49-42ba-88b6-1c84e6aee26b None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:28.287154 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ae4cd-ad49-42ba-88b6-1c84e6aee26b None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:28.287427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ae4cd-ad49-42ba-88b6-1c84e6aee26b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:28.351327 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ae4cd-ad49-42ba-88b6-1c84e6aee26b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:28.352761 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ae4cd-ad49-42ba-88b6-1c84e6aee26b None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:28.424645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:28.456557 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 576/1144] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:41:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 13:41:28.462490 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dadb9-81d0-4306-b1ac-268e26a2f441 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:28.546731 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:28.562916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dadb9-81d0-4306-b1ac-268e26a2f441 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:28.596492 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3de809-4da5-43cc-94a9-44aceed5e345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:28.597377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3de809-4da5-43cc-94a9-44aceed5e345 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:28.597659 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3de809-4da5-43cc-94a9-44aceed5e345 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:28.597935 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3de809-4da5-43cc-94a9-44aceed5e345 None admin] PATH_INFO: `/v3/projects/a7be0c7691ec4950a73fc4da25749687` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:28.599128 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3de809-4da5-43cc-94a9-44aceed5e345 None admin] RBAC: Authorizing `identity:get_project(project_id=a7be0c7691ec4950a73fc4da25749687)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:28.600556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3de809-4da5-43cc-94a9-44aceed5e345 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:28.602288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 569/1145] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:41:28 2022] GET /identity/v3/projects/a7be0c7691ec4950a73fc4da25749687 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:41:28.608519 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ae4cd-ad49-42ba-88b6-1c84e6aee26b None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:28.703860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ae4cd-ad49-42ba-88b6-1c84e6aee26b None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:28.736010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3772fd7-b6e6-4faf-baa9-60cf82383c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:28.736651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3772fd7-b6e6-4faf-baa9-60cf82383c8f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:28.736929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3772fd7-b6e6-4faf-baa9-60cf82383c8f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:28.737201 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3772fd7-b6e6-4faf-baa9-60cf82383c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:28.738040 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3772fd7-b6e6-4faf-baa9-60cf82383c8f None admin] RBAC: Adding query filter params (role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.project.id=a7be0c7691ec4950a73fc4da25749687, user.id=c890f63d3e2347d0a4493793e9bed9a1) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:28.738346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3772fd7-b6e6-4faf-baa9-60cf82383c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:28.739739 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3772fd7-b6e6-4faf-baa9-60cf82383c8f None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:28.745021 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 577/1146] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:41:28 2022] GET /identity/v3/role_assignments?user.id=c890f63d3e2347d0a4493793e9bed9a1&scope.project.id=a7be0c7691ec4950a73fc4da25749687&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:30.917663 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a4c55-073d-48f1-bc10-c4e30c3bc6f2 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:30.918186 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a4c55-073d-48f1-bc10-c4e30c3bc6f2 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:30.918186 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a4c55-073d-48f1-bc10-c4e30c3bc6f2 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:30.919552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 570/1147] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:30.925661 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ba436-64d4-4947-a8cf-b8f8cbaf3fa0 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:30.926063 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ba436-64d4-4947-a8cf-b8f8cbaf3fa0 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:30.926217 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ba436-64d4-4947-a8cf-b8f8cbaf3fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:30.942590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-010ba436-64d4-4947-a8cf-b8f8cbaf3fa0 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:30.943730 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-010ba436-64d4-4947-a8cf-b8f8cbaf3fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:30.971512 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:31.008266 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 578/1148] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:41:31.031065 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a4c55-073d-48f1-bc10-c4e30c3bc6f2 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:31.128149 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a4c55-073d-48f1-bc10-c4e30c3bc6f2 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:31.161474 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6070e5f-a1f5-4fc0-af72-c919648567b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:31.162239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6070e5f-a1f5-4fc0-af72-c919648567b3 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:31.162521 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6070e5f-a1f5-4fc0-af72-c919648567b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:31.162793 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6070e5f-a1f5-4fc0-af72-c919648567b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:31.172494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6070e5f-a1f5-4fc0-af72-c919648567b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:41:31.180020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-f6070e5f-a1f5-4fc0-af72-c919648567b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:41:31.180020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:31.180020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:31.180020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:31.180020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:31.180020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:31.180020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:31.180020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:31.180020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:31.180020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:31.180020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:31.180020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:31.180020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:41:31.180020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:41:31.180020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:41:31.180020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:41:31.181107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:41:31.181107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:41:31.181107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:41:31.181107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:41:31.181107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:31.181107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:31.181107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:31.181107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:31.181107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:31.181107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:31.181107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:31.181107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:41:31.181107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:31.181107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:31.181107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:31.181107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:31.182181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:31.182181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:31.182181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:31.182181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:31.182181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:41:31.182181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:41:31.182181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:41:31.182181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:41:31.182181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:41:31.182181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:41:31.182181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:41:31.182181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:41:31.182181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 571/1149] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:41:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:41:31.187070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ba436-64d4-4947-a8cf-b8f8cbaf3fa0 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:31.281866 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ba436-64d4-4947-a8cf-b8f8cbaf3fa0 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:31.313437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e4600-226b-4572-a6e3-575fd82f98d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:31.314086 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e4600-226b-4572-a6e3-575fd82f98d9 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:31.314368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e4600-226b-4572-a6e3-575fd82f98d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:31.314645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e4600-226b-4572-a6e3-575fd82f98d9 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:31.315381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e4600-226b-4572-a6e3-575fd82f98d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:31.315686 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e4600-226b-4572-a6e3-575fd82f98d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:31.317030 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e4600-226b-4572-a6e3-575fd82f98d9 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:31.324691 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 579/1150] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:41:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:31.330898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6070e5f-a1f5-4fc0-af72-c919648567b3 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:31.347110 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:31.428138 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6070e5f-a1f5-4fc0-af72-c919648567b3 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:31.460954 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0710ec-4fc0-49e6-b579-f5ea97502cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:31.461834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0710ec-4fc0-49e6-b579-f5ea97502cd1 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:31.462115 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0710ec-4fc0-49e6-b579-f5ea97502cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:31.462387 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0710ec-4fc0-49e6-b579-f5ea97502cd1 None admin] PATH_INFO: `/v3/users/c890f63d3e2347d0a4493793e9bed9a1` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:31.463534 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0710ec-4fc0-49e6-b579-f5ea97502cd1 None admin] RBAC: Authorizing `identity:get_user(user_id=c890f63d3e2347d0a4493793e9bed9a1)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:31.464950 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0710ec-4fc0-49e6-b579-f5ea97502cd1 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:31.466564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 572/1151] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:41:31 2022] GET /identity/v3/users/c890f63d3e2347d0a4493793e9bed9a1 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:31.472293 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e4600-226b-4572-a6e3-575fd82f98d9 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:31.499897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:31.568751 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e4600-226b-4572-a6e3-575fd82f98d9 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:31.600474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36df6a7-a7ee-494e-85ab-4cc5932f491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:31.601343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36df6a7-a7ee-494e-85ab-4cc5932f491f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:31.601627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36df6a7-a7ee-494e-85ab-4cc5932f491f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:31.601904 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36df6a7-a7ee-494e-85ab-4cc5932f491f None admin] PATH_INFO: `/v3/projects/a7be0c7691ec4950a73fc4da25749687` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:31.603055 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36df6a7-a7ee-494e-85ab-4cc5932f491f None admin] RBAC: Authorizing `identity:get_project(project_id=a7be0c7691ec4950a73fc4da25749687)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:31.604459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36df6a7-a7ee-494e-85ab-4cc5932f491f None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:31.606157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 580/1152] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:41:31 2022] GET /identity/v3/projects/a7be0c7691ec4950a73fc4da25749687 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:31.611955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0710ec-4fc0-49e6-b579-f5ea97502cd1 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:31.690457 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:31.708701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0710ec-4fc0-49e6-b579-f5ea97502cd1 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:31.740043 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fd2bc-f73b-428a-a777-c8e009cfc84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:31.740924 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fd2bc-f73b-428a-a777-c8e009cfc84f None admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:31.741202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fd2bc-f73b-428a-a777-c8e009cfc84f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:31.741502 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fd2bc-f73b-428a-a777-c8e009cfc84f None admin] PATH_INFO: `/v3/projects/a7be0c7691ec4950a73fc4da25749687/users/c890f63d3e2347d0a4493793e9bed9a1/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:31.743402 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fd2bc-f73b-428a-a777-c8e009cfc84f None admin] RBAC: Authorizing `identity:create_grant(project_id=a7be0c7691ec4950a73fc4da25749687, user_id=c890f63d3e2347d0a4493793e9bed9a1, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:31.744816 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fd2bc-f73b-428a-a777-c8e009cfc84f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:31.758496 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 573/1153] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:41:31 2022] PUT /identity/v3/projects/a7be0c7691ec4950a73fc4da25749687/users/c890f63d3e2347d0a4493793e9bed9a1/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:41:33.940463 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c679d-fda6-4cba-b4b7-de77bdbfa662 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:33.940961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c679d-fda6-4cba-b4b7-de77bdbfa662 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:33.940961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c679d-fda6-4cba-b4b7-de77bdbfa662 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:33.942349 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 581/1154] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:33.947673 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c69d6-e715-49e0-92bf-2eedeae505f0 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:33.948097 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c69d6-e715-49e0-92bf-2eedeae505f0 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:33.948224 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c69d6-e715-49e0-92bf-2eedeae505f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:33.964662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-bf0c69d6-e715-49e0-92bf-2eedeae505f0 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:33.965869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-bf0c69d6-e715-49e0-92bf-2eedeae505f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:34.034208 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 574/1155] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:41:34.057705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c679d-fda6-4cba-b4b7-de77bdbfa662 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:34.147825 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:34.155632 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c679d-fda6-4cba-b4b7-de77bdbfa662 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:34.187450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e204c-68e3-48d3-86ab-e161e892072e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:34.188223 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e204c-68e3-48d3-86ab-e161e892072e None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:34.188507 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e204c-68e3-48d3-86ab-e161e892072e None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:34.188786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e204c-68e3-48d3-86ab-e161e892072e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:34.199148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e204c-68e3-48d3-86ab-e161e892072e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:41:34.207136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-366e204c-68e3-48d3-86ab-e161e892072e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:41:34.207136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:34.207136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:34.207136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:34.207136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:34.207136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:34.207136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:34.207136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:34.207136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:34.207136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:34.207136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:34.207136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:34.207136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:41:34.207136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:41:34.207136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:41:34.207136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:41:34.208251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:41:34.208251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:41:34.208251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:41:34.208251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:41:34.208251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:34.208251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:34.208251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:34.208251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:34.208251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:34.208251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:34.208251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:34.208251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:41:34.208251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:34.208251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:34.208251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:34.208251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:34.209219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:34.209219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:34.209219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:34.209219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:34.209219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:41:34.209219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:41:34.209219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:41:34.209219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:41:34.209219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:41:34.209219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:41:34.209219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:41:34.209219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:41:34.209219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 582/1156] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:41:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:41:34.214217 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c69d6-e715-49e0-92bf-2eedeae505f0 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:34.282489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:34.310647 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c69d6-e715-49e0-92bf-2eedeae505f0 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:34.344934 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838773fc-9510-4db0-a259-bbed581314f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:34.345604 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838773fc-9510-4db0-a259-bbed581314f0 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:34.345880 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838773fc-9510-4db0-a259-bbed581314f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:34.346148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838773fc-9510-4db0-a259-bbed581314f0 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:34.346873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838773fc-9510-4db0-a259-bbed581314f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:34.347173 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838773fc-9510-4db0-a259-bbed581314f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:34.348525 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838773fc-9510-4db0-a259-bbed581314f0 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:34.356192 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 575/1157] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:41:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:34.361973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e204c-68e3-48d3-86ab-e161e892072e None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:34.459325 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e204c-68e3-48d3-86ab-e161e892072e None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:34.491221 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3e1a4-dc1f-4d06-8c89-83f6ef54426c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:34.492124 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3e1a4-dc1f-4d06-8c89-83f6ef54426c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:34.492446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3e1a4-dc1f-4d06-8c89-83f6ef54426c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:34.492721 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3e1a4-dc1f-4d06-8c89-83f6ef54426c None admin] PATH_INFO: `/v3/users/c890f63d3e2347d0a4493793e9bed9a1` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:34.493936 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3e1a4-dc1f-4d06-8c89-83f6ef54426c None admin] RBAC: Authorizing `identity:get_user(user_id=c890f63d3e2347d0a4493793e9bed9a1)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:34.495399 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3e1a4-dc1f-4d06-8c89-83f6ef54426c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:34.496979 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 583/1158] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:41:34 2022] GET /identity/v3/users/c890f63d3e2347d0a4493793e9bed9a1 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:34.503180 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838773fc-9510-4db0-a259-bbed581314f0 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:34.599519 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838773fc-9510-4db0-a259-bbed581314f0 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:34.630385 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca72c8-c45c-4077-981d-0383d0959c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:34.631010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca72c8-c45c-4077-981d-0383d0959c94 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:34.631287 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca72c8-c45c-4077-981d-0383d0959c94 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:34.631810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca72c8-c45c-4077-981d-0383d0959c94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:34.634346 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:34.696975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca72c8-c45c-4077-981d-0383d0959c94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:34.698449 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca72c8-c45c-4077-981d-0383d0959c94 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:34.791250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 576/1159] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:41:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 13:41:34.797623 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3e1a4-dc1f-4d06-8c89-83f6ef54426c None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:34.822274 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:34.893810 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3e1a4-dc1f-4d06-8c89-83f6ef54426c None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:34.926157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920eaacc-dae9-42e5-8ae6-c10db31e5a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:34.926999 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920eaacc-dae9-42e5-8ae6-c10db31e5a62 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:34.927278 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920eaacc-dae9-42e5-8ae6-c10db31e5a62 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:34.927548 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920eaacc-dae9-42e5-8ae6-c10db31e5a62 None admin] PATH_INFO: `/v3/projects/a7be0c7691ec4950a73fc4da25749687` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:34.928677 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920eaacc-dae9-42e5-8ae6-c10db31e5a62 None admin] RBAC: Authorizing `identity:get_project(project_id=a7be0c7691ec4950a73fc4da25749687)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:34.930110 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920eaacc-dae9-42e5-8ae6-c10db31e5a62 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:34.931774 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 584/1160] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:41:34 2022] GET /identity/v3/projects/a7be0c7691ec4950a73fc4da25749687 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:34.938447 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca72c8-c45c-4077-981d-0383d0959c94 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:34.969932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:35.033091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca72c8-c45c-4077-981d-0383d0959c94 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:35.066018 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aee48-91c1-4f55-8464-3a0f239f1b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:35.066597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aee48-91c1-4f55-8464-3a0f239f1b16 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:35.066875 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aee48-91c1-4f55-8464-3a0f239f1b16 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:35.067148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aee48-91c1-4f55-8464-3a0f239f1b16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:35.067949 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076aee48-91c1-4f55-8464-3a0f239f1b16 None admin] RBAC: Adding query filter params (role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.project.id=a7be0c7691ec4950a73fc4da25749687, user.id=c890f63d3e2347d0a4493793e9bed9a1) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:35.068254 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076aee48-91c1-4f55-8464-3a0f239f1b16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:35.069688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076aee48-91c1-4f55-8464-3a0f239f1b16 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:35.075845 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 577/1161] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:41:34 2022] GET /identity/v3/role_assignments?user.id=c890f63d3e2347d0a4493793e9bed9a1&scope.project.id=a7be0c7691ec4950a73fc4da25749687&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:41:37.268388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb1657-95ef-40d9-af2b-49331f25f796 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:37.268940 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb1657-95ef-40d9-af2b-49331f25f796 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:37.268940 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb1657-95ef-40d9-af2b-49331f25f796 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:37.270347 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 585/1162] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:37.275435 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707e25f-743b-446a-ab20-872ed8700e5d None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:37.275854 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707e25f-743b-446a-ab20-872ed8700e5d None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:37.275985 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707e25f-743b-446a-ab20-872ed8700e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:37.292740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-9707e25f-743b-446a-ab20-872ed8700e5d None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:37.293932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9707e25f-743b-446a-ab20-872ed8700e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:37.356520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 578/1163] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 13:41:37.378359 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb1657-95ef-40d9-af2b-49331f25f796 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:37.467017 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:37.476478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb1657-95ef-40d9-af2b-49331f25f796 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:37.509028 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f605d-3e28-40a0-bd27-f920622c91d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:37.509682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f605d-3e28-40a0-bd27-f920622c91d9 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:37.509969 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f605d-3e28-40a0-bd27-f920622c91d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:37.510246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f605d-3e28-40a0-bd27-f920622c91d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:37.573927 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f605d-3e28-40a0-bd27-f920622c91d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:37.575349 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f605d-3e28-40a0-bd27-f920622c91d9 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:37.660382 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:37.670064 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 586/1164] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:41:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 13:41:37.675789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707e25f-743b-446a-ab20-872ed8700e5d None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:37.703396 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:37.773111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707e25f-743b-446a-ab20-872ed8700e5d None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:37.806094 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b45069-99df-489f-a9fc-e7f62d2761d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:37.806881 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b45069-99df-489f-a9fc-e7f62d2761d8 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:37.807161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b45069-99df-489f-a9fc-e7f62d2761d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:37.807435 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b45069-99df-489f-a9fc-e7f62d2761d8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:37.814514 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b45069-99df-489f-a9fc-e7f62d2761d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:37.815950 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b45069-99df-489f-a9fc-e7f62d2761d8 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:37.829911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-98b45069-99df-489f-a9fc-e7f62d2761d8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 13:41:37.829911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:37.829911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 13:41:37.829911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 13:41:37.829911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:41:37.829911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:41:37.829911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:41:37.829911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:41:37.829911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 13:41:37.829911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:41:37.829911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:41:37.829911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:41:37.829911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:37.829911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:37.829911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:37.829911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:37.829911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:37.831243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:37.831243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:37.831243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:37.831243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:37.831243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:37.831243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:37.831243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:41:37.831243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:41:37.831243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:41:37.831243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:41:37.831243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:37.831243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:37.831243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:37.831243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:37.831243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:37.831243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:37.832161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:37.832161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:41:37.832161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:37.832161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:37.832161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:37.832161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:37.832161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:37.832161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:37.832161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:37.832161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:37.832161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 13:41:37.832161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:41:37.832161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 13:41:37.832161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:41:37.832161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 579/1165] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 13:41:37 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:41:37.838300 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f605d-3e28-40a0-bd27-f920622c91d9 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:37.937038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f605d-3e28-40a0-bd27-f920622c91d9 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:37.968539 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1939c-ddc8-4ce0-9b79-ad8709a06c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:37.969181 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1939c-ddc8-4ce0-9b79-ad8709a06c47 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:37.969484 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1939c-ddc8-4ce0-9b79-ad8709a06c47 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:37.969754 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1939c-ddc8-4ce0-9b79-ad8709a06c47 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:37.970452 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1939c-ddc8-4ce0-9b79-ad8709a06c47 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:37.970753 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1939c-ddc8-4ce0-9b79-ad8709a06c47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:37.972081 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1939c-ddc8-4ce0-9b79-ad8709a06c47 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:37.978906 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 587/1166] 10.222.0.45 () {56 vars in 1115 bytes} [Thu May 26 13:41:37 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:40.125466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8d4ff-d117-4e30-82d8-706bee2af988 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:40.126017 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8d4ff-d117-4e30-82d8-706bee2af988 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:40.126017 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8d4ff-d117-4e30-82d8-706bee2af988 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:40.127355 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 580/1167] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:40.132982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c93f70-9d3b-43b2-9229-feaeb19888fd None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:40.133421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c93f70-9d3b-43b2-9229-feaeb19888fd None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:40.133567 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c93f70-9d3b-43b2-9229-feaeb19888fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:40.150214 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-00c93f70-9d3b-43b2-9229-feaeb19888fd None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:40.151373 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-00c93f70-9d3b-43b2-9229-feaeb19888fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:40.198644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:40.215338 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 588/1168] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:41:40.237987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8d4ff-d117-4e30-82d8-706bee2af988 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:40.322696 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:40.336121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8d4ff-d117-4e30-82d8-706bee2af988 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:40.368179 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e3893-88d1-434e-b9ea-b470be8fce6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:40.368811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e3893-88d1-434e-b9ea-b470be8fce6f None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:40.369088 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e3893-88d1-434e-b9ea-b470be8fce6f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:40.369395 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e3893-88d1-434e-b9ea-b470be8fce6f None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:40.370122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e3893-88d1-434e-b9ea-b470be8fce6f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:40.371465 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e3893-88d1-434e-b9ea-b470be8fce6f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:40.385120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 581/1169] 10.222.0.45 () {60 vars in 1138 bytes} [Thu May 26 13:41:40 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:41:42.592517 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eada91-fb5b-4a2f-b857-4083ad246c4c None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:42.593071 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eada91-fb5b-4a2f-b857-4083ad246c4c None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:42.593071 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eada91-fb5b-4a2f-b857-4083ad246c4c None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:42.594464 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 589/1170] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:42.599833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9838f-bd78-4bfc-a341-aaf79478b98a None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:42.600277 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9838f-bd78-4bfc-a341-aaf79478b98a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:42.600375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9838f-bd78-4bfc-a341-aaf79478b98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:42.616692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-7ec9838f-bd78-4bfc-a341-aaf79478b98a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:42.617904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-7ec9838f-bd78-4bfc-a341-aaf79478b98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:42.682227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 582/1171] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:41:42.706209 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eada91-fb5b-4a2f-b857-4083ad246c4c None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:42.802253 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eada91-fb5b-4a2f-b857-4083ad246c4c None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:42.836778 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3392cf-45e8-4c89-b15f-c7a04005cbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:42.837716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3392cf-45e8-4c89-b15f-c7a04005cbdb None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:42.837993 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3392cf-45e8-4c89-b15f-c7a04005cbdb None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:42.838267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3392cf-45e8-4c89-b15f-c7a04005cbdb None admin] PATH_INFO: `/v3/domains/92ab7f410e3540efb3138d0f366d9c26` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:42.848246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3392cf-45e8-4c89-b15f-c7a04005cbdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=92ab7f410e3540efb3138d0f366d9c26)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:42.849647 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3392cf-45e8-4c89-b15f-c7a04005cbdb None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:42.851252 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 590/1172] 10.222.0.45 () {56 vars in 1183 bytes} [Thu May 26 13:41:42 2022] GET /identity/v3/domains/92ab7f410e3540efb3138d0f366d9c26 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:42.856906 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9838f-bd78-4bfc-a341-aaf79478b98a None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:42.930735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:42.952843 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9838f-bd78-4bfc-a341-aaf79478b98a None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:42.984697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e21f22-cb3f-4162-a443-b5d26973a4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:42.985361 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e21f22-cb3f-4162-a443-b5d26973a4b1 None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:42.985647 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e21f22-cb3f-4162-a443-b5d26973a4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:42.985921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e21f22-cb3f-4162-a443-b5d26973a4b1 None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:42.986608 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e21f22-cb3f-4162-a443-b5d26973a4b1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:42.988029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e21f22-cb3f-4162-a443-b5d26973a4b1 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:43.012004 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 583/1173] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 13:41:42 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:41:45.196398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794ce85-c9ff-4362-a94b-527116fba436 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:45.196930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794ce85-c9ff-4362-a94b-527116fba436 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:45.196930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794ce85-c9ff-4362-a94b-527116fba436 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:45.198353 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 591/1174] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:45.203576 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c849c-461f-44d2-838f-b9b58c811c19 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:45.204016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c849c-461f-44d2-838f-b9b58c811c19 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:45.204124 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c849c-461f-44d2-838f-b9b58c811c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:45.220935 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-234c849c-461f-44d2-838f-b9b58c811c19 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:45.222210 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-234c849c-461f-44d2-838f-b9b58c811c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:45.286193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 584/1175] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:41:45.310504 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794ce85-c9ff-4362-a94b-527116fba436 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:45.356396 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:45.408954 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794ce85-c9ff-4362-a94b-527116fba436 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:45.441258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9659b-aeb2-4aae-bf75-965be64323d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:45.442124 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9659b-aeb2-4aae-bf75-965be64323d2 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:45.442402 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9659b-aeb2-4aae-bf75-965be64323d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:45.442674 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9659b-aeb2-4aae-bf75-965be64323d2 None admin] PATH_INFO: `/v3/domains/92ab7f410e3540efb3138d0f366d9c26` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:45.443814 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9659b-aeb2-4aae-bf75-965be64323d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=92ab7f410e3540efb3138d0f366d9c26)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:45.445212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9659b-aeb2-4aae-bf75-965be64323d2 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:45.446866 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 592/1176] 10.222.0.45 () {56 vars in 1183 bytes} [Thu May 26 13:41:45 2022] GET /identity/v3/domains/92ab7f410e3540efb3138d0f366d9c26 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:45.452442 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c849c-461f-44d2-838f-b9b58c811c19 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:45.511663 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:45.552646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c849c-461f-44d2-838f-b9b58c811c19 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:45.585931 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4334b-0206-45fd-b668-18059b0b63f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:45.586580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4334b-0206-45fd-b668-18059b0b63f9 None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:45.586857 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4334b-0206-45fd-b668-18059b0b63f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:45.587128 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4334b-0206-45fd-b668-18059b0b63f9 None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:45.587814 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4334b-0206-45fd-b668-18059b0b63f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:45.589227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4334b-0206-45fd-b668-18059b0b63f9 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:45.608691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 585/1177] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 13:41:45 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:41:47.801813 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8d548-debc-4f03-ac06-34e7dc543427 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:47.802359 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8d548-debc-4f03-ac06-34e7dc543427 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:47.802359 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8d548-debc-4f03-ac06-34e7dc543427 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:47.803717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 593/1178] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:47.808964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a058c-6c31-48c1-9e72-833a4bedda8c None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:47.809408 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a058c-6c31-48c1-9e72-833a4bedda8c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:47.809541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a058c-6c31-48c1-9e72-833a4bedda8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:47.830869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-fa1a058c-6c31-48c1-9e72-833a4bedda8c None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:47.832302 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-fa1a058c-6c31-48c1-9e72-833a4bedda8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:47.896485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 586/1179] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:41:47.920370 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8d548-debc-4f03-ac06-34e7dc543427 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:48.017221 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8d548-debc-4f03-ac06-34e7dc543427 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:48.030352 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:48.050372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3996af-3008-470d-86f3-4bbcc929e547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:48.051141 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3996af-3008-470d-86f3-4bbcc929e547 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:48.051425 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3996af-3008-470d-86f3-4bbcc929e547 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:48.051703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3996af-3008-470d-86f3-4bbcc929e547 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:48.061808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3996af-3008-470d-86f3-4bbcc929e547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:41:48.069172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-9a3996af-3008-470d-86f3-4bbcc929e547 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:41:48.069172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:48.069172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:48.069172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:48.069172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:48.069172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:48.069172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:48.069172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:48.069172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:48.069172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:48.069172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:48.069172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:48.069172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:41:48.069172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:41:48.069172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:41:48.069172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:41:48.070126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:41:48.070126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:41:48.070126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:41:48.070126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:41:48.070126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:48.070126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:48.070126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:48.070126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:48.070126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:48.070126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:48.070126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:48.070126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:41:48.070126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:48.070126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:48.070126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:48.070126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:48.070987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:48.070987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:48.070987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:48.070987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:48.070987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:41:48.070987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:41:48.070987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:41:48.070987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:41:48.070987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:41:48.070987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:41:48.070987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:41:48.070987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:41:48.070987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 594/1180] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:41:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:41:48.076438 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a058c-6c31-48c1-9e72-833a4bedda8c None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:48.120839 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:48.174248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a058c-6c31-48c1-9e72-833a4bedda8c None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:48.207371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02177b14-2e6e-4738-8d9c-793f51cf9664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:48.208029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02177b14-2e6e-4738-8d9c-793f51cf9664 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:48.208313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02177b14-2e6e-4738-8d9c-793f51cf9664 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:48.208592 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02177b14-2e6e-4738-8d9c-793f51cf9664 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:48.209356 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02177b14-2e6e-4738-8d9c-793f51cf9664 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:48.209667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02177b14-2e6e-4738-8d9c-793f51cf9664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:48.211029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02177b14-2e6e-4738-8d9c-793f51cf9664 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:48.219651 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 587/1181] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:41:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:41:48.225431 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3996af-3008-470d-86f3-4bbcc929e547 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:48.321745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3996af-3008-470d-86f3-4bbcc929e547 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:48.354820 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ede48-d588-4981-8394-815395bf1f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:48.355675 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ede48-d588-4981-8394-815395bf1f5f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:48.355959 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ede48-d588-4981-8394-815395bf1f5f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:48.356245 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ede48-d588-4981-8394-815395bf1f5f None admin] PATH_INFO: `/v3/users/5b9802dc469b47cb915685dc365218a5` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:48.368799 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ede48-d588-4981-8394-815395bf1f5f None admin] RBAC: Authorizing `identity:get_user(user_id=5b9802dc469b47cb915685dc365218a5)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:48.370274 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ede48-d588-4981-8394-815395bf1f5f None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:48.371888 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 595/1182] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:41:48 2022] GET /identity/v3/users/5b9802dc469b47cb915685dc365218a5 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:48.377379 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02177b14-2e6e-4738-8d9c-793f51cf9664 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:48.475579 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02177b14-2e6e-4738-8d9c-793f51cf9664 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:48.483960 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:48.507821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73d0a3-48cd-491b-85e1-86a1dd2d1cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:48.508452 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73d0a3-48cd-491b-85e1-86a1dd2d1cf9 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:48.508732 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73d0a3-48cd-491b-85e1-86a1dd2d1cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:48.509005 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73d0a3-48cd-491b-85e1-86a1dd2d1cf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:48.572332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73d0a3-48cd-491b-85e1-86a1dd2d1cf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:48.573730 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73d0a3-48cd-491b-85e1-86a1dd2d1cf9 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:48.667476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 588/1183] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:41:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 13:41:48.673878 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ede48-d588-4981-8394-815395bf1f5f None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:48.703978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:48.770030 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ede48-d588-4981-8394-815395bf1f5f None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:48.802775 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43806f-9b84-4ef4-9095-5f43def67d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:48.803621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43806f-9b84-4ef4-9095-5f43def67d46 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:48.803894 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43806f-9b84-4ef4-9095-5f43def67d46 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:48.804162 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43806f-9b84-4ef4-9095-5f43def67d46 None admin] PATH_INFO: `/v3/projects/3f1ff61674b94f3c80ca9002bb03bf79` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:48.805331 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43806f-9b84-4ef4-9095-5f43def67d46 None admin] RBAC: Authorizing `identity:get_project(project_id=3f1ff61674b94f3c80ca9002bb03bf79)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:48.806733 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43806f-9b84-4ef4-9095-5f43def67d46 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:48.808408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 596/1184] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:41:48 2022] GET /identity/v3/projects/3f1ff61674b94f3c80ca9002bb03bf79 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:48.814439 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73d0a3-48cd-491b-85e1-86a1dd2d1cf9 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:48.824330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:48.910117 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73d0a3-48cd-491b-85e1-86a1dd2d1cf9 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:48.942125 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ddd31-76c3-4ad2-b8ed-82b271d626a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:48.942756 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ddd31-76c3-4ad2-b8ed-82b271d626a6 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:48.943037 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ddd31-76c3-4ad2-b8ed-82b271d626a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:48.943306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ddd31-76c3-4ad2-b8ed-82b271d626a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:48.944261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ddd31-76c3-4ad2-b8ed-82b271d626a6 None admin] RBAC: Adding query filter params (role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.project.id=3f1ff61674b94f3c80ca9002bb03bf79, user.id=5b9802dc469b47cb915685dc365218a5) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:48.944607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ddd31-76c3-4ad2-b8ed-82b271d626a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:48.946044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ddd31-76c3-4ad2-b8ed-82b271d626a6 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:48.951270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 589/1185] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:41:48 2022] GET /identity/v3/role_assignments?user.id=5b9802dc469b47cb915685dc365218a5&scope.project.id=3f1ff61674b94f3c80ca9002bb03bf79&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:51.084159 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac3c0b-d300-4333-800b-1539e633774b None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:51.084700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac3c0b-d300-4333-800b-1539e633774b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:51.084700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac3c0b-d300-4333-800b-1539e633774b None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:51.086122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 597/1186] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:51.091748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ccb89-7c1b-4389-8498-89f1f06cf18b None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:51.092168 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ccb89-7c1b-4389-8498-89f1f06cf18b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:51.092290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ccb89-7c1b-4389-8498-89f1f06cf18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:51.109744 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-211ccb89-7c1b-4389-8498-89f1f06cf18b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:51.110899 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-211ccb89-7c1b-4389-8498-89f1f06cf18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:51.174323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 590/1187] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:41:51.196662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac3c0b-d300-4333-800b-1539e633774b None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:51.290180 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:51.294200 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac3c0b-d300-4333-800b-1539e633774b None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:51.328164 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96887b14-86a2-4e77-adc9-e7c5696d84da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:51.328928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96887b14-86a2-4e77-adc9-e7c5696d84da None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:51.329212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96887b14-86a2-4e77-adc9-e7c5696d84da None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:51.329517 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96887b14-86a2-4e77-adc9-e7c5696d84da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:51.339208 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96887b14-86a2-4e77-adc9-e7c5696d84da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:41:51.347272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-96887b14-86a2-4e77-adc9-e7c5696d84da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:41:51.347272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:51.347272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:51.347272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:51.347272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:51.347272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:51.347272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:51.347272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:51.347272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:51.347272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:51.347272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:51.347272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:51.347272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:41:51.347272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:41:51.347272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:41:51.347272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:41:51.348397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:41:51.348397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:41:51.348397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:41:51.348397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:41:51.348397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:51.348397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:51.348397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:51.348397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:51.348397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:51.348397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:51.348397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:51.348397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:41:51.348397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:51.348397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:51.348397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:51.348397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:51.349578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:51.349578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:51.349578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:51.349578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:51.349578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:41:51.349578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:41:51.349578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:41:51.349578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:41:51.349578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:41:51.349578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:41:51.349578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:41:51.349578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:41:51.349578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 598/1188] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:41:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:41:51.354247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ccb89-7c1b-4389-8498-89f1f06cf18b None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:51.356411 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:51.450320 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ccb89-7c1b-4389-8498-89f1f06cf18b None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:51.483266 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfe882-065f-4a84-b251-53c6826d32e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:51.483915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfe882-065f-4a84-b251-53c6826d32e2 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:51.484199 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfe882-065f-4a84-b251-53c6826d32e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:51.484473 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfe882-065f-4a84-b251-53c6826d32e2 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:51.485201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfe882-065f-4a84-b251-53c6826d32e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:51.485530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfe882-065f-4a84-b251-53c6826d32e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:51.486882 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfe882-065f-4a84-b251-53c6826d32e2 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:51.494713 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 591/1189] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:41:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:51.500446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96887b14-86a2-4e77-adc9-e7c5696d84da None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:51.596783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96887b14-86a2-4e77-adc9-e7c5696d84da None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:51.629207 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c293e67-0502-4431-8495-95f085568610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:51.630086 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c293e67-0502-4431-8495-95f085568610 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:51.630369 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c293e67-0502-4431-8495-95f085568610 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:51.630902 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c293e67-0502-4431-8495-95f085568610 None admin] PATH_INFO: `/v3/users/5b9802dc469b47cb915685dc365218a5` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:51.632065 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c293e67-0502-4431-8495-95f085568610 None admin] RBAC: Authorizing `identity:get_user(user_id=5b9802dc469b47cb915685dc365218a5)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:51.633511 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c293e67-0502-4431-8495-95f085568610 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:51.635108 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 599/1190] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:41:51 2022] GET /identity/v3/users/5b9802dc469b47cb915685dc365218a5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:51.640550 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfe882-065f-4a84-b251-53c6826d32e2 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:51.700519 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:51.738472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfe882-065f-4a84-b251-53c6826d32e2 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:51.770289 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266178b-93fe-41cf-adcc-ec79604d34ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:51.771129 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266178b-93fe-41cf-adcc-ec79604d34ab None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:51.771404 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266178b-93fe-41cf-adcc-ec79604d34ab None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:51.771671 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266178b-93fe-41cf-adcc-ec79604d34ab None admin] PATH_INFO: `/v3/projects/3f1ff61674b94f3c80ca9002bb03bf79` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:51.772807 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266178b-93fe-41cf-adcc-ec79604d34ab None admin] RBAC: Authorizing `identity:get_project(project_id=3f1ff61674b94f3c80ca9002bb03bf79)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:51.774255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266178b-93fe-41cf-adcc-ec79604d34ab None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:51.775896 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 592/1191] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:41:51 2022] GET /identity/v3/projects/3f1ff61674b94f3c80ca9002bb03bf79 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:51.782315 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c293e67-0502-4431-8495-95f085568610 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:51.810088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:51.881428 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c293e67-0502-4431-8495-95f085568610 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:51.913235 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194be2b-0d9a-4c58-a056-0fb7fb3868e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:51.914132 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194be2b-0d9a-4c58-a056-0fb7fb3868e9 None admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:51.914415 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194be2b-0d9a-4c58-a056-0fb7fb3868e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:51.914692 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194be2b-0d9a-4c58-a056-0fb7fb3868e9 None admin] PATH_INFO: `/v3/projects/3f1ff61674b94f3c80ca9002bb03bf79/users/5b9802dc469b47cb915685dc365218a5/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:51.916603 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194be2b-0d9a-4c58-a056-0fb7fb3868e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f1ff61674b94f3c80ca9002bb03bf79, user_id=5b9802dc469b47cb915685dc365218a5, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:51.918036 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194be2b-0d9a-4c58-a056-0fb7fb3868e9 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:51.930695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 600/1192] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:41:51 2022] PUT /identity/v3/projects/3f1ff61674b94f3c80ca9002bb03bf79/users/5b9802dc469b47cb915685dc365218a5/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:41:54.107293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adae411-1231-4df1-ad14-10255d7e66e8 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:54.107821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adae411-1231-4df1-ad14-10255d7e66e8 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:54.107821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adae411-1231-4df1-ad14-10255d7e66e8 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:54.109197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 593/1193] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:41:54.114391 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26aac2-fd11-4e43-a7cc-5c8578211640 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:54.114837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26aac2-fd11-4e43-a7cc-5c8578211640 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:54.114934 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26aac2-fd11-4e43-a7cc-5c8578211640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:54.131270 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-cc26aac2-fd11-4e43-a7cc-5c8578211640 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:41:54.132436 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-cc26aac2-fd11-4e43-a7cc-5c8578211640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:54.195936 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 601/1194] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:41:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:41:54.218806 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adae411-1231-4df1-ad14-10255d7e66e8 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:54.317221 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adae411-1231-4df1-ad14-10255d7e66e8 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:54.345770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:54.350952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ef414-b95f-42ee-b5c6-9cbfec178332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:54.351728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ef414-b95f-42ee-b5c6-9cbfec178332 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:54.352006 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ef414-b95f-42ee-b5c6-9cbfec178332 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:54.352278 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ef414-b95f-42ee-b5c6-9cbfec178332 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:54.362113 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ef414-b95f-42ee-b5c6-9cbfec178332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:41:54.369656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-101ef414-b95f-42ee-b5c6-9cbfec178332 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:41:54.369656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:41:54.369656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:41:54.369656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:41:54.369656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:41:54.369656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:41:54.369656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:41:54.369656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:41:54.369656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:41:54.369656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:41:54.369656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:41:54.369656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:41:54.369656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:41:54.369656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:41:54.369656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:41:54.369656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:41:54.370635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:41:54.370635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:41:54.370635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:41:54.370635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:41:54.370635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:41:54.370635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:41:54.370635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:41:54.370635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:41:54.370635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:41:54.370635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:41:54.370635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:41:54.370635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:41:54.370635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:41:54.370635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:41:54.370635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:41:54.370635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:41:54.371639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:41:54.371639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:41:54.371639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:41:54.371639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:41:54.371639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:41:54.371639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:41:54.371639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:41:54.371639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:41:54.371639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:41:54.371639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:41:54.371639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:41:54.371639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:41:54.371639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 594/1195] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:41:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:41:54.376910 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26aac2-fd11-4e43-a7cc-5c8578211640 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:54.395095 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:54.473351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26aac2-fd11-4e43-a7cc-5c8578211640 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:54.504770 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30503bee-c469-4ae7-9560-0bb603b13d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:54.505445 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30503bee-c469-4ae7-9560-0bb603b13d56 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:54.505979 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30503bee-c469-4ae7-9560-0bb603b13d56 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:54.506253 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30503bee-c469-4ae7-9560-0bb603b13d56 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:54.506981 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30503bee-c469-4ae7-9560-0bb603b13d56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:54.507283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30503bee-c469-4ae7-9560-0bb603b13d56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:54.508616 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30503bee-c469-4ae7-9560-0bb603b13d56 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:54.516780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 602/1196] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:41:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:54.522445 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ef414-b95f-42ee-b5c6-9cbfec178332 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:54.618703 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ef414-b95f-42ee-b5c6-9cbfec178332 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:54.650682 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31463a-a640-42f4-b324-91e96f86cb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:54.651524 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31463a-a640-42f4-b324-91e96f86cb60 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:54.651805 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31463a-a640-42f4-b324-91e96f86cb60 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:54.652079 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31463a-a640-42f4-b324-91e96f86cb60 None admin] PATH_INFO: `/v3/users/5b9802dc469b47cb915685dc365218a5` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:54.653234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31463a-a640-42f4-b324-91e96f86cb60 None admin] RBAC: Authorizing `identity:get_user(user_id=5b9802dc469b47cb915685dc365218a5)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:54.654688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31463a-a640-42f4-b324-91e96f86cb60 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:54.656257 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 595/1197] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 13:41:54 2022] GET /identity/v3/users/5b9802dc469b47cb915685dc365218a5 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:54.661698 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30503bee-c469-4ae7-9560-0bb603b13d56 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:54.739198 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:54.757605 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30503bee-c469-4ae7-9560-0bb603b13d56 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:54.789595 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5ff7f-1bea-4136-b08c-7a00573fbd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:54.790222 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5ff7f-1bea-4136-b08c-7a00573fbd78 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:54.790501 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5ff7f-1bea-4136-b08c-7a00573fbd78 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:54.790773 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5ff7f-1bea-4136-b08c-7a00573fbd78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:54.855529 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5ff7f-1bea-4136-b08c-7a00573fbd78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:54.857595 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5ff7f-1bea-4136-b08c-7a00573fbd78 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:54.934455 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:54.953486 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 603/1198] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:41:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 13:41:54.959346 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31463a-a640-42f4-b324-91e96f86cb60 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:55.016459 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:55.056723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31463a-a640-42f4-b324-91e96f86cb60 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:55.088393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c50e3-c682-4e34-89b2-7cf57068c16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:55.089229 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c50e3-c682-4e34-89b2-7cf57068c16a None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:55.089537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c50e3-c682-4e34-89b2-7cf57068c16a None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:55.089809 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c50e3-c682-4e34-89b2-7cf57068c16a None admin] PATH_INFO: `/v3/projects/3f1ff61674b94f3c80ca9002bb03bf79` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:55.091513 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c50e3-c682-4e34-89b2-7cf57068c16a None admin] RBAC: Authorizing `identity:get_project(project_id=3f1ff61674b94f3c80ca9002bb03bf79)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:55.092936 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c50e3-c682-4e34-89b2-7cf57068c16a None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:55.094622 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 596/1199] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 13:41:54 2022] GET /identity/v3/projects/3f1ff61674b94f3c80ca9002bb03bf79 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:41:55.100678 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5ff7f-1bea-4136-b08c-7a00573fbd78 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:55.194664 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5ff7f-1bea-4136-b08c-7a00573fbd78 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:55.227308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5da454-4e00-45f8-8d27-47723891a918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:55.227938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5da454-4e00-45f8-8d27-47723891a918 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:55.228219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5da454-4e00-45f8-8d27-47723891a918 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:55.228493 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5da454-4e00-45f8-8d27-47723891a918 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:55.229326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5da454-4e00-45f8-8d27-47723891a918 None admin] RBAC: Adding query filter params (role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.project.id=3f1ff61674b94f3c80ca9002bb03bf79, user.id=5b9802dc469b47cb915685dc365218a5) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:41:55.229638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5da454-4e00-45f8-8d27-47723891a918 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:55.231039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5da454-4e00-45f8-8d27-47723891a918 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:55.236640 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 604/1200] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:41:55 2022] GET /identity/v3/role_assignments?user.id=5b9802dc469b47cb915685dc365218a5&scope.project.id=3f1ff61674b94f3c80ca9002bb03bf79&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:42:05.084401 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=36 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:42:05.234112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=78 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:42:54.952690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e364a2-2cc1-4c52-80cf-af4702a364e5 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:42:54.953247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e364a2-2cc1-4c52-80cf-af4702a364e5 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:42:54.953247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e364a2-2cc1-4c52-80cf-af4702a364e5 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:42:54.954852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 597/1201] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:42:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:42:54.960747 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cfa9d-363b-4934-a2de-bda832e1ce80 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:42:54.962014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cfa9d-363b-4934-a2de-bda832e1ce80 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:42:54.962014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cfa9d-363b-4934-a2de-bda832e1ce80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:42:54.980129 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-dc4cfa9d-363b-4934-a2de-bda832e1ce80 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:42:54.981594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-dc4cfa9d-363b-4934-a2de-bda832e1ce80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:42:55.078840 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 605/1202] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:42:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 13:42:55.108821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e364a2-2cc1-4c52-80cf-af4702a364e5 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:42:55.257614 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e364a2-2cc1-4c52-80cf-af4702a364e5 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:42:55.309977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d2079-9f3b-4bba-8f85-f066e20b973d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:42:55.310801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d2079-9f3b-4bba-8f85-f066e20b973d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:42:55.311176 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d2079-9f3b-4bba-8f85-f066e20b973d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:42:55.311610 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d2079-9f3b-4bba-8f85-f066e20b973d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:42:55.324972 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d2079-9f3b-4bba-8f85-f066e20b973d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:42:55.326570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d2079-9f3b-4bba-8f85-f066e20b973d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:42:55.350370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-b20d2079-9f3b-4bba-8f85-f066e20b973d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:42:55.350370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:42:55.350370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:42:55.350370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:42:55.350370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:42:55.350370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:42:55.350370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:42:55.350370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:42:55.350370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:42:55.350370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:42:55.350370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:42:55.350370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:42:55.350370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:42:55.350370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:42:55.350370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:42:55.351485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:42:55.351485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:42:55.351485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:42:55.351485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:42:55.351485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:42:55.351485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:42:55.351485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:42:55.351485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:42:55.351485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:42:55.351485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:42:55.351485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:42:55.351485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:42:55.351485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:42:55.351485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:42:55.351485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:42:55.351485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:42:55.351485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:42:55.352538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:42:55.352538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:42:55.352538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:42:55.352538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:42:55.352538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 598/1203] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:42:55.358147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cfa9d-363b-4934-a2de-bda832e1ce80 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:42:55.497178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cfa9d-363b-4934-a2de-bda832e1ce80 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:42:55.538260 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:42:55.543109 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a2556-248f-44c4-998f-a0dbd6079aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:42:55.543963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a2556-248f-44c4-998f-a0dbd6079aab None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:42:55.544253 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a2556-248f-44c4-998f-a0dbd6079aab None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:42:55.544523 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a2556-248f-44c4-998f-a0dbd6079aab None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:42:55.545251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a2556-248f-44c4-998f-a0dbd6079aab None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:42:55.545579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a2556-248f-44c4-998f-a0dbd6079aab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:42:55.546948 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a2556-248f-44c4-998f-a0dbd6079aab None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:42:55.560863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 606/1204] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:42:55.568132 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d2079-9f3b-4bba-8f85-f066e20b973d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:42:55.625856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:42:55.690883 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d2079-9f3b-4bba-8f85-f066e20b973d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:42:55.725895 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ed1fd-0966-45a1-9bf7-be546fdaaa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:42:55.726568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ed1fd-0966-45a1-9bf7-be546fdaaa04 None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:42:55.726872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ed1fd-0966-45a1-9bf7-be546fdaaa04 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:42:55.727151 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ed1fd-0966-45a1-9bf7-be546fdaaa04 None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:42:55.727853 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ed1fd-0966-45a1-9bf7-be546fdaaa04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:42:55.729294 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ed1fd-0966-45a1-9bf7-be546fdaaa04 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:42:55.752488 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 599/1205] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 13:42:55 2022] POST /identity/v3/users => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:42:58.287148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6884e9-2956-4bd2-a81a-5ce606a0e27e None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:42:58.287699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6884e9-2956-4bd2-a81a-5ce606a0e27e None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:42:58.287699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6884e9-2956-4bd2-a81a-5ce606a0e27e None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:42:58.289089 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 607/1206] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:42:58.299355 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df9877-9bcd-4a16-9e88-f7dd73625d87 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:42:58.299877 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df9877-9bcd-4a16-9e88-f7dd73625d87 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:42:58.299877 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df9877-9bcd-4a16-9e88-f7dd73625d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:42:58.324445 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a3df9877-9bcd-4a16-9e88-f7dd73625d87 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:42:58.326086 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a3df9877-9bcd-4a16-9e88-f7dd73625d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:42:58.420725 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 600/1207] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:42:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:42:58.453674 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6884e9-2956-4bd2-a81a-5ce606a0e27e None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:42:58.587709 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6884e9-2956-4bd2-a81a-5ce606a0e27e None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:42:58.626045 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d7ed8-2212-4d41-806c-7c373c80cfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:42:58.626917 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d7ed8-2212-4d41-806c-7c373c80cfb9 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:42:58.627205 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d7ed8-2212-4d41-806c-7c373c80cfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:42:58.627482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d7ed8-2212-4d41-806c-7c373c80cfb9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:42:58.641614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d7ed8-2212-4d41-806c-7c373c80cfb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:42:58.650003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-4d6d7ed8-2212-4d41-806c-7c373c80cfb9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:42:58.650003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:42:58.650003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:42:58.650003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:42:58.650003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:42:58.650003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:42:58.650003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:42:58.650003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:42:58.650003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:42:58.650003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:42:58.650003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:42:58.650003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:42:58.650003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:42:58.650003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:42:58.650003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:42:58.650003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:42:58.651276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:42:58.651276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:42:58.651276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:42:58.651276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:42:58.651276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:42:58.651276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:42:58.651276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:42:58.651276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:42:58.651276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:42:58.651276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:42:58.651276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:42:58.651276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:42:58.651276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:42:58.651276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:42:58.651276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:42:58.651276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:42:58.652165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:42:58.652165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:42:58.652165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:42:58.652165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:42:58.652165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:42:58.652165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:42:58.652165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:42:58.652165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:42:58.652165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:42:58.652165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:42:58.652165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:42:58.652165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:42:58.656738 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 608/1208] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:42:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:42:58.658970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df9877-9bcd-4a16-9e88-f7dd73625d87 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:42:58.710376 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:42:58.790429 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df9877-9bcd-4a16-9e88-f7dd73625d87 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:42:58.829995 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a235b-df8b-4f5a-ae22-69cec180baf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:42:58.830706 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a235b-df8b-4f5a-ae22-69cec180baf7 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:42:58.831027 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a235b-df8b-4f5a-ae22-69cec180baf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:42:58.831302 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a235b-df8b-4f5a-ae22-69cec180baf7 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:42:58.832088 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a235b-df8b-4f5a-ae22-69cec180baf7 None admin] RBAC: Adding query filter params (name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:42:58.832393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a235b-df8b-4f5a-ae22-69cec180baf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:42:58.833875 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a235b-df8b-4f5a-ae22-69cec180baf7 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:42:58.844887 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 601/1209] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:42:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:42:58.850635 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d7ed8-2212-4d41-806c-7c373c80cfb9 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:42:58.904992 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:42:58.963313 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d7ed8-2212-4d41-806c-7c373c80cfb9 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:42:59.003089 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77156173-6479-4101-bcf6-cdf371b83603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:42:59.003890 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77156173-6479-4101-bcf6-cdf371b83603 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:42:59.004179 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77156173-6479-4101-bcf6-cdf371b83603 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:42:59.004461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77156173-6479-4101-bcf6-cdf371b83603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:42:59.015571 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77156173-6479-4101-bcf6-cdf371b83603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:42:59.017041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77156173-6479-4101-bcf6-cdf371b83603 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:42:59.036786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-77156173-6479-4101-bcf6-cdf371b83603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:42:59.036786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:42:59.036786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:42:59.036786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:42:59.036786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:42:59.036786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:42:59.036786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:42:59.036786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:42:59.036786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:42:59.036786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:42:59.036786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:42:59.036786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:42:59.036786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:42:59.036786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:42:59.036786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:42:59.037961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:42:59.037961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:42:59.037961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:42:59.037961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:42:59.037961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:42:59.037961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:42:59.037961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:42:59.037961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:42:59.037961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:42:59.037961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:42:59.037961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:42:59.037961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:42:59.037961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:42:59.037961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:42:59.037961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:42:59.037961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:42:59.037961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:42:59.039670 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:42:59.039670 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:42:59.039670 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:42:59.039670 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:42:59.043299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 609/1210] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:42:59.045146 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a235b-df8b-4f5a-ae22-69cec180baf7 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:42:59.186662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:42:59.189305 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a235b-df8b-4f5a-ae22-69cec180baf7 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:42:59.228927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c38b95-aafb-468d-859a-65c2b07d3423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:42:59.229651 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c38b95-aafb-468d-859a-65c2b07d3423 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:42:59.229920 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c38b95-aafb-468d-859a-65c2b07d3423 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:42:59.230249 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c38b95-aafb-468d-859a-65c2b07d3423 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:42:59.231140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c38b95-aafb-468d-859a-65c2b07d3423 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:42:59.231425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c38b95-aafb-468d-859a-65c2b07d3423 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:42:59.232840 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c38b95-aafb-468d-859a-65c2b07d3423 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:42:59.254151 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 602/1211] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:42:59.256028 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77156173-6479-4101-bcf6-cdf371b83603 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:42:59.367892 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77156173-6479-4101-bcf6-cdf371b83603 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:42:59.369588 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:42:59.410596 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44471a00-0c83-4621-afb0-01696628bf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:42:59.411735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44471a00-0c83-4621-afb0-01696628bf2a None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:42:59.412148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44471a00-0c83-4621-afb0-01696628bf2a None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:42:59.412608 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44471a00-0c83-4621-afb0-01696628bf2a None admin] PATH_INFO: `/v3/users/placement` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:42:59.421262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44471a00-0c83-4621-afb0-01696628bf2a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:42:59.423090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44471a00-0c83-4621-afb0-01696628bf2a None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:42:59.447728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-44471a00-0c83-4621-afb0-01696628bf2a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 13:42:59.447728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:42:59.447728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:42:59.447728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:42:59.447728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:42:59.447728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:42:59.447728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:42:59.447728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:42:59.447728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:42:59.447728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:42:59.447728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:42:59.447728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:42:59.447728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:42:59.447728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:42:59.447728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:42:59.447728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:42:59.449003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:42:59.449003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:42:59.449003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:42:59.449003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:42:59.449003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:42:59.449003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:42:59.449003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:42:59.449003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:42:59.449003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:42:59.449003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:42:59.449003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:42:59.449003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:42:59.449003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:42:59.449003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:42:59.449003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:42:59.449003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:42:59.449003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:42:59.449003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:42:59.450364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:42:59.450364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:42:59.450364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:42:59.450364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:42:59.450364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:42:59.450364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:42:59.450364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:42:59.450364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:42:59.450364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 13:42:59.450364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:42:59.452554 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 610/1212] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:42:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:42:59.459745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c38b95-aafb-468d-859a-65c2b07d3423 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:42:59.584340 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c38b95-aafb-468d-859a-65c2b07d3423 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:42:59.625224 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2daaad-c457-435e-b5da-821d725ebf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:42:59.626325 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2daaad-c457-435e-b5da-821d725ebf01 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:42:59.626826 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2daaad-c457-435e-b5da-821d725ebf01 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:42:59.627311 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2daaad-c457-435e-b5da-821d725ebf01 None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:42:59.628711 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2daaad-c457-435e-b5da-821d725ebf01 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:42:59.629419 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2daaad-c457-435e-b5da-821d725ebf01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:42:59.631288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2daaad-c457-435e-b5da-821d725ebf01 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:42:59.656271 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 603/1213] 10.222.0.45 () {56 vars in 1143 bytes} [Thu May 26 13:42:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:42:59.662266 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44471a00-0c83-4621-afb0-01696628bf2a None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:42:59.784458 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44471a00-0c83-4621-afb0-01696628bf2a None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:42:59.832092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1959b88-6cda-478b-9990-508ba53a5e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:42:59.833587 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1959b88-6cda-478b-9990-508ba53a5e2b None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:42:59.833587 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1959b88-6cda-478b-9990-508ba53a5e2b None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:42:59.833587 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1959b88-6cda-478b-9990-508ba53a5e2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:42:59.866750 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:42:59.912395 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1959b88-6cda-478b-9990-508ba53a5e2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:42:59.914182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1959b88-6cda-478b-9990-508ba53a5e2b None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:00.033303 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 611/1214] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:42:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 13:43:00.039907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2daaad-c457-435e-b5da-821d725ebf01 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:00.059555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:00.159165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2daaad-c457-435e-b5da-821d725ebf01 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:00.203793 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd92aee-a0a1-4488-8e43-9be2349ffc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:00.204584 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd92aee-a0a1-4488-8e43-9be2349ffc19 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:00.204864 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd92aee-a0a1-4488-8e43-9be2349ffc19 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:00.205136 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd92aee-a0a1-4488-8e43-9be2349ffc19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:00.219947 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd92aee-a0a1-4488-8e43-9be2349ffc19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:00.221826 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd92aee-a0a1-4488-8e43-9be2349ffc19 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:00.255062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-cbd92aee-a0a1-4488-8e43-9be2349ffc19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:00.255062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:00.255062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:00.255062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:00.255062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:00.255062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:00.255062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:00.255062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:00.255062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:00.255062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:00.255062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:00.255062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:00.255062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:43:00.255062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:43:00.255062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:43:00.256134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:43:00.256134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:00.256134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:00.256134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:00.256134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:00.256134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:00.256134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:00.256134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:00.256134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:43:00.256134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:00.256134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:00.256134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:00.256134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:00.256134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:00.256134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:00.256134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:00.256134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:00.257084 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:43:00.257084 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:43:00.257084 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:00.257084 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:43:00.260266 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 604/1215] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:43:00.266749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1959b88-6cda-478b-9990-508ba53a5e2b None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:00.337719 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:00.383548 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1959b88-6cda-478b-9990-508ba53a5e2b None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:00.423252 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e95938-0244-4fa6-a6c1-22cee7390be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:00.423922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e95938-0244-4fa6-a6c1-22cee7390be5 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:00.424208 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e95938-0244-4fa6-a6c1-22cee7390be5 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:00.424487 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e95938-0244-4fa6-a6c1-22cee7390be5 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:00.425259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e95938-0244-4fa6-a6c1-22cee7390be5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:00.425622 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e95938-0244-4fa6-a6c1-22cee7390be5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:00.426989 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e95938-0244-4fa6-a6c1-22cee7390be5 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:00.444008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 612/1216] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:00.445386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd92aee-a0a1-4488-8e43-9be2349ffc19 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:00.532124 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:00.577245 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd92aee-a0a1-4488-8e43-9be2349ffc19 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:00.613155 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09707619-89b7-4ac3-8e94-3fbca9bfade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:00.614041 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09707619-89b7-4ac3-8e94-3fbca9bfade9 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:00.614445 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09707619-89b7-4ac3-8e94-3fbca9bfade9 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:00.614823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09707619-89b7-4ac3-8e94-3fbca9bfade9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:00.623491 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09707619-89b7-4ac3-8e94-3fbca9bfade9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:00.625087 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09707619-89b7-4ac3-8e94-3fbca9bfade9 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:00.640063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-09707619-89b7-4ac3-8e94-3fbca9bfade9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:43:00.640063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:00.640063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:00.640063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:00.640063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:00.640063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:00.640063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:00.640063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:00.640063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:00.640063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:00.640063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:00.640063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:00.640063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:43:00.640063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:43:00.640063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:43:00.641368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:43:00.641368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:00.641368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:00.641368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:00.641368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:00.641368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:00.641368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:00.641368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:00.641368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:43:00.641368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:00.641368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:00.641368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:00.641368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:00.641368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:00.641368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:00.641368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:00.641368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:00.647835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:43:00.647835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:43:00.647835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:43:00.647835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:43:00.647835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:43:00.647835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:43:00.647835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:43:00.647835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:43:00.647835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 605/1217] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:43:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:43:00.648470 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e95938-0244-4fa6-a6c1-22cee7390be5 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:00.768289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e95938-0244-4fa6-a6c1-22cee7390be5 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:00.796845 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:00.809464 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f401591-b6f7-4802-9360-537db4fc565c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:00.810123 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f401591-b6f7-4802-9360-537db4fc565c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:00.810402 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f401591-b6f7-4802-9360-537db4fc565c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:00.810675 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f401591-b6f7-4802-9360-537db4fc565c None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:00.811459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f401591-b6f7-4802-9360-537db4fc565c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:00.811751 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f401591-b6f7-4802-9360-537db4fc565c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:00.813464 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f401591-b6f7-4802-9360-537db4fc565c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:00.829323 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 613/1218] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:43:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:43:00.836346 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09707619-89b7-4ac3-8e94-3fbca9bfade9 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:00.952809 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09707619-89b7-4ac3-8e94-3fbca9bfade9 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:00.984295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:00.990699 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d7c77-66c2-4163-b408-032b45346ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:00.991343 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d7c77-66c2-4163-b408-032b45346ad4 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:00.991623 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d7c77-66c2-4163-b408-032b45346ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:00.991898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d7c77-66c2-4163-b408-032b45346ad4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:00.992751 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d7c77-66c2-4163-b408-032b45346ad4 None admin] RBAC: Adding query filter params (role.id=0bb0d62bb4f84638888ceb6ecabda8b3, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=8b0db68b7fda4da29eb13689f3fd7b5f) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:00.993062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d7c77-66c2-4163-b408-032b45346ad4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:00.994547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d7c77-66c2-4163-b408-032b45346ad4 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:01.000504 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 606/1219] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:43:00 2022] GET /identity/v3/role_assignments?user.id=8b0db68b7fda4da29eb13689f3fd7b5f&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=0bb0d62bb4f84638888ceb6ecabda8b3 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:03.298495 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3e306-1619-473f-9d42-a853907b8660 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:03.299061 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3e306-1619-473f-9d42-a853907b8660 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:03.299061 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3e306-1619-473f-9d42-a853907b8660 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:03.300424 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 614/1220] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:43:03.306325 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d9a65-4ba5-4595-8520-c9ff77f4318d None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:03.306766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d9a65-4ba5-4595-8520-c9ff77f4318d None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:03.306929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d9a65-4ba5-4595-8520-c9ff77f4318d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:03.327463 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-404d9a65-4ba5-4595-8520-c9ff77f4318d None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:43:03.328694 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-404d9a65-4ba5-4595-8520-c9ff77f4318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:43:03.403308 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 607/1221] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:43:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:43:03.425798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3e306-1619-473f-9d42-a853907b8660 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:03.560927 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3e306-1619-473f-9d42-a853907b8660 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:03.604974 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dad77d-5cdc-4aaf-9319-33d40fbe7c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:03.605879 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dad77d-5cdc-4aaf-9319-33d40fbe7c9f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:03.606239 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dad77d-5cdc-4aaf-9319-33d40fbe7c9f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:03.606490 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dad77d-5cdc-4aaf-9319-33d40fbe7c9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:03.618180 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dad77d-5cdc-4aaf-9319-33d40fbe7c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:43:03.626351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-83dad77d-5cdc-4aaf-9319-33d40fbe7c9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:43:03.626351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:03.626351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:03.626351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:03.626351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:03.626351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:03.626351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:03.626351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:03.626351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:03.626351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:03.626351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:03.626351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:03.626351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:43:03.626351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:43:03.626351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:43:03.626351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:43:03.628140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:43:03.628140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:43:03.628140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:43:03.628140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:43:03.628140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:03.628140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:03.628140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:03.628140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:03.628140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:03.628140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:03.628140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:03.628140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:43:03.628140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:03.628140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:03.628140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:03.628140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:03.629202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:03.629202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:03.629202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:03.629202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:03.629202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:43:03.629202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:43:03.629202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:43:03.629202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:43:03.629202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:43:03.629202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:43:03.629202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:43:03.629202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:03.629202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 615/1222] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:43:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:03.634161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d9a65-4ba5-4595-8520-c9ff77f4318d None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:03.775069 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d9a65-4ba5-4595-8520-c9ff77f4318d None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:03.808032 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:03.821184 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe3e14-29c9-42fd-bb29-ad7e049c7be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:03.821894 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe3e14-29c9-42fd-bb29-ad7e049c7be2 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:03.822145 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe3e14-29c9-42fd-bb29-ad7e049c7be2 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:03.822433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe3e14-29c9-42fd-bb29-ad7e049c7be2 None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:03.823296 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe3e14-29c9-42fd-bb29-ad7e049c7be2 None admin] RBAC: Adding query filter params (name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:03.823972 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe3e14-29c9-42fd-bb29-ad7e049c7be2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:03.825138 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe3e14-29c9-42fd-bb29-ad7e049c7be2 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:03.837232 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 608/1223] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:43:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:03.843869 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dad77d-5cdc-4aaf-9319-33d40fbe7c9f None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:03.895577 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:03.980221 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dad77d-5cdc-4aaf-9319-33d40fbe7c9f None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:04.021876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2527fdb-c4b1-4e82-b553-d559ad21a98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:04.023771 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2527fdb-c4b1-4e82-b553-d559ad21a98f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:04.024213 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2527fdb-c4b1-4e82-b553-d559ad21a98f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:04.024501 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2527fdb-c4b1-4e82-b553-d559ad21a98f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:04.036913 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2527fdb-c4b1-4e82-b553-d559ad21a98f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:04.038442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2527fdb-c4b1-4e82-b553-d559ad21a98f None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:04.058748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-f2527fdb-c4b1-4e82-b553-d559ad21a98f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:04.058748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:04.058748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:04.058748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:04.058748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:04.058748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:04.058748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:04.058748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:04.058748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:04.058748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:04.058748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:04.058748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:04.058748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:43:04.058748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:43:04.058748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:43:04.059695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:43:04.059695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:04.059695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:04.059695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:04.059695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:04.059695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:04.059695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:04.059695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:04.059695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:43:04.059695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:04.059695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:04.059695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:04.059695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:04.059695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:04.059695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:04.059695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:04.059695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:04.060679 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:43:04.060679 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:43:04.060679 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:04.060679 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:04.064982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 616/1224] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:04.066073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe3e14-29c9-42fd-bb29-ad7e049c7be2 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:04.173401 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe3e14-29c9-42fd-bb29-ad7e049c7be2 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:04.214990 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3962ab-9478-427d-930a-84f716ae753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:04.215659 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3962ab-9478-427d-930a-84f716ae753a None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:04.215949 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3962ab-9478-427d-930a-84f716ae753a None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:04.216218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3962ab-9478-427d-930a-84f716ae753a None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:04.216927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3962ab-9478-427d-930a-84f716ae753a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:04.217280 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3962ab-9478-427d-930a-84f716ae753a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:04.218634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3962ab-9478-427d-930a-84f716ae753a None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:04.231399 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 609/1225] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:04.237655 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2527fdb-c4b1-4e82-b553-d559ad21a98f None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:04.352937 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:04.360866 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2527fdb-c4b1-4e82-b553-d559ad21a98f None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:04.397100 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da7284-f461-4bf9-a269-5fddbfe3a206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:04.398023 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da7284-f461-4bf9-a269-5fddbfe3a206 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:04.398940 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da7284-f461-4bf9-a269-5fddbfe3a206 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:04.399250 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da7284-f461-4bf9-a269-5fddbfe3a206 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:04.407169 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da7284-f461-4bf9-a269-5fddbfe3a206 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:04.408675 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da7284-f461-4bf9-a269-5fddbfe3a206 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:04.423342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-82da7284-f461-4bf9-a269-5fddbfe3a206 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 13:43:04.423342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:04.423342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:04.423342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:04.423342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:04.423342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:04.423342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:04.423342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:04.423342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:04.423342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:04.423342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:04.423342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:04.423342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:43:04.423342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:43:04.423342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:43:04.423342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:43:04.424459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:04.424459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:04.424459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:43:04.424459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:43:04.424459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:43:04.424459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:43:04.424459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:04.424459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:04.424459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:04.424459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:04.424459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:04.424459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:43:04.424459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:04.424459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:04.424459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:04.424459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:04.424459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:04.424459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:04.425478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:04.425478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:04.425478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:43:04.425478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:43:04.425478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:43:04.425478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:43:04.425478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:43:04.425478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:43:04.425478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 13:43:04.425478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:04.425478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 617/1226] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:43:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:43:04.430968 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3962ab-9478-427d-930a-84f716ae753a None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:04.487837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:04.545123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3962ab-9478-427d-930a-84f716ae753a None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:04.581322 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e28c5-0aeb-4830-8fe0-4896b6199cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:04.582047 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e28c5-0aeb-4830-8fe0-4896b6199cd6 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:04.582369 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e28c5-0aeb-4830-8fe0-4896b6199cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:04.582648 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e28c5-0aeb-4830-8fe0-4896b6199cd6 None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:04.583469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e28c5-0aeb-4830-8fe0-4896b6199cd6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:04.583807 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e28c5-0aeb-4830-8fe0-4896b6199cd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:04.585515 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e28c5-0aeb-4830-8fe0-4896b6199cd6 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:04.603226 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 610/1227] 10.222.0.45 () {56 vars in 1143 bytes} [Thu May 26 13:43:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:04.609285 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da7284-f461-4bf9-a269-5fddbfe3a206 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:04.724623 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da7284-f461-4bf9-a269-5fddbfe3a206 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:04.762327 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814dee6-12f6-49d3-8c5e-1b807e5dae69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:04.763190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814dee6-12f6-49d3-8c5e-1b807e5dae69 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:04.763472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814dee6-12f6-49d3-8c5e-1b807e5dae69 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:04.763792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814dee6-12f6-49d3-8c5e-1b807e5dae69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:04.776182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814dee6-12f6-49d3-8c5e-1b807e5dae69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:04.777855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814dee6-12f6-49d3-8c5e-1b807e5dae69 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:04.800008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-9814dee6-12f6-49d3-8c5e-1b807e5dae69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:04.800008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:04.800008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:04.800008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:04.800008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:04.800008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:04.800008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:04.800008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:04.800008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:04.800008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:04.800008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:04.800008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:04.800008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:43:04.800008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:43:04.800008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:43:04.801259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:43:04.801259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:04.801259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:04.801259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:04.801259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:04.801259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:04.801259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:04.801259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:04.801259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:43:04.801259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:04.801259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:04.801259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:04.801259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:04.801259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:04.801259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:04.801259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:04.801259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:04.802410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:43:04.802410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:43:04.802410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:04.802410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:04.802410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 618/1228] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:04.809480 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e28c5-0aeb-4830-8fe0-4896b6199cd6 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:04.921189 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e28c5-0aeb-4830-8fe0-4896b6199cd6 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:04.923547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:04.958326 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8471345-638a-4673-af98-41659a4e6b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:04.958873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8471345-638a-4673-af98-41659a4e6b0d None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:04.959150 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8471345-638a-4673-af98-41659a4e6b0d None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:04.959418 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8471345-638a-4673-af98-41659a4e6b0d None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:04.960129 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8471345-638a-4673-af98-41659a4e6b0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:04.960432 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8471345-638a-4673-af98-41659a4e6b0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:04.962400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8471345-638a-4673-af98-41659a4e6b0d None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:04.974174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 611/1229] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:04.980818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814dee6-12f6-49d3-8c5e-1b807e5dae69 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:04.991046 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:05.090229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814dee6-12f6-49d3-8c5e-1b807e5dae69 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:05.125401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c59206-bd6b-4e25-8ec1-a21edd30c21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:05.126253 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c59206-bd6b-4e25-8ec1-a21edd30c21f None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:05.126589 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c59206-bd6b-4e25-8ec1-a21edd30c21f None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:05.126902 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c59206-bd6b-4e25-8ec1-a21edd30c21f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:05.134832 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c59206-bd6b-4e25-8ec1-a21edd30c21f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:05.136260 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c59206-bd6b-4e25-8ec1-a21edd30c21f None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:05.151714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-38c59206-bd6b-4e25-8ec1-a21edd30c21f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:43:05.151714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:05.151714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:05.151714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:05.151714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:05.151714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:05.151714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:05.151714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:05.151714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:05.151714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:05.151714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:05.151714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:05.151714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:43:05.151714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:43:05.151714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:43:05.152850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:43:05.152850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:05.152850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:05.152850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:05.152850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:05.152850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:05.152850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:05.152850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:05.152850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:43:05.152850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:05.152850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:05.152850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:05.152850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:05.152850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:05.152850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:05.152850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:05.152850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:05.154011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:43:05.154011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:43:05.154011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:43:05.154011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:43:05.154011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:43:05.154011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:43:05.154011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:43:05.154011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:05.154011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 619/1230] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:43:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:05.159446 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8471345-638a-4673-af98-41659a4e6b0d None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:05.270776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8471345-638a-4673-af98-41659a4e6b0d None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:05.306038 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fba21-126b-4749-a996-e6c4c0073c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:05.306701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fba21-126b-4749-a996-e6c4c0073c90 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:05.306983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fba21-126b-4749-a996-e6c4c0073c90 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:05.307260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fba21-126b-4749-a996-e6c4c0073c90 None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:05.308042 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fba21-126b-4749-a996-e6c4c0073c90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:05.308350 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fba21-126b-4749-a996-e6c4c0073c90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:05.309829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fba21-126b-4749-a996-e6c4c0073c90 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:05.323008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 612/1231] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:43:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:43:05.330006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c59206-bd6b-4e25-8ec1-a21edd30c21f None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:05.406200 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:05.448850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c59206-bd6b-4e25-8ec1-a21edd30c21f None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:05.486846 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdb98d-bafe-4175-b2a9-e21628d98e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:05.487738 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdb98d-bafe-4175-b2a9-e21628d98e49 None admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:05.488028 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdb98d-bafe-4175-b2a9-e21628d98e49 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:05.488309 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdb98d-bafe-4175-b2a9-e21628d98e49 None admin] PATH_INFO: `/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/8b0db68b7fda4da29eb13689f3fd7b5f/roles/0bb0d62bb4f84638888ceb6ecabda8b3` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:05.503118 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdb98d-bafe-4175-b2a9-e21628d98e49 None admin] RBAC: Authorizing `identity:create_grant(project_id=095d02b8a79c4915ac8d3c5b81e195a4, user_id=8b0db68b7fda4da29eb13689f3fd7b5f, role_id=0bb0d62bb4f84638888ceb6ecabda8b3)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:05.504643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdb98d-bafe-4175-b2a9-e21628d98e49 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:05.516626 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 620/1232] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:43:05 2022] PUT /identity/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/8b0db68b7fda4da29eb13689f3fd7b5f/roles/0bb0d62bb4f84638888ceb6ecabda8b3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:43:07.898499 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20b1e9-3e8e-4080-8be2-58c34e338b82 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:07.899091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20b1e9-3e8e-4080-8be2-58c34e338b82 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:07.899091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20b1e9-3e8e-4080-8be2-58c34e338b82 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:07.900465 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 613/1233] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:43:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:43:07.906219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70689765-5a45-4386-a5d6-2541250e7a34 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:07.906723 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70689765-5a45-4386-a5d6-2541250e7a34 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:07.906826 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70689765-5a45-4386-a5d6-2541250e7a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:07.923640 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-70689765-5a45-4386-a5d6-2541250e7a34 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:43:07.924862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-70689765-5a45-4386-a5d6-2541250e7a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:43:07.995638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 621/1234] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:43:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 13:43:08.019159 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20b1e9-3e8e-4080-8be2-58c34e338b82 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:08.047982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:08.141233 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20b1e9-3e8e-4080-8be2-58c34e338b82 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:08.176600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316da21-755d-4a53-bbdd-0356c5d2c641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:08.177435 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316da21-755d-4a53-bbdd-0356c5d2c641 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:08.177717 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316da21-755d-4a53-bbdd-0356c5d2c641 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:08.177993 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316da21-755d-4a53-bbdd-0356c5d2c641 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:08.189795 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316da21-755d-4a53-bbdd-0356c5d2c641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:43:08.198466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-e316da21-755d-4a53-bbdd-0356c5d2c641 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 13:43:08.198466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:08.198466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:08.198466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:08.198466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:08.198466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:08.198466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:08.198466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:08.198466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:08.198466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:08.198466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:08.198466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:08.198466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:43:08.198466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:43:08.198466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:43:08.198466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:43:08.199802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:43:08.199802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:43:08.199802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:43:08.199802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:43:08.199802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:08.199802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:08.199802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:08.199802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:08.199802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:08.199802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:08.199802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:08.199802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:43:08.199802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:08.199802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:08.199802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:08.199802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:08.200763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:08.200763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:08.200763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:08.200763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:08.200763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:43:08.200763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:43:08.200763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:43:08.200763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:43:08.200763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:43:08.200763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:43:08.200763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 13:43:08.200763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:43:08.200763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 614/1235] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 13:43:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:08.206321 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70689765-5a45-4386-a5d6-2541250e7a34 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:08.258337 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:08.325535 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70689765-5a45-4386-a5d6-2541250e7a34 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:08.367647 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbfe82-1604-4e16-a0f0-935e19998886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:08.368366 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbfe82-1604-4e16-a0f0-935e19998886 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:08.368666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbfe82-1604-4e16-a0f0-935e19998886 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:08.369194 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbfe82-1604-4e16-a0f0-935e19998886 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:08.369978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbfe82-1604-4e16-a0f0-935e19998886 None admin] RBAC: Adding query filter params (name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:08.370336 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbfe82-1604-4e16-a0f0-935e19998886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:08.372277 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbfe82-1604-4e16-a0f0-935e19998886 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:08.382584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 622/1236] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 13:43:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:08.389916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316da21-755d-4a53-bbdd-0356c5d2c641 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:08.518714 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:08.541805 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316da21-755d-4a53-bbdd-0356c5d2c641 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:08.588124 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c46b0-56f4-4593-937b-b6bda65a39e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:08.589083 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c46b0-56f4-4593-937b-b6bda65a39e0 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:08.589393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c46b0-56f4-4593-937b-b6bda65a39e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:08.589692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c46b0-56f4-4593-937b-b6bda65a39e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:08.602014 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c46b0-56f4-4593-937b-b6bda65a39e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:08.603678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c46b0-56f4-4593-937b-b6bda65a39e0 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:08.623885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-ab0c46b0-56f4-4593-937b-b6bda65a39e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:08.623885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:08.623885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:08.623885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:08.623885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:08.623885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:08.623885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:08.623885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:08.623885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:08.623885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:08.623885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:08.623885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:08.623885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:43:08.623885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:43:08.623885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:43:08.625130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:43:08.625130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:08.625130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:08.625130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:08.625130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:08.625130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:08.625130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:08.625130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:08.625130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:43:08.625130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:08.625130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:08.625130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:08.625130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:08.625130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:08.625130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:08.625130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:08.625130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:08.626315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:43:08.626315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:43:08.626315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:08.626315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:43:08.626315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 615/1237] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:08.631284 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbfe82-1604-4e16-a0f0-935e19998886 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:08.748419 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbfe82-1604-4e16-a0f0-935e19998886 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:08.760506 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:08.787800 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cface8-8dae-470d-b527-61defa4d12da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:08.788459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cface8-8dae-470d-b527-61defa4d12da None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:08.788739 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cface8-8dae-470d-b527-61defa4d12da None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:08.789016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cface8-8dae-470d-b527-61defa4d12da None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:08.789761 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cface8-8dae-470d-b527-61defa4d12da None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:08.790067 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cface8-8dae-470d-b527-61defa4d12da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:08.791431 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cface8-8dae-470d-b527-61defa4d12da None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:08.802882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 623/1238] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:08.809434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c46b0-56f4-4593-937b-b6bda65a39e0 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:08.917604 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c46b0-56f4-4593-937b-b6bda65a39e0 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:08.950716 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b810de-26ac-48b9-8efa-53a58e9421d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:08.951520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b810de-26ac-48b9-8efa-53a58e9421d2 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:08.951899 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b810de-26ac-48b9-8efa-53a58e9421d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:08.952133 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b810de-26ac-48b9-8efa-53a58e9421d2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:08.955207 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:08.961370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b810de-26ac-48b9-8efa-53a58e9421d2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:08.963066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b810de-26ac-48b9-8efa-53a58e9421d2 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:08.979103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-73b810de-26ac-48b9-8efa-53a58e9421d2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 13:43:08.979103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:08.979103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:08.979103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:08.979103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:08.979103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:08.979103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:08.979103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:08.979103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:08.979103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:08.979103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:08.979103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:08.979103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:43:08.979103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:43:08.979103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:43:08.979103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:43:08.980721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:08.980721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:08.980721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:43:08.980721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:43:08.980721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:43:08.980721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:43:08.980721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:08.980721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:08.980721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:08.980721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:08.980721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:08.980721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:43:08.980721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:08.980721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:08.980721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:08.980721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:08.980721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:08.980721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:08.981900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:08.981900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:08.981900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:43:08.981900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:43:08.981900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:43:08.981900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:43:08.981900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:43:08.981900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:43:08.981900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 13:43:08.981900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:43:08.981900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 616/1239] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:43:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:08.986838 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cface8-8dae-470d-b527-61defa4d12da None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:09.109901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cface8-8dae-470d-b527-61defa4d12da None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:09.150338 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e1fc6-178a-4ce1-96f9-cfb377a6890d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:09.151111 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e1fc6-178a-4ce1-96f9-cfb377a6890d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:09.151425 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e1fc6-178a-4ce1-96f9-cfb377a6890d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:09.151761 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e1fc6-178a-4ce1-96f9-cfb377a6890d None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:09.152771 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e1fc6-178a-4ce1-96f9-cfb377a6890d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:09.153105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e1fc6-178a-4ce1-96f9-cfb377a6890d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:09.154720 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e1fc6-178a-4ce1-96f9-cfb377a6890d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:09.175305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 624/1240] 10.222.0.45 () {56 vars in 1143 bytes} [Thu May 26 13:43:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:09.181297 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b810de-26ac-48b9-8efa-53a58e9421d2 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:09.294614 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b810de-26ac-48b9-8efa-53a58e9421d2 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:09.333830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50b63a-227d-4367-9a72-a26fd871e980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:09.334644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50b63a-227d-4367-9a72-a26fd871e980 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:09.334979 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50b63a-227d-4367-9a72-a26fd871e980 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:09.335974 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50b63a-227d-4367-9a72-a26fd871e980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:09.407851 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:09.415218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50b63a-227d-4367-9a72-a26fd871e980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:09.416692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50b63a-227d-4367-9a72-a26fd871e980 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:09.527999 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 617/1241] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:43:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 13:43:09.534970 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e1fc6-178a-4ce1-96f9-cfb377a6890d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:09.565545 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:09.649079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e1fc6-178a-4ce1-96f9-cfb377a6890d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:09.691532 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a79042-a0fe-41b0-8af4-fb8af74654ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:09.692545 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a79042-a0fe-41b0-8af4-fb8af74654ed None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:09.692938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a79042-a0fe-41b0-8af4-fb8af74654ed None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:09.693386 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a79042-a0fe-41b0-8af4-fb8af74654ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:09.704933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a79042-a0fe-41b0-8af4-fb8af74654ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:09.706504 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a79042-a0fe-41b0-8af4-fb8af74654ed None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:09.723429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-06a79042-a0fe-41b0-8af4-fb8af74654ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:09.723429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:09.723429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:09.723429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:09.723429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:09.723429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:09.723429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:09.723429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:09.723429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:09.723429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:09.723429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:09.723429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:09.723429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:43:09.723429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:43:09.723429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:43:09.724578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:43:09.724578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:09.724578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:09.724578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:09.724578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:09.724578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:09.724578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:09.724578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:09.724578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:43:09.724578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:09.724578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:09.724578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:09.724578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:09.724578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:09.724578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:09.724578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:09.724578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:09.725702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:43:09.725702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:43:09.725702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:09.725702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:09.725702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 625/1242] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:09.731018 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50b63a-227d-4367-9a72-a26fd871e980 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:09.836784 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:09.843704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50b63a-227d-4367-9a72-a26fd871e980 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:09.885095 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88320886-7dcf-4e9f-82ad-0b03248d2d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:09.885804 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88320886-7dcf-4e9f-82ad-0b03248d2d5e None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:09.886079 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88320886-7dcf-4e9f-82ad-0b03248d2d5e None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:09.886354 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88320886-7dcf-4e9f-82ad-0b03248d2d5e None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:09.887059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88320886-7dcf-4e9f-82ad-0b03248d2d5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:09.887362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88320886-7dcf-4e9f-82ad-0b03248d2d5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:09.888724 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88320886-7dcf-4e9f-82ad-0b03248d2d5e None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:09.901192 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 618/1243] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:43:09.906960 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a79042-a0fe-41b0-8af4-fb8af74654ed None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:09.988643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:10.013138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a79042-a0fe-41b0-8af4-fb8af74654ed None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:10.051673 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae085e4-1fa4-4cbb-afbf-9dc1a93aeaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:10.052621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae085e4-1fa4-4cbb-afbf-9dc1a93aeaf8 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:10.052853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae085e4-1fa4-4cbb-afbf-9dc1a93aeaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:10.053244 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae085e4-1fa4-4cbb-afbf-9dc1a93aeaf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:10.060103 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae085e4-1fa4-4cbb-afbf-9dc1a93aeaf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:10.061557 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae085e4-1fa4-4cbb-afbf-9dc1a93aeaf8 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:10.075580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-3ae085e4-1fa4-4cbb-afbf-9dc1a93aeaf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:43:10.075580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:10.075580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:10.075580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:10.075580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:10.075580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:10.075580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:10.075580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:10.075580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:10.075580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:10.075580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:10.075580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:10.075580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:43:10.075580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:43:10.075580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:43:10.076583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:43:10.076583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:10.076583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:10.076583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:10.076583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:10.076583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:10.076583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:10.076583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:10.076583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:43:10.076583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:10.076583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:10.076583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:10.076583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:10.076583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:10.076583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:10.076583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:10.076583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:10.077552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:43:10.077552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:43:10.077552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:43:10.077552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:43:10.077552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:43:10.077552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:43:10.077552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:43:10.077552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:10.077552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 626/1244] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:43:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:10.082934 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88320886-7dcf-4e9f-82ad-0b03248d2d5e None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:10.193364 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88320886-7dcf-4e9f-82ad-0b03248d2d5e None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:10.233509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbf05a-4d78-49e4-a29d-51a68ccbdfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:10.234254 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbf05a-4d78-49e4-a29d-51a68ccbdfdb None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:10.234591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbf05a-4d78-49e4-a29d-51a68ccbdfdb None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:10.234909 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbf05a-4d78-49e4-a29d-51a68ccbdfdb None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:10.235754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbf05a-4d78-49e4-a29d-51a68ccbdfdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:10.236113 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbf05a-4d78-49e4-a29d-51a68ccbdfdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:10.237614 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbf05a-4d78-49e4-a29d-51a68ccbdfdb None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:10.251347 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 619/1245] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:43:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:10.258975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae085e4-1fa4-4cbb-afbf-9dc1a93aeaf8 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:10.380167 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae085e4-1fa4-4cbb-afbf-9dc1a93aeaf8 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:10.414442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6245f70-fb22-46b5-bd51-206f481932ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:10.415113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6245f70-fb22-46b5-bd51-206f481932ea None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:10.415392 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6245f70-fb22-46b5-bd51-206f481932ea None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:10.415661 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6245f70-fb22-46b5-bd51-206f481932ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:10.416490 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6245f70-fb22-46b5-bd51-206f481932ea None admin] RBAC: Adding query filter params (role.id=0bb0d62bb4f84638888ceb6ecabda8b3, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=8b0db68b7fda4da29eb13689f3fd7b5f) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:10.416785 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6245f70-fb22-46b5-bd51-206f481932ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:10.418231 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6245f70-fb22-46b5-bd51-206f481932ea None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:10.424049 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 627/1246] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:43:10 2022] GET /identity/v3/role_assignments?user.id=8b0db68b7fda4da29eb13689f3fd7b5f&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=0bb0d62bb4f84638888ceb6ecabda8b3 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:12.718732 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24cdb0-de80-4de7-b60a-c99dceda9e94 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:12.719269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24cdb0-de80-4de7-b60a-c99dceda9e94 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:12.719269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24cdb0-de80-4de7-b60a-c99dceda9e94 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:12.720771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 620/1247] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:43:12.727377 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb27f5-8212-4540-aa81-a57c2348b55f None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:12.727817 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb27f5-8212-4540-aa81-a57c2348b55f None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:12.728171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb27f5-8212-4540-aa81-a57c2348b55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:12.734910 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:12.750903 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-b3cb27f5-8212-4540-aa81-a57c2348b55f None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:43:12.752738 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-b3cb27f5-8212-4540-aa81-a57c2348b55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:43:12.833690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 628/1248] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:43:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 13:43:12.858966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24cdb0-de80-4de7-b60a-c99dceda9e94 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:12.878261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:12.968903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24cdb0-de80-4de7-b60a-c99dceda9e94 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:13.005855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efb8ce-3a5e-466e-81dc-3bbbba3c5ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:13.006623 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efb8ce-3a5e-466e-81dc-3bbbba3c5ee5 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:13.006934 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efb8ce-3a5e-466e-81dc-3bbbba3c5ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:13.007201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efb8ce-3a5e-466e-81dc-3bbbba3c5ee5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:13.017551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efb8ce-3a5e-466e-81dc-3bbbba3c5ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:43:13.025759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-60efb8ce-3a5e-466e-81dc-3bbbba3c5ee5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:43:13.025759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:13.025759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:13.025759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:13.025759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:13.025759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:13.025759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:13.025759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:13.025759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:13.025759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:13.025759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:13.025759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:13.025759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:43:13.025759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:43:13.025759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:43:13.025759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:43:13.026771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:43:13.026771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:43:13.026771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:43:13.026771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:43:13.026771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:13.026771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:13.026771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:13.026771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:13.026771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:13.026771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:13.026771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:13.026771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:43:13.026771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:13.026771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:13.026771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:13.026771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:13.027628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:13.027628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:13.027628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:13.027628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:13.027628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:43:13.027628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:43:13.027628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:43:13.027628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:43:13.027628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:43:13.027628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:43:13.027628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:43:13.027628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:43:13.027628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 621/1249] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:43:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:13.033082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb27f5-8212-4540-aa81-a57c2348b55f None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:13.139299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb27f5-8212-4540-aa81-a57c2348b55f None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:13.173366 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:13.180360 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7416be-330e-4771-b8ee-121a88b708af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:13.181103 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7416be-330e-4771-b8ee-121a88b708af None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:13.181422 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7416be-330e-4771-b8ee-121a88b708af None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:13.181770 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7416be-330e-4771-b8ee-121a88b708af None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:13.182522 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7416be-330e-4771-b8ee-121a88b708af None admin] RBAC: Adding query filter params (name=admin) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:13.182955 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7416be-330e-4771-b8ee-121a88b708af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:13.184451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7416be-330e-4771-b8ee-121a88b708af None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:13.193401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 629/1250] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:43:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:13.199720 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efb8ce-3a5e-466e-81dc-3bbbba3c5ee5 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:13.281204 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:13.308749 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efb8ce-3a5e-466e-81dc-3bbbba3c5ee5 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:13.347964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7f242-afb0-4ca8-9a6b-9961b6a0c328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:13.348759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7f242-afb0-4ca8-9a6b-9961b6a0c328 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:13.349111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7f242-afb0-4ca8-9a6b-9961b6a0c328 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:13.349504 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7f242-afb0-4ca8-9a6b-9961b6a0c328 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:13.361292 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7f242-afb0-4ca8-9a6b-9961b6a0c328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:13.362758 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7f242-afb0-4ca8-9a6b-9961b6a0c328 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:13.380267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-bae7f242-afb0-4ca8-9a6b-9961b6a0c328 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:13.380267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:13.380267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:13.380267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:13.380267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:13.380267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:13.380267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:13.380267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:13.380267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:13.380267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:13.380267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:13.380267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:13.380267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:43:13.380267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:43:13.380267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:43:13.381489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:43:13.381489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:13.381489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:13.381489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:13.381489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:13.381489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:13.381489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:13.381489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:13.381489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:43:13.381489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:13.381489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:13.381489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:13.381489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:13.381489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:13.381489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:13.381489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:13.381489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:13.382854 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:43:13.382854 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:43:13.382854 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:13.382854 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:43:13.382854 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 622/1251] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:13.387549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7416be-330e-4771-b8ee-121a88b708af None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:13.497367 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7416be-330e-4771-b8ee-121a88b708af None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:13.535423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb47df2-3562-4bb0-b233-219db40ac348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:13.536285 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb47df2-3562-4bb0-b233-219db40ac348 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:13.536640 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb47df2-3562-4bb0-b233-219db40ac348 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:13.537148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb47df2-3562-4bb0-b233-219db40ac348 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:13.538030 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb47df2-3562-4bb0-b233-219db40ac348 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:13.538911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb47df2-3562-4bb0-b233-219db40ac348 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:13.540672 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb47df2-3562-4bb0-b233-219db40ac348 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:13.553515 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 630/1252] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:43:13.559503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7f242-afb0-4ca8-9a6b-9961b6a0c328 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:13.668179 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7f242-afb0-4ca8-9a6b-9961b6a0c328 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:13.696213 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:13.704736 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca5200-df63-46db-8cbf-7267678e86aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:13.705591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca5200-df63-46db-8cbf-7267678e86aa None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:13.705873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca5200-df63-46db-8cbf-7267678e86aa None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:13.706147 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca5200-df63-46db-8cbf-7267678e86aa None admin] PATH_INFO: `/v3/users/placement` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:13.715345 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca5200-df63-46db-8cbf-7267678e86aa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:13.716819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca5200-df63-46db-8cbf-7267678e86aa None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:13.732835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-56ca5200-df63-46db-8cbf-7267678e86aa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 13:43:13.732835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:13.732835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:13.732835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:13.732835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:13.732835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:13.732835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:13.732835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:13.732835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:13.732835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:13.732835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:13.732835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:13.732835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:43:13.732835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:43:13.732835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:43:13.732835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:43:13.734568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:13.734568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:13.734568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:43:13.734568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:43:13.734568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:43:13.734568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:43:13.734568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:13.734568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:13.734568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:13.734568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:13.734568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:13.734568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:43:13.734568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:13.734568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:13.734568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:13.734568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:13.734568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:13.734568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:13.735552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:13.735552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:13.735552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:43:13.735552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:43:13.735552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:43:13.735552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:43:13.735552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:43:13.735552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:43:13.735552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 13:43:13.735552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:43:13.735552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 623/1253] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:43:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:13.740425 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb47df2-3562-4bb0-b233-219db40ac348 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:13.799455 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:13.844744 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb47df2-3562-4bb0-b233-219db40ac348 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:13.889171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d50d7-b678-4a94-9ad7-763177eae77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:13.889877 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d50d7-b678-4a94-9ad7-763177eae77c None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:13.890160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d50d7-b678-4a94-9ad7-763177eae77c None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:13.890436 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d50d7-b678-4a94-9ad7-763177eae77c None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:13.891306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d50d7-b678-4a94-9ad7-763177eae77c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:13.891614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d50d7-b678-4a94-9ad7-763177eae77c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:13.893045 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d50d7-b678-4a94-9ad7-763177eae77c None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:13.912128 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 631/1254] 10.222.0.45 () {56 vars in 1143 bytes} [Thu May 26 13:43:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:13.917992 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca5200-df63-46db-8cbf-7267678e86aa None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:14.020407 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca5200-df63-46db-8cbf-7267678e86aa None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:14.054632 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358a72c-a51e-499a-a569-66d3ecaab805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:14.055210 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358a72c-a51e-499a-a569-66d3ecaab805 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:14.055489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358a72c-a51e-499a-a569-66d3ecaab805 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:14.055758 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358a72c-a51e-499a-a569-66d3ecaab805 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:14.112167 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:14.124960 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358a72c-a51e-499a-a569-66d3ecaab805 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:14.126458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358a72c-a51e-499a-a569-66d3ecaab805 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:14.226303 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 624/1255] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:43:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 13:43:14.232178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d50d7-b678-4a94-9ad7-763177eae77c None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:14.334052 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d50d7-b678-4a94-9ad7-763177eae77c None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:14.347176 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:14.368033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac3532-7c0e-47b7-9ed4-dd642a646874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:14.368815 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac3532-7c0e-47b7-9ed4-dd642a646874 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:14.369099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac3532-7c0e-47b7-9ed4-dd642a646874 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:14.369405 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac3532-7c0e-47b7-9ed4-dd642a646874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:14.379161 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac3532-7c0e-47b7-9ed4-dd642a646874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:14.380586 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac3532-7c0e-47b7-9ed4-dd642a646874 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:14.398718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-4aac3532-7c0e-47b7-9ed4-dd642a646874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:14.398718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:14.398718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:14.398718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:14.398718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:14.398718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:14.398718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:14.398718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:14.398718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:14.398718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:14.398718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:14.398718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:14.398718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:43:14.398718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:43:14.398718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:43:14.400387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:43:14.400387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:14.400387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:14.400387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:14.400387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:14.400387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:14.400387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:14.400387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:14.400387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:43:14.400387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:14.400387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:14.400387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:14.400387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:14.400387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:14.400387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:14.400387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:14.400387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:14.401579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:43:14.401579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:43:14.401579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:14.401579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:14.401579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 632/1256] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:14.407688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358a72c-a51e-499a-a569-66d3ecaab805 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:14.499364 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:14.511878 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358a72c-a51e-499a-a569-66d3ecaab805 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:14.545239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da400c4e-498f-4565-8c06-99683b55cbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:14.545918 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da400c4e-498f-4565-8c06-99683b55cbd6 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:14.546199 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da400c4e-498f-4565-8c06-99683b55cbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:14.546478 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da400c4e-498f-4565-8c06-99683b55cbd6 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:14.547184 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da400c4e-498f-4565-8c06-99683b55cbd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:14.547492 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da400c4e-498f-4565-8c06-99683b55cbd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:14.548849 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da400c4e-498f-4565-8c06-99683b55cbd6 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:14.559717 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 625/1257] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:14.565341 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac3532-7c0e-47b7-9ed4-dd642a646874 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:14.660332 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac3532-7c0e-47b7-9ed4-dd642a646874 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:14.693798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0064e8-3239-4301-b56d-1646c82d9a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:14.694650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0064e8-3239-4301-b56d-1646c82d9a49 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:14.694928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0064e8-3239-4301-b56d-1646c82d9a49 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:14.695202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0064e8-3239-4301-b56d-1646c82d9a49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:14.701639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0064e8-3239-4301-b56d-1646c82d9a49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:14.703069 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0064e8-3239-4301-b56d-1646c82d9a49 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:14.716372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-9b0064e8-3239-4301-b56d-1646c82d9a49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:43:14.716372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:14.716372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:14.716372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:14.716372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:14.716372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:14.716372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:14.716372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:14.716372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:14.716372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:14.716372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:14.716372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:14.716372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:43:14.716372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:43:14.716372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:43:14.717498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:43:14.717498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:14.717498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:14.717498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:14.717498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:14.717498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:14.717498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:14.717498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:14.717498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:43:14.717498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:14.717498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:14.717498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:14.717498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:14.717498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:14.717498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:14.717498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:14.717498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:14.718795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:43:14.718795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:43:14.718795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:43:14.718795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:43:14.718795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:43:14.718795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:43:14.718795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:43:14.718795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:14.718795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 633/1258] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:43:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:14.723255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da400c4e-498f-4565-8c06-99683b55cbd6 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:14.820268 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da400c4e-498f-4565-8c06-99683b55cbd6 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:14.852363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34353fa-c817-4fa9-9e38-a79a8966ff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:14.853003 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34353fa-c817-4fa9-9e38-a79a8966ff35 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:14.853307 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34353fa-c817-4fa9-9e38-a79a8966ff35 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:14.853582 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34353fa-c817-4fa9-9e38-a79a8966ff35 None admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:14.854354 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34353fa-c817-4fa9-9e38-a79a8966ff35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:14.854658 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34353fa-c817-4fa9-9e38-a79a8966ff35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:14.856079 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34353fa-c817-4fa9-9e38-a79a8966ff35 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:14.868103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 626/1259] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:43:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:14.874433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0064e8-3239-4301-b56d-1646c82d9a49 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:14.899426 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:14.971282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0064e8-3239-4301-b56d-1646c82d9a49 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:15.003740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdce4b-89be-4e10-9f16-d2b6ff4bff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:15.004385 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdce4b-89be-4e10-9f16-d2b6ff4bff61 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:15.004665 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdce4b-89be-4e10-9f16-d2b6ff4bff61 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:15.004943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdce4b-89be-4e10-9f16-d2b6ff4bff61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:15.005789 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdce4b-89be-4e10-9f16-d2b6ff4bff61 None admin] RBAC: Adding query filter params (role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=8b0db68b7fda4da29eb13689f3fd7b5f) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:15.006103 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdce4b-89be-4e10-9f16-d2b6ff4bff61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:15.007536 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdce4b-89be-4e10-9f16-d2b6ff4bff61 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:15.012865 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 634/1260] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:43:14 2022] GET /identity/v3/role_assignments?user.id=8b0db68b7fda4da29eb13689f3fd7b5f&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:17.164903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2e9e3-2ddc-48a5-ae71-5246a0c2e46e None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:17.165477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2e9e3-2ddc-48a5-ae71-5246a0c2e46e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:17.165477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2e9e3-2ddc-48a5-ae71-5246a0c2e46e None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:17.166825 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 627/1261] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:43:17.171997 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2ac9e-625a-46fc-82e3-13ec4a88fedb None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:17.172420 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2ac9e-625a-46fc-82e3-13ec4a88fedb None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:17.172559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2ac9e-625a-46fc-82e3-13ec4a88fedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:17.189402 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-2aa2ac9e-625a-46fc-82e3-13ec4a88fedb None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:43:17.190592 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-2aa2ac9e-625a-46fc-82e3-13ec4a88fedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:43:17.254068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 635/1262] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:43:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:43:17.276334 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2e9e3-2ddc-48a5-ae71-5246a0c2e46e None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:17.286890 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:17.373696 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2e9e3-2ddc-48a5-ae71-5246a0c2e46e None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:17.406270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc875491-da52-49c4-bc90-dfb9b4b43669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:17.407037 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc875491-da52-49c4-bc90-dfb9b4b43669 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:17.407319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc875491-da52-49c4-bc90-dfb9b4b43669 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:17.407592 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc875491-da52-49c4-bc90-dfb9b4b43669 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:17.417420 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc875491-da52-49c4-bc90-dfb9b4b43669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:43:17.424915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-dc875491-da52-49c4-bc90-dfb9b4b43669 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:43:17.424915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:17.424915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:17.424915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:17.424915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:17.424915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:17.424915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:17.424915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:17.424915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:17.424915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:17.424915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:17.424915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:17.424915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:43:17.424915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:43:17.424915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:43:17.424915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:43:17.426101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:43:17.426101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:43:17.426101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:43:17.426101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:43:17.426101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:17.426101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:17.426101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:17.426101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:17.426101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:17.426101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:17.426101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:17.426101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:43:17.426101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:17.426101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:17.426101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:17.426101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:17.427363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:17.427363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:17.427363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:17.427363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:17.427363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:43:17.427363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:43:17.427363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:43:17.427363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:43:17.427363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:43:17.427363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:43:17.427363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:43:17.427363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:43:17.427363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 628/1263] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:43:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:17.432534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2ac9e-625a-46fc-82e3-13ec4a88fedb None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:17.452465 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:17.544581 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2ac9e-625a-46fc-82e3-13ec4a88fedb None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:17.576798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76424ab-9f95-4bfc-a243-bc4cbb174902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:17.577473 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76424ab-9f95-4bfc-a243-bc4cbb174902 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:17.577753 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76424ab-9f95-4bfc-a243-bc4cbb174902 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:17.578024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76424ab-9f95-4bfc-a243-bc4cbb174902 None admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:17.578751 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76424ab-9f95-4bfc-a243-bc4cbb174902 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:17.579053 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76424ab-9f95-4bfc-a243-bc4cbb174902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:17.580388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76424ab-9f95-4bfc-a243-bc4cbb174902 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:17.588073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 636/1264] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:43:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:17.594058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc875491-da52-49c4-bc90-dfb9b4b43669 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:17.658576 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:17.692117 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc875491-da52-49c4-bc90-dfb9b4b43669 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:17.724076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf4f07-8d70-41b9-89ce-05bd844f28e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:17.724857 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf4f07-8d70-41b9-89ce-05bd844f28e2 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:17.725142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf4f07-8d70-41b9-89ce-05bd844f28e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:17.725952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf4f07-8d70-41b9-89ce-05bd844f28e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:17.736157 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf4f07-8d70-41b9-89ce-05bd844f28e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:17.737626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf4f07-8d70-41b9-89ce-05bd844f28e2 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:17.754938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-d5cf4f07-8d70-41b9-89ce-05bd844f28e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:17.754938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:17.754938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:17.754938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:17.754938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:17.754938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:17.754938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:17.754938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:17.754938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:17.754938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:17.754938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:17.754938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:17.754938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:43:17.754938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:43:17.754938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:43:17.755966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:43:17.755966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:17.755966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:17.755966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:17.755966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:17.755966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:17.755966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:17.755966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:17.755966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:43:17.755966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:17.755966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:17.755966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:17.755966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:17.755966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:17.755966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:17.755966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:17.755966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:17.757045 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:43:17.757045 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:43:17.757045 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:17.757045 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:43:17.757045 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 629/1265] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:17.761956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76424ab-9f95-4bfc-a243-bc4cbb174902 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:17.843988 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:17.863286 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76424ab-9f95-4bfc-a243-bc4cbb174902 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:17.895326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0ae17-2087-40ab-8aa8-0b96f22dd59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:17.895971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0ae17-2087-40ab-8aa8-0b96f22dd59e None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:17.896249 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0ae17-2087-40ab-8aa8-0b96f22dd59e None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:17.896522 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0ae17-2087-40ab-8aa8-0b96f22dd59e None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:17.897230 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0ae17-2087-40ab-8aa8-0b96f22dd59e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:17.897561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0ae17-2087-40ab-8aa8-0b96f22dd59e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:17.898898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0ae17-2087-40ab-8aa8-0b96f22dd59e None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:17.910041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 637/1266] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:17.916115 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf4f07-8d70-41b9-89ce-05bd844f28e2 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:18.012589 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf4f07-8d70-41b9-89ce-05bd844f28e2 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:18.031697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:18.045299 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b27df-a0cd-4e6d-8fe1-96764aa68474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:18.046083 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b27df-a0cd-4e6d-8fe1-96764aa68474 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:18.046366 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b27df-a0cd-4e6d-8fe1-96764aa68474 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:18.046640 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b27df-a0cd-4e6d-8fe1-96764aa68474 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:18.054407 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b27df-a0cd-4e6d-8fe1-96764aa68474 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:18.055838 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b27df-a0cd-4e6d-8fe1-96764aa68474 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:18.069858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-338b27df-a0cd-4e6d-8fe1-96764aa68474 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 13:43:18.069858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:18.069858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:18.069858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:18.069858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:18.069858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:18.069858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:18.069858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:18.069858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:18.069858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:18.069858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:18.069858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:18.069858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:43:18.069858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:43:18.069858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:43:18.069858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:43:18.070965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:18.070965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:18.070965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:43:18.070965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:43:18.070965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:43:18.070965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:43:18.070965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:18.070965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:18.070965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:18.070965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:18.070965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:18.070965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:43:18.070965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:18.070965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:18.070965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:18.070965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:18.070965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:18.070965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:18.072170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:18.072170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:18.072170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:43:18.072170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:43:18.072170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:43:18.072170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:43:18.072170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:43:18.072170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:43:18.072170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 13:43:18.072170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:43:18.072170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 630/1267] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:43:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:18.078666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0ae17-2087-40ab-8aa8-0b96f22dd59e None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:18.176328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0ae17-2087-40ab-8aa8-0b96f22dd59e None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:18.207972 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ec55c-2c26-4a4e-8b32-466626d8236d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:18.208618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ec55c-2c26-4a4e-8b32-466626d8236d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:18.208893 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ec55c-2c26-4a4e-8b32-466626d8236d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:18.209165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ec55c-2c26-4a4e-8b32-466626d8236d None admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:18.210546 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ec55c-2c26-4a4e-8b32-466626d8236d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:18.210848 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ec55c-2c26-4a4e-8b32-466626d8236d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:18.212288 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ec55c-2c26-4a4e-8b32-466626d8236d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:18.221253 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:18.231509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 638/1268] 10.222.0.45 () {56 vars in 1143 bytes} [Thu May 26 13:43:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:18.236966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b27df-a0cd-4e6d-8fe1-96764aa68474 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:18.336409 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b27df-a0cd-4e6d-8fe1-96764aa68474 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:18.368499 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279c461-76d5-40d0-92d7-2570bf449571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:18.369296 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279c461-76d5-40d0-92d7-2570bf449571 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:18.369585 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279c461-76d5-40d0-92d7-2570bf449571 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:18.369861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279c461-76d5-40d0-92d7-2570bf449571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:18.380259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279c461-76d5-40d0-92d7-2570bf449571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:18.382290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279c461-76d5-40d0-92d7-2570bf449571 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:18.403016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-d279c461-76d5-40d0-92d7-2570bf449571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:18.403016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:18.403016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:18.403016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:18.403016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:18.403016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:18.403016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:18.403016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:18.403016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:18.403016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:18.403016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:18.403016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:18.403016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:43:18.403016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:43:18.403016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:43:18.404061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:43:18.404061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:18.404061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:18.404061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:18.404061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:18.404061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:18.404061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:18.404061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:18.404061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:43:18.404061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:18.404061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:18.404061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:18.404061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:18.404061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:18.404061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:18.404061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:18.404061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:18.405177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:43:18.405177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:43:18.405177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:18.405177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:43:18.405177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 631/1269] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:18.410021 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ec55c-2c26-4a4e-8b32-466626d8236d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:18.513223 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ec55c-2c26-4a4e-8b32-466626d8236d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:18.545980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9e1b2-869c-4b24-95da-e106f3967de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:18.546625 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9e1b2-869c-4b24-95da-e106f3967de7 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:18.546901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9e1b2-869c-4b24-95da-e106f3967de7 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:18.547169 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9e1b2-869c-4b24-95da-e106f3967de7 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:18.547871 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9e1b2-869c-4b24-95da-e106f3967de7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:18.548169 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9e1b2-869c-4b24-95da-e106f3967de7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:18.549518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9e1b2-869c-4b24-95da-e106f3967de7 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:18.560152 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 639/1270] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:18.565899 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279c461-76d5-40d0-92d7-2570bf449571 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:18.597445 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:18.663580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279c461-76d5-40d0-92d7-2570bf449571 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:18.696477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf6e26-42d6-4d27-88e9-d0d2d729849f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:18.697258 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf6e26-42d6-4d27-88e9-d0d2d729849f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:18.697565 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf6e26-42d6-4d27-88e9-d0d2d729849f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:18.697838 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf6e26-42d6-4d27-88e9-d0d2d729849f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:18.704274 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf6e26-42d6-4d27-88e9-d0d2d729849f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:18.705752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf6e26-42d6-4d27-88e9-d0d2d729849f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:18.719483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-6edf6e26-42d6-4d27-88e9-d0d2d729849f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:43:18.719483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:18.719483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:18.719483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:18.719483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:18.719483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:18.719483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:18.719483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:18.719483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:18.719483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:18.719483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:18.719483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:18.719483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:43:18.719483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:43:18.719483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:43:18.720539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:43:18.720539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:18.720539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:18.720539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:18.720539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:18.720539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:18.720539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:18.720539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:18.720539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:43:18.720539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:18.720539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:18.720539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:18.720539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:18.720539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:18.720539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:18.720539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:18.720539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:18.721774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:43:18.721774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:43:18.721774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:43:18.721774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:43:18.721774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:43:18.721774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:43:18.721774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:43:18.721774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:43:18.721774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 632/1271] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:43:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:18.726483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9e1b2-869c-4b24-95da-e106f3967de7 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:18.782627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:18.822850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9e1b2-869c-4b24-95da-e106f3967de7 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:18.854426 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd05013-17d4-4417-847b-3f4e8221e5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:18.855014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd05013-17d4-4417-847b-3f4e8221e5d9 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:18.855294 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd05013-17d4-4417-847b-3f4e8221e5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:18.855568 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd05013-17d4-4417-847b-3f4e8221e5d9 None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:18.856339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd05013-17d4-4417-847b-3f4e8221e5d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:18.856646 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd05013-17d4-4417-847b-3f4e8221e5d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:18.858082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd05013-17d4-4417-847b-3f4e8221e5d9 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:18.870036 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 640/1272] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:43:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:18.875839 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf6e26-42d6-4d27-88e9-d0d2d729849f None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:18.963861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:18.972498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf6e26-42d6-4d27-88e9-d0d2d729849f None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:19.005181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8628163-e11f-48b1-a745-8c935e992494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:19.006071 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8628163-e11f-48b1-a745-8c935e992494 None admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:19.006378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8628163-e11f-48b1-a745-8c935e992494 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:19.006664 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8628163-e11f-48b1-a745-8c935e992494 None admin] PATH_INFO: `/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/8b0db68b7fda4da29eb13689f3fd7b5f/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:19.008551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8628163-e11f-48b1-a745-8c935e992494 None admin] RBAC: Authorizing `identity:create_grant(project_id=095d02b8a79c4915ac8d3c5b81e195a4, user_id=8b0db68b7fda4da29eb13689f3fd7b5f, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:19.009995 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8628163-e11f-48b1-a745-8c935e992494 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:19.021723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 633/1273] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 13:43:18 2022] PUT /identity/v3/projects/095d02b8a79c4915ac8d3c5b81e195a4/users/8b0db68b7fda4da29eb13689f3fd7b5f/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:43:21.209414 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2684ff-24c5-4f35-a2d4-827972a8a7b1 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:21.209939 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2684ff-24c5-4f35-a2d4-827972a8a7b1 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:21.209939 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2684ff-24c5-4f35-a2d4-827972a8a7b1 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:21.211334 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 641/1274] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:43:21.216697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6fdee-1fde-4d0b-9695-e6f7c5cc5d48 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:21.217106 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6fdee-1fde-4d0b-9695-e6f7c5cc5d48 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:21.217252 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6fdee-1fde-4d0b-9695-e6f7c5cc5d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:21.233517 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-1ae6fdee-1fde-4d0b-9695-e6f7c5cc5d48 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:43:21.234695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1ae6fdee-1fde-4d0b-9695-e6f7c5cc5d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:43:21.298910 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 634/1275] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:43:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:43:21.323668 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2684ff-24c5-4f35-a2d4-827972a8a7b1 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:21.421964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2684ff-24c5-4f35-a2d4-827972a8a7b1 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:21.440342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:21.461624 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8846c6b-4ae8-477c-a712-1e84dddd92fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:21.462349 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8846c6b-4ae8-477c-a712-1e84dddd92fc None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:21.462632 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8846c6b-4ae8-477c-a712-1e84dddd92fc None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:21.462909 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8846c6b-4ae8-477c-a712-1e84dddd92fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:21.476965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8846c6b-4ae8-477c-a712-1e84dddd92fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 13:43:21.487346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-b8846c6b-4ae8-477c-a712-1e84dddd92fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:43:21.487346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:21.487346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:21.487346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:21.487346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:21.487346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:21.487346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:21.487346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:21.487346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:21.487346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:21.487346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:21.487346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:21.487346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 13:43:21.487346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 13:43:21.487346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 13:43:21.487346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 13:43:21.488543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 13:43:21.488543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 13:43:21.488543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 13:43:21.488543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 13:43:21.488543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:21.488543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:21.488543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:21.488543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:21.488543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:21.488543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:21.488543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:21.488543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:43:21.488543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:21.488543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:21.488543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:21.488543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:21.489600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:21.489600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:21.489600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:21.489600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:21.489600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 13:43:21.489600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 13:43:21.489600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 13:43:21.489600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 13:43:21.489600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 13:43:21.489600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 13:43:21.489600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 13:43:21.489600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:21.489600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 642/1276] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 13:43:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:21.497090 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6fdee-1fde-4d0b-9695-e6f7c5cc5d48 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:21.577631 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:21.595667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6fdee-1fde-4d0b-9695-e6f7c5cc5d48 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:21.629215 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c06ac-2599-4d78-9e47-55617aa13c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:21.629897 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c06ac-2599-4d78-9e47-55617aa13c0a None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:21.630176 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c06ac-2599-4d78-9e47-55617aa13c0a None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:21.630450 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c06ac-2599-4d78-9e47-55617aa13c0a None admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:21.631359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c06ac-2599-4d78-9e47-55617aa13c0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:21.631664 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c06ac-2599-4d78-9e47-55617aa13c0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:21.633017 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c06ac-2599-4d78-9e47-55617aa13c0a None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:21.640739 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 635/1277] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 13:43:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:21.646442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8846c6b-4ae8-477c-a712-1e84dddd92fc None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:21.743845 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8846c6b-4ae8-477c-a712-1e84dddd92fc None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:21.776141 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7553e03-2bc3-458b-ba57-baa010682f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:21.776909 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7553e03-2bc3-458b-ba57-baa010682f63 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:21.777193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7553e03-2bc3-458b-ba57-baa010682f63 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:21.777490 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7553e03-2bc3-458b-ba57-baa010682f63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:21.788304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7553e03-2bc3-458b-ba57-baa010682f63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:21.790289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7553e03-2bc3-458b-ba57-baa010682f63 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:21.806727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-d7553e03-2bc3-458b-ba57-baa010682f63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:21.806727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:21.806727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:21.806727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:21.806727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:21.806727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:21.806727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:21.806727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:21.806727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:21.806727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:21.806727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:21.806727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:21.806727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:43:21.806727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:43:21.806727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:43:21.807812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:43:21.807812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:21.807812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:21.807812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:21.807812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:21.807812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:21.807812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:21.807812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:21.807812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:43:21.807812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:21.807812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:21.807812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:21.807812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:21.807812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:21.807812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:21.807812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:21.807812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:21.809135 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:43:21.809135 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:43:21.809135 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:21.809135 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:21.809135 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 643/1278] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:21.813589 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c06ac-2599-4d78-9e47-55617aa13c0a None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:21.911211 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c06ac-2599-4d78-9e47-55617aa13c0a None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:21.943084 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5033687-915f-4c3f-940b-6ba0cff9b851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:21.943730 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5033687-915f-4c3f-940b-6ba0cff9b851 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:21.944010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5033687-915f-4c3f-940b-6ba0cff9b851 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:21.944284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5033687-915f-4c3f-940b-6ba0cff9b851 None admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:21.944987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5033687-915f-4c3f-940b-6ba0cff9b851 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:21.945338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5033687-915f-4c3f-940b-6ba0cff9b851 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:21.946712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5033687-915f-4c3f-940b-6ba0cff9b851 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:21.957930 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 636/1279] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:21.963906 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7553e03-2bc3-458b-ba57-baa010682f63 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:21.993919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:22.060248 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7553e03-2bc3-458b-ba57-baa010682f63 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:22.092484 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0298ad-302e-4321-98a2-a75ef5f619e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:22.093259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0298ad-302e-4321-98a2-a75ef5f619e1 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:22.093566 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0298ad-302e-4321-98a2-a75ef5f619e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:22.093840 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0298ad-302e-4321-98a2-a75ef5f619e1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:22.100899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0298ad-302e-4321-98a2-a75ef5f619e1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:22.102364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0298ad-302e-4321-98a2-a75ef5f619e1 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:22.116151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-fa0298ad-302e-4321-98a2-a75ef5f619e1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 13:43:22.116151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:22.116151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:22.116151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:22.116151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:22.116151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:22.116151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:22.116151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:22.116151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:22.116151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:22.116151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:22.116151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:22.116151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 13:43:22.116151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 13:43:22.116151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 13:43:22.116151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 13:43:22.117078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:22.117078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:22.117078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 13:43:22.117078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:43:22.117078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 13:43:22.117078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 13:43:22.117078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:22.117078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:22.117078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:22.117078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:22.117078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:22.117078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:43:22.117078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:22.117078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:22.117078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:22.117078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:22.117078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:22.117078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:22.118115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:22.118115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:22.118115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 13:43:22.118115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 13:43:22.118115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 13:43:22.118115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 13:43:22.118115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 13:43:22.118115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 13:43:22.118115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 13:43:22.118115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:22.118115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 644/1280] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:43:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:22.123126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5033687-915f-4c3f-940b-6ba0cff9b851 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:22.127092 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:22.219916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5033687-915f-4c3f-940b-6ba0cff9b851 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:22.252279 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f072488-2b70-4eb1-bc4d-ca86130a83cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:22.252871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f072488-2b70-4eb1-bc4d-ca86130a83cb None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:22.253156 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f072488-2b70-4eb1-bc4d-ca86130a83cb None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:22.253460 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f072488-2b70-4eb1-bc4d-ca86130a83cb None admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:22.254280 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f072488-2b70-4eb1-bc4d-ca86130a83cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:22.254593 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f072488-2b70-4eb1-bc4d-ca86130a83cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:22.256009 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f072488-2b70-4eb1-bc4d-ca86130a83cb None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:22.272810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 637/1281] 10.222.0.45 () {56 vars in 1143 bytes} [Thu May 26 13:43:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:22.278979 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0298ad-302e-4321-98a2-a75ef5f619e1 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:22.368438 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:22.378334 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0298ad-302e-4321-98a2-a75ef5f619e1 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:22.410958 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf4cdc-317f-4238-b45b-e1fabb382cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:22.411597 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf4cdc-317f-4238-b45b-e1fabb382cad None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:22.411898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf4cdc-317f-4238-b45b-e1fabb382cad None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:22.412152 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf4cdc-317f-4238-b45b-e1fabb382cad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:22.480876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf4cdc-317f-4238-b45b-e1fabb382cad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:22.482336 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf4cdc-317f-4238-b45b-e1fabb382cad None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:22.567055 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:22.578043 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 645/1282] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 13:43:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 13:43:22.583939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f072488-2b70-4eb1-bc4d-ca86130a83cb None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:22.644093 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:22.683835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f072488-2b70-4eb1-bc4d-ca86130a83cb None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:22.717196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbeca7-d17a-426e-b21f-268af3db5f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:22.717992 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbeca7-d17a-426e-b21f-268af3db5f10 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:22.718268 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbeca7-d17a-426e-b21f-268af3db5f10 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:22.718533 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbeca7-d17a-426e-b21f-268af3db5f10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:22.728703 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fbeca7-d17a-426e-b21f-268af3db5f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:22.730163 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fbeca7-d17a-426e-b21f-268af3db5f10 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:22.746911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-63fbeca7-d17a-426e-b21f-268af3db5f10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:22.746911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:22.746911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:22.746911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:22.746911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:22.746911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:22.746911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:22.746911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:22.746911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:22.746911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:22.746911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:22.746911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:22.746911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 13:43:22.746911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 13:43:22.746911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 13:43:22.747948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 13:43:22.747948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:22.747948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:22.747948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:22.747948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:22.747948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:22.747948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:22.747948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:22.747948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:43:22.747948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:22.747948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:22.747948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:22.747948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:22.747948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:22.747948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:22.747948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:22.747948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:22.749071 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 13:43:22.749071 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 13:43:22.749071 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 13:43:22.749071 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:43:22.749071 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 638/1283] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:22.754019 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf4cdc-317f-4238-b45b-e1fabb382cad None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:22.848078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf4cdc-317f-4238-b45b-e1fabb382cad None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:22.879609 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b51ac-45b9-42d2-88b9-031059e27586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:22.880243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b51ac-45b9-42d2-88b9-031059e27586 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:22.880521 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b51ac-45b9-42d2-88b9-031059e27586 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:22.880796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b51ac-45b9-42d2-88b9-031059e27586 None admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:22.881525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b51ac-45b9-42d2-88b9-031059e27586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:22.881834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b51ac-45b9-42d2-88b9-031059e27586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:22.883689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b51ac-45b9-42d2-88b9-031059e27586 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:22.894273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 646/1284] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 13:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:22.900397 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbeca7-d17a-426e-b21f-268af3db5f10 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:22.994758 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbeca7-d17a-426e-b21f-268af3db5f10 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:23.008987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:23.029552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d8939-e0f0-47de-81e0-4c406426e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:23.030401 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d8939-e0f0-47de-81e0-4c406426e57f None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:23.030680 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d8939-e0f0-47de-81e0-4c406426e57f None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:23.031030 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d8939-e0f0-47de-81e0-4c406426e57f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:23.037741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d8939-e0f0-47de-81e0-4c406426e57f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:23.039220 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d8939-e0f0-47de-81e0-4c406426e57f None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:23.052285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application [None req-3f5d8939-e0f0-47de-81e0-4c406426e57f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:43:23.052285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:23.052285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:23.052285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:23.052285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:23.052285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:23.052285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:23.052285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:23.052285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:23.052285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:23.052285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:23.052285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:23.052285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 13:43:23.052285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 13:43:23.052285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 13:43:23.053352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 13:43:23.053352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:23.053352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:23.053352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:23.053352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:23.053352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:23.053352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:23.053352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:23.053352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application with Lock( May 26 13:43:23.053352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:23.053352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:23.053352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:23.053352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:23.053352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:23.053352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:23.053352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:23.053352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:23.054367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 13:43:23.054367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 13:43:23.054367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 13:43:23.054367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 13:43:23.054367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 13:43:23.054367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 13:43:23.054367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 13:43:23.054367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: ERROR keystone.server.flask.application May 26 13:43:23.054367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 639/1285] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 13:43:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 13:43:23.059236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b51ac-45b9-42d2-88b9-031059e27586 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:23.107373 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:23.156515 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b51ac-45b9-42d2-88b9-031059e27586 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:23.188123 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d6f14-2c96-405b-8b79-e71cc808cdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:23.188759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d6f14-2c96-405b-8b79-e71cc808cdc6 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:23.189035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d6f14-2c96-405b-8b79-e71cc808cdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:23.189328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d6f14-2c96-405b-8b79-e71cc808cdc6 None admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:23.190093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d6f14-2c96-405b-8b79-e71cc808cdc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:23.190394 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d6f14-2c96-405b-8b79-e71cc808cdc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:23.191795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d6f14-2c96-405b-8b79-e71cc808cdc6 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:23.203725 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 647/1286] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 13:43:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:23.209936 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d8939-e0f0-47de-81e0-4c406426e57f None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:23.306834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d8939-e0f0-47de-81e0-4c406426e57f None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:23.338790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef59db-f4c5-4202-b863-83154acde398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:23.339422 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef59db-f4c5-4202-b863-83154acde398 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:23.339704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef59db-f4c5-4202-b863-83154acde398 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:23.339979 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef59db-f4c5-4202-b863-83154acde398 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:23.340794 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef59db-f4c5-4202-b863-83154acde398 None admin] RBAC: Adding query filter params (role.id=e6dbcc7e1ea84b1fa478cff5d02d0344, scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4, user.id=8b0db68b7fda4da29eb13689f3fd7b5f) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:23.341104 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef59db-f4c5-4202-b863-83154acde398 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:23.342555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef59db-f4c5-4202-b863-83154acde398 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:23.348127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 640/1287] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 13:43:23 2022] GET /identity/v3/role_assignments?user.id=8b0db68b7fda4da29eb13689f3fd7b5f&scope.project.id=095d02b8a79c4915ac8d3c5b81e195a4&role.id=e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:25.528341 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720aad8-48dc-4f80-acf1-abb702a06cc6 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:25.528902 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720aad8-48dc-4f80-acf1-abb702a06cc6 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:25.528902 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720aad8-48dc-4f80-acf1-abb702a06cc6 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:25.530281 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 648/1288] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:43:25.535535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ec037-fc39-4f2b-a76b-f3b6e136381a None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:25.535914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ec037-fc39-4f2b-a76b-f3b6e136381a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:25.536210 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ec037-fc39-4f2b-a76b-f3b6e136381a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:25.553947 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-377ec037-fc39-4f2b-a76b-f3b6e136381a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:43:25.555114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-377ec037-fc39-4f2b-a76b-f3b6e136381a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:43:25.582790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:25.619305 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 641/1289] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:43:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:43:25.641299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720aad8-48dc-4f80-acf1-abb702a06cc6 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:25.740045 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720aad8-48dc-4f80-acf1-abb702a06cc6 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:25.750176 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:25.773060 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654bbbe-7f7c-4e79-995b-01c522f7456d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:25.774357 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654bbbe-7f7c-4e79-995b-01c522f7456d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:25.774636 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654bbbe-7f7c-4e79-995b-01c522f7456d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:25.774909 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654bbbe-7f7c-4e79-995b-01c522f7456d None admin] PATH_INFO: `/v3/services/placement` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:25.775553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654bbbe-7f7c-4e79-995b-01c522f7456d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:25.776893 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654bbbe-7f7c-4e79-995b-01c522f7456d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:25.788448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-5654bbbe-7f7c-4e79-995b-01c522f7456d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 13:43:25.788448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:25.788448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:43:25.788448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:43:25.788448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:43:25.788448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:43:25.788448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:43:25.788448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:43:25.788448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 13:43:25.788448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:25.788448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:43:25.788448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:25.788448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:25.788448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:25.788448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:25.788448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:25.788448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:25.789736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:25.789736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:25.789736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:25.789736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:25.789736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:25.789736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:25.789736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:43:25.789736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:43:25.789736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:43:25.789736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:43:25.789736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:25.789736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:25.789736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:25.789736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:25.789736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:25.789736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:25.790868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:25.790868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:43:25.790868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:25.790868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:25.790868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:25.790868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:25.790868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:25.790868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:25.790868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:25.790868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:25.790868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:43:25.790868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:43:25.790868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 13:43:25.790868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:25.790868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 649/1290] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 13:43:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:25.795654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ec037-fc39-4f2b-a76b-f3b6e136381a None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:25.889647 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ec037-fc39-4f2b-a76b-f3b6e136381a None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:25.921644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e252f-019f-4b98-bf8f-ecb8c145c18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:25.922285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e252f-019f-4b98-bf8f-ecb8c145c18e None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:25.922562 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e252f-019f-4b98-bf8f-ecb8c145c18e None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:25.922834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e252f-019f-4b98-bf8f-ecb8c145c18e None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:25.923534 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e252f-019f-4b98-bf8f-ecb8c145c18e None admin] RBAC: Adding query filter params (name=placement) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:25.923816 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e252f-019f-4b98-bf8f-ecb8c145c18e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:25.925167 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e252f-019f-4b98-bf8f-ecb8c145c18e None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:25.929790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 642/1291] 10.222.0.45 () {56 vars in 1116 bytes} [Thu May 26 13:43:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:25.935265 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654bbbe-7f7c-4e79-995b-01c522f7456d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:26.035241 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654bbbe-7f7c-4e79-995b-01c522f7456d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:26.066398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e188e-e7ea-4023-83b0-e87d58726f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:26.066989 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e188e-e7ea-4023-83b0-e87d58726f90 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:26.067269 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e188e-e7ea-4023-83b0-e87d58726f90 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:26.067544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e188e-e7ea-4023-83b0-e87d58726f90 None admin] PATH_INFO: `/v3/services` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:26.068235 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e188e-e7ea-4023-83b0-e87d58726f90 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:26.068537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e188e-e7ea-4023-83b0-e87d58726f90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:26.070418 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e188e-e7ea-4023-83b0-e87d58726f90 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:26.074694 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 650/1292] 10.222.0.45 () {56 vars in 1116 bytes} [Thu May 26 13:43:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:28.240123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2467b0-1418-4cd8-85d8-855f48a0c799 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:28.240696 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2467b0-1418-4cd8-85d8-855f48a0c799 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:28.240696 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2467b0-1418-4cd8-85d8-855f48a0c799 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:28.242098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 643/1293] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:43:28.247174 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae843e1-929b-4a9c-bf4b-f7faad00c458 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:28.247547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae843e1-929b-4a9c-bf4b-f7faad00c458 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:28.247735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae843e1-929b-4a9c-bf4b-f7faad00c458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:28.264671 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-bae843e1-929b-4a9c-bf4b-f7faad00c458 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:43:28.265880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-bae843e1-929b-4a9c-bf4b-f7faad00c458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:43:28.294154 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:28.330532 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 651/1294] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:43:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:43:28.353753 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2467b0-1418-4cd8-85d8-855f48a0c799 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:28.384507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:28.458911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2467b0-1418-4cd8-85d8-855f48a0c799 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:28.499137 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc142c1b-71c4-43c1-b955-98f7640edb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:28.499897 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc142c1b-71c4-43c1-b955-98f7640edb22 None admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:28.500178 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc142c1b-71c4-43c1-b955-98f7640edb22 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:28.500499 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc142c1b-71c4-43c1-b955-98f7640edb22 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:28.501660 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc142c1b-71c4-43c1-b955-98f7640edb22 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:28.503248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc142c1b-71c4-43c1-b955-98f7640edb22 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:28.519081 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 644/1295] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 13:43:28 2022] POST /identity/v3/services => generated 246 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:43:30.715019 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c583d1-8f4e-47b0-9ef4-f7a01a80b86f None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:30.715471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c583d1-8f4e-47b0-9ef4-f7a01a80b86f None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:30.715581 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c583d1-8f4e-47b0-9ef4-f7a01a80b86f None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:30.716958 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 652/1296] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:43:30.722130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbd5ff-5157-4ae2-bbd1-8c5466bcb02b None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:30.722540 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbd5ff-5157-4ae2-bbd1-8c5466bcb02b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:30.722682 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbd5ff-5157-4ae2-bbd1-8c5466bcb02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:30.738865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-b3cbd5ff-5157-4ae2-bbd1-8c5466bcb02b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:43:30.740023 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-b3cbd5ff-5157-4ae2-bbd1-8c5466bcb02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:43:30.808905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 645/1297] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:43:30 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:43:30.831257 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c583d1-8f4e-47b0-9ef4-f7a01a80b86f None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:30.932252 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c583d1-8f4e-47b0-9ef4-f7a01a80b86f None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:30.972800 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3ca8e-8084-4fc6-97a7-92451a70700d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:30.973831 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3ca8e-8084-4fc6-97a7-92451a70700d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:30.974164 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3ca8e-8084-4fc6-97a7-92451a70700d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:30.974444 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3ca8e-8084-4fc6-97a7-92451a70700d None admin] PATH_INFO: `/v3/services/placement` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:30.975092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3ca8e-8084-4fc6-97a7-92451a70700d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:30.976444 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3ca8e-8084-4fc6-97a7-92451a70700d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:30.990584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-42a3ca8e-8084-4fc6-97a7-92451a70700d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 13:43:30.990584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:30.990584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:43:30.990584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:43:30.990584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:43:30.990584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:43:30.990584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:43:30.990584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:43:30.990584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 13:43:30.990584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:30.990584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:43:30.990584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:30.990584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:30.990584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:30.990584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:30.990584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:30.990584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:30.992308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:30.992308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:30.992308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:30.992308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:30.992308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:30.992308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:30.992308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:43:30.992308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:43:30.992308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:43:30.992308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:43:30.992308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:30.992308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:30.992308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:30.992308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:30.992308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:30.992308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:30.993456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:30.993456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:43:30.993456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:30.993456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:30.993456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:30.993456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:30.993456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:30.993456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:30.993456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:30.993456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:30.993456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:43:30.993456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:43:30.993456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 13:43:30.993456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:30.993456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 653/1298] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 13:43:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:30.998405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbd5ff-5157-4ae2-bbd1-8c5466bcb02b None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:31.017184 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:31.094793 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbd5ff-5157-4ae2-bbd1-8c5466bcb02b None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:31.128432 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8c0c5-8350-4d7f-9d21-b2d1cc975739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:31.129086 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8c0c5-8350-4d7f-9d21-b2d1cc975739 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:31.129402 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8c0c5-8350-4d7f-9d21-b2d1cc975739 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:31.129681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8c0c5-8350-4d7f-9d21-b2d1cc975739 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:31.130372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8c0c5-8350-4d7f-9d21-b2d1cc975739 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:31.130679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8c0c5-8350-4d7f-9d21-b2d1cc975739 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:31.132075 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8c0c5-8350-4d7f-9d21-b2d1cc975739 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:31.137071 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 646/1299] 10.222.0.45 () {56 vars in 1116 bytes} [Thu May 26 13:43:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:31.142903 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3ca8e-8084-4fc6-97a7-92451a70700d None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:31.173883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:31.240411 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3ca8e-8084-4fc6-97a7-92451a70700d None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:31.274252 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558ef08-2d50-4fc8-ac4b-50009ab2a13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:31.274890 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558ef08-2d50-4fc8-ac4b-50009ab2a13d None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:31.275170 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558ef08-2d50-4fc8-ac4b-50009ab2a13d None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:31.275444 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558ef08-2d50-4fc8-ac4b-50009ab2a13d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:31.276215 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558ef08-2d50-4fc8-ac4b-50009ab2a13d None admin] RBAC: Adding query filter params (interface=public, service_id=4b869285b933447a82dca2709a86f606, region_id=RegionOne) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:31.276527 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558ef08-2d50-4fc8-ac4b-50009ab2a13d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:31.277904 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558ef08-2d50-4fc8-ac4b-50009ab2a13d None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:31.282808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 654/1300] 10.222.0.45 () {56 vars in 1251 bytes} [Thu May 26 13:43:31 2022] GET /identity/v3/endpoints?service_id=4b869285b933447a82dca2709a86f606&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:43:31.288819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8c0c5-8350-4d7f-9d21-b2d1cc975739 None admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:31.367325 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:31.385153 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8c0c5-8350-4d7f-9d21-b2d1cc975739 None admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:31.418221 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09487f36-4087-494f-b1a8-c67a84082eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:31.418880 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09487f36-4087-494f-b1a8-c67a84082eb6 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:31.419166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09487f36-4087-494f-b1a8-c67a84082eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:31.419447 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09487f36-4087-494f-b1a8-c67a84082eb6 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:31.420118 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09487f36-4087-494f-b1a8-c67a84082eb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:31.421507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09487f36-4087-494f-b1a8-c67a84082eb6 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:31.428076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 647/1301] 10.222.0.45 () {56 vars in 1087 bytes} [Thu May 26 13:43:31 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:43:33.570524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4d79d-93df-488d-b300-e7c962dd1fb6 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:33.571056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4d79d-93df-488d-b300-e7c962dd1fb6 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:33.571056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4d79d-93df-488d-b300-e7c962dd1fb6 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:33.572429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 655/1302] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:43:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:43:33.577662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10065ae-1e3c-41ac-8886-0515accdd7d4 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:33.578077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10065ae-1e3c-41ac-8886-0515accdd7d4 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:33.578220 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10065ae-1e3c-41ac-8886-0515accdd7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:33.595736 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a10065ae-1e3c-41ac-8886-0515accdd7d4 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:43:33.596899 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a10065ae-1e3c-41ac-8886-0515accdd7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:43:33.660702 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 648/1303] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:43:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 13:43:33.684710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4d79d-93df-488d-b300-e7c962dd1fb6 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:33.776414 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:33.783443 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4d79d-93df-488d-b300-e7c962dd1fb6 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:33.815201 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564af9ce-5f62-4510-b524-ded74c41b495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:33.815975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564af9ce-5f62-4510-b524-ded74c41b495 None admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:33.816252 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564af9ce-5f62-4510-b524-ded74c41b495 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:33.816524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564af9ce-5f62-4510-b524-ded74c41b495 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:33.817157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564af9ce-5f62-4510-b524-ded74c41b495 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:33.818537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564af9ce-5f62-4510-b524-ded74c41b495 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:33.830639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application [None req-564af9ce-5f62-4510-b524-ded74c41b495 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 13:43:33.830639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:33.830639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 13:43:33.830639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 13:43:33.830639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 13:43:33.830639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 13:43:33.830639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 13:43:33.830639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:43:33.830639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 13:43:33.830639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:33.830639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 13:43:33.830639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:33.830639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 13:43:33.830639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 13:43:33.830639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 13:43:33.830639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 13:43:33.830639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 13:43:33.831795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 13:43:33.831795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 13:43:33.831795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 13:43:33.831795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 13:43:33.831795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 13:43:33.831795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 13:43:33.831795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 13:43:33.831795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 13:43:33.831795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 13:43:33.831795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 13:43:33.831795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 13:43:33.831795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 13:43:33.831795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 13:43:33.831795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 13:43:33.831795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 13:43:33.831795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.get_or_create( May 26 13:43:33.832827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 13:43:33.832827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application with Lock( May 26 13:43:33.832827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 13:43:33.832827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self._enter() May 26 13:43:33.832827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 13:43:33.832827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 13:43:33.832827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 13:43:33.832827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application return self.creator() May 26 13:43:33.832827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 13:43:33.832827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application created_value = creator( May 26 13:43:33.832827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 13:43:33.832827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 13:43:33.832827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 13:43:33.832827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: ERROR keystone.server.flask.application May 26 13:43:33.832827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 656/1304] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 13:43:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 13:43:33.837986 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10065ae-1e3c-41ac-8886-0515accdd7d4 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:33.909926 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:33.932428 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10065ae-1e3c-41ac-8886-0515accdd7d4 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:33.965426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b56a4-9614-4c43-af91-927b8983eac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:33.966072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b56a4-9614-4c43-af91-927b8983eac5 None admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:33.966353 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b56a4-9614-4c43-af91-927b8983eac5 None admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:33.966626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b56a4-9614-4c43-af91-927b8983eac5 None admin] PATH_INFO: `/v3/services` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:33.967311 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b56a4-9614-4c43-af91-927b8983eac5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:43:33.967706 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b56a4-9614-4c43-af91-927b8983eac5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:33.969066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b56a4-9614-4c43-af91-927b8983eac5 None admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:33.974077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 649/1305] 10.222.0.45 () {56 vars in 1116 bytes} [Thu May 26 13:43:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:43:33.980073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564af9ce-5f62-4510-b524-ded74c41b495 None admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:43:34.078832 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564af9ce-5f62-4510-b524-ded74c41b495 None admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:43:34.111379 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598bddd-1388-46b8-b015-e5d49ab28f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:43:34.111965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598bddd-1388-46b8-b015-e5d49ab28f14 None admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:43:34.112247 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598bddd-1388-46b8-b015-e5d49ab28f14 None admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:43:34.112523 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598bddd-1388-46b8-b015-e5d49ab28f14 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:43:34.113250 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598bddd-1388-46b8-b015-e5d49ab28f14 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:43:34.114619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598bddd-1388-46b8-b015-e5d49ab28f14 None admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:43:34.133239 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 657/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Thu May 26 13:43:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:43:43.971212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=30 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:43:44.129059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:37.428059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fcd49-21df-44c4-9fdf-ef878f3d8e7e None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:37.428591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fcd49-21df-44c4-9fdf-ef878f3d8e7e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:37.428591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fcd49-21df-44c4-9fdf-ef878f3d8e7e None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:37.434197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 650/1307] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:44:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:44:37.435278 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2a3ea-b9e5-4d62-9eaf-a7f59efbc9a0 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:37.435716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2a3ea-b9e5-4d62-9eaf-a7f59efbc9a0 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:37.435881 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2a3ea-b9e5-4d62-9eaf-a7f59efbc9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:37.520781 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-3fd2a3ea-b9e5-4d62-9eaf-a7f59efbc9a0 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:44:37.522026 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-3fd2a3ea-b9e5-4d62-9eaf-a7f59efbc9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:37.653984 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 658/1308] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:44:37.691734 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9771567-8435-4024-86bf-218da3bba5ab None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:37.692239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9771567-8435-4024-86bf-218da3bba5ab None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:37.692690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9771567-8435-4024-86bf-218da3bba5ab None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:37.696089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 651/1309] 10.222.0.45 () {54 vars in 964 bytes} [Thu May 26 13:44:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:44:37.703656 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4097ee-e46d-47ba-aa04-59a2ce083f05 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:37.704421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4097ee-e46d-47ba-aa04-59a2ce083f05 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:37.705083 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4097ee-e46d-47ba-aa04-59a2ce083f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:37.799012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-ad4097ee-e46d-47ba-aa04-59a2ce083f05 None None] MFA Rules not processed for user `45105360300a4cae802fdbda91b9d5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:44:37.800737 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ad4097ee-e46d-47ba-aa04-59a2ce083f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:37.821598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:37.888873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 659/1310] 10.222.0.45 () {58 vars in 1061 bytes} [Thu May 26 13:44:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:44:37.898551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9771567-8435-4024-86bf-218da3bba5ab None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:44:37.900253 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f9771567-8435-4024-86bf-218da3bba5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:38.015125 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9771567-8435-4024-86bf-218da3bba5ab None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:44:38.092842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8e715-bbc5-4c10-af38-48e11bfab0f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:44:38.093521 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8e715-bbc5-4c10-af38-48e11bfab0f0 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:38.093804 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8e715-bbc5-4c10-af38-48e11bfab0f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:38.094075 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8e715-bbc5-4c10-af38-48e11bfab0f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:38.095711 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-8bd8e715-bbc5-4c10-af38-48e11bfab0f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:38.154073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:38.211530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8e715-bbc5-4c10-af38-48e11bfab0f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:44:38.212985 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8e715-bbc5-4c10-af38-48e11bfab0f0 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:44:38.233112 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 652/1311] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:44:40.719467 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23206429-7837-4034-87de-6aa96e9bfce6 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:40.719914 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23206429-7837-4034-87de-6aa96e9bfce6 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:40.720271 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23206429-7837-4034-87de-6aa96e9bfce6 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:40.721600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 660/1312] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:44:40.727403 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e18098-05ac-40a2-ad83-15b94773c07a None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:40.727895 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e18098-05ac-40a2-ad83-15b94773c07a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:40.727895 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e18098-05ac-40a2-ad83-15b94773c07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:40.809524 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-18e18098-05ac-40a2-ad83-15b94773c07a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:44:40.810893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-18e18098-05ac-40a2-ad83-15b94773c07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:40.925105 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 653/1313] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:44:40.961978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23206429-7837-4034-87de-6aa96e9bfce6 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:44:40.963706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-23206429-7837-4034-87de-6aa96e9bfce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:41.072055 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23206429-7837-4034-87de-6aa96e9bfce6 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:44:41.145127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:41.148401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd84ed-04c1-4f5a-a72c-a940e082c6a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:44:41.149442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd84ed-04c1-4f5a-a72c-a940e082c6a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:41.150063 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd84ed-04c1-4f5a-a72c-a940e082c6a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:41.150534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd84ed-04c1-4f5a-a72c-a940e082c6a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:41.152442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-4ebd84ed-04c1-4f5a-a72c-a940e082c6a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:41.266343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd84ed-04c1-4f5a-a72c-a940e082c6a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:44:41.267843 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd84ed-04c1-4f5a-a72c-a940e082c6a5 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:44:41.290072 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 661/1314] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:44:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:44:43.823097 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5db67c-78b6-4fe0-8a01-44b907a358fd None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:43.823627 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5db67c-78b6-4fe0-8a01-44b907a358fd None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:43.823627 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5db67c-78b6-4fe0-8a01-44b907a358fd None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:43.824989 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 654/1315] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:44:43.830297 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f704265-3a1e-4b28-a3b3-725bdf99c72e None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:43.830724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f704265-3a1e-4b28-a3b3-725bdf99c72e None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:43.830861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f704265-3a1e-4b28-a3b3-725bdf99c72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:43.896797 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-2f704265-3a1e-4b28-a3b3-725bdf99c72e None None] MFA Rules not processed for user `a7511ee85d654a25b46c136f366541e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:44:43.898045 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-2f704265-3a1e-4b28-a3b3-725bdf99c72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:43.949193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:43.996920 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 662/1316] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:44:43 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:44:44.037067 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5db67c-78b6-4fe0-8a01-44b907a358fd None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:44:44.038611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-2f5db67c-78b6-4fe0-8a01-44b907a358fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:44.048112 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:44.139070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5db67c-78b6-4fe0-8a01-44b907a358fd None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:44:44.209137 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c6769-ed0d-45d0-93d3-c0dd0db9955a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:44:44.209729 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c6769-ed0d-45d0-93d3-c0dd0db9955a service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:44.210009 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c6769-ed0d-45d0-93d3-c0dd0db9955a service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:44.210282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c6769-ed0d-45d0-93d3-c0dd0db9955a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:44.211887 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c69c6769-ed0d-45d0-93d3-c0dd0db9955a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:44.271509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:44.317050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c6769-ed0d-45d0-93d3-c0dd0db9955a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:44:44.318511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c6769-ed0d-45d0-93d3-c0dd0db9955a service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:44:44.338547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 655/1317] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:44:44 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:44:47.055145 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4921f0-057a-4417-b780-1fed6b350806 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:47.055694 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4921f0-057a-4417-b780-1fed6b350806 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:47.055694 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4921f0-057a-4417-b780-1fed6b350806 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:47.057066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 663/1318] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:44:47.062310 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638398aa-4592-41b9-afca-5846a05f6af4 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:47.062742 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638398aa-4592-41b9-afca-5846a05f6af4 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:47.062848 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638398aa-4592-41b9-afca-5846a05f6af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:47.127455 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-638398aa-4592-41b9-afca-5846a05f6af4 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:44:47.128839 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-638398aa-4592-41b9-afca-5846a05f6af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:47.221639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 656/1319] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:44:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:44:47.259588 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4921f0-057a-4417-b780-1fed6b350806 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:44:47.261127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-2f4921f0-057a-4417-b780-1fed6b350806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:47.361741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4921f0-057a-4417-b780-1fed6b350806 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:44:47.431397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822918c6-654a-4058-8a94-9b85a4533452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:44:47.432034 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822918c6-654a-4058-8a94-9b85a4533452 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:47.432312 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822918c6-654a-4058-8a94-9b85a4533452 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:47.432587 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822918c6-654a-4058-8a94-9b85a4533452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:47.434214 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-822918c6-654a-4058-8a94-9b85a4533452 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:47.441361 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:47.540969 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822918c6-654a-4058-8a94-9b85a4533452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:44:47.542416 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822918c6-654a-4058-8a94-9b85a4533452 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:44:47.559761 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 664/1320] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:44:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:44:50.405629 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8182e-57b4-4455-9929-12b8cf7e9977 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:50.406169 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8182e-57b4-4455-9929-12b8cf7e9977 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:50.406169 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8182e-57b4-4455-9929-12b8cf7e9977 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:50.407548 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 657/1321] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:44:50.412986 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e2f74-bbc5-4f03-888c-5a86386f8e03 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:50.413445 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e2f74-bbc5-4f03-888c-5a86386f8e03 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:50.413593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e2f74-bbc5-4f03-888c-5a86386f8e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:50.477851 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-e28e2f74-bbc5-4f03-888c-5a86386f8e03 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:44:50.479055 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e28e2f74-bbc5-4f03-888c-5a86386f8e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:50.536100 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:50.574386 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 665/1322] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:44:50.610031 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8182e-57b4-4455-9929-12b8cf7e9977 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:44:50.611644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-4eb8182e-57b4-4455-9929-12b8cf7e9977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:50.631271 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:50.718694 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8182e-57b4-4455-9929-12b8cf7e9977 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:44:50.791410 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111b277-0bff-4c5d-87fa-c596eca0524f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:44:50.792077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111b277-0bff-4c5d-87fa-c596eca0524f service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:50.792359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111b277-0bff-4c5d-87fa-c596eca0524f service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:50.792635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111b277-0bff-4c5d-87fa-c596eca0524f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:50.798450 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e111b277-0bff-4c5d-87fa-c596eca0524f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:50.875765 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:50.915417 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111b277-0bff-4c5d-87fa-c596eca0524f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:44:50.916860 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111b277-0bff-4c5d-87fa-c596eca0524f service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:44:50.935309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 658/1323] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:44:53.183164 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4d620-f69d-4572-a0de-704bb709306c None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:53.183709 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4d620-f69d-4572-a0de-704bb709306c None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:53.183709 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4d620-f69d-4572-a0de-704bb709306c None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:53.185094 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 666/1324] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:44:53.190501 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af2ac7-daf4-4025-94e9-ee17b8307ad8 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:53.191498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af2ac7-daf4-4025-94e9-ee17b8307ad8 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:53.191634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af2ac7-daf4-4025-94e9-ee17b8307ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:53.254876 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-98af2ac7-daf4-4025-94e9-ee17b8307ad8 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:44:53.256075 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-98af2ac7-daf4-4025-94e9-ee17b8307ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:53.354902 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 659/1325] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:44:53.391007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4d620-f69d-4572-a0de-704bb709306c None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:44:53.392545 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-3ce4d620-f69d-4572-a0de-704bb709306c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:53.500722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4d620-f69d-4572-a0de-704bb709306c None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:44:53.574557 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02a181-5287-46eb-99b8-8c84524a275e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:44:53.575201 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02a181-5287-46eb-99b8-8c84524a275e service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:53.575484 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02a181-5287-46eb-99b8-8c84524a275e service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:53.575760 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02a181-5287-46eb-99b8-8c84524a275e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:53.577401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-fb02a181-5287-46eb-99b8-8c84524a275e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:53.593446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:53.689963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02a181-5287-46eb-99b8-8c84524a275e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:44:53.691395 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02a181-5287-46eb-99b8-8c84524a275e service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:44:53.709740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 667/1326] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:44:55.981073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a5c21-89ea-4201-9437-a2423ddae2b1 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:55.981606 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a5c21-89ea-4201-9437-a2423ddae2b1 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:55.981606 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a5c21-89ea-4201-9437-a2423ddae2b1 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:55.982939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 660/1327] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:44:55.988867 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beac2f-d86e-4392-a377-56ccaa3714a9 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:55.989331 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beac2f-d86e-4392-a377-56ccaa3714a9 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:55.989459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beac2f-d86e-4392-a377-56ccaa3714a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:56.053430 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-59beac2f-d86e-4392-a377-56ccaa3714a9 None None] MFA Rules not processed for user `a7511ee85d654a25b46c136f366541e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:44:56.054636 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-59beac2f-d86e-4392-a377-56ccaa3714a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:56.119661 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:56.152660 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 668/1328] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:44:55 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:44:56.189538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a5c21-89ea-4201-9437-a2423ddae2b1 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:44:56.191067 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-939a5c21-89ea-4201-9437-a2423ddae2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:56.223628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:56.296125 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a5c21-89ea-4201-9437-a2423ddae2b1 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:44:56.368757 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21e3d3-83de-4879-92f9-8d9f13815043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:44:56.369440 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21e3d3-83de-4879-92f9-8d9f13815043 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:56.369729 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21e3d3-83de-4879-92f9-8d9f13815043 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:56.370010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21e3d3-83de-4879-92f9-8d9f13815043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:56.371623 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-2a21e3d3-83de-4879-92f9-8d9f13815043 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:56.447378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:56.478897 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21e3d3-83de-4879-92f9-8d9f13815043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:44:56.480333 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21e3d3-83de-4879-92f9-8d9f13815043 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:44:56.498325 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 661/1329] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:44:56 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:44:58.928017 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5970c-d62f-489c-b0d5-084e6dd70c5d None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:58.928558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5970c-d62f-489c-b0d5-084e6dd70c5d None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:58.928558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5970c-d62f-489c-b0d5-084e6dd70c5d None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:58.929970 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 669/1330] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:44:58.935160 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8987497-27f6-4208-aa8d-d6983749e44c None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:58.935566 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8987497-27f6-4208-aa8d-d6983749e44c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:58.935720 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8987497-27f6-4208-aa8d-d6983749e44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:59.000766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a8987497-27f6-4208-aa8d-d6983749e44c None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:44:59.001934 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a8987497-27f6-4208-aa8d-d6983749e44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:59.096884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 662/1331] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:44:59.149643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998ab13-2f8f-41e9-90d4-e9ece0b27235 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:59.149933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998ab13-2f8f-41e9-90d4-e9ece0b27235 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:59.150214 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998ab13-2f8f-41e9-90d4-e9ece0b27235 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:59.151583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 670/1332] 10.222.0.45 () {54 vars in 964 bytes} [Thu May 26 13:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:44:59.159562 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9412a42-6369-429f-a878-8cae61b001ee None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:59.160416 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9412a42-6369-429f-a878-8cae61b001ee None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:59.160694 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9412a42-6369-429f-a878-8cae61b001ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:59.207794 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:59.241867 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-d9412a42-6369-429f-a878-8cae61b001ee None None] MFA Rules not processed for user `45105360300a4cae802fdbda91b9d5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:44:59.243085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-d9412a42-6369-429f-a878-8cae61b001ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:59.318525 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 663/1333] 10.222.0.45 () {58 vars in 1061 bytes} [Thu May 26 13:44:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:44:59.327776 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998ab13-2f8f-41e9-90d4-e9ece0b27235 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:44:59.329329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-b998ab13-2f8f-41e9-90d4-e9ece0b27235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:59.445165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998ab13-2f8f-41e9-90d4-e9ece0b27235 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:44:59.532670 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62cbbf-57f0-4f1f-9203-d480ac4f5b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:44:59.533381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62cbbf-57f0-4f1f-9203-d480ac4f5b79 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:59.533660 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62cbbf-57f0-4f1f-9203-d480ac4f5b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:59.534028 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62cbbf-57f0-4f1f-9203-d480ac4f5b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:59.537882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-4d62cbbf-57f0-4f1f-9203-d480ac4f5b79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:59.568134 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:59.670306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62cbbf-57f0-4f1f-9203-d480ac4f5b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:44:59.671833 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62cbbf-57f0-4f1f-9203-d480ac4f5b79 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:44:59.695995 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 671/1334] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:45:02.174632 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a0ae2-a1b2-4db9-8713-e92a31ac46bf None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:02.175196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a0ae2-a1b2-4db9-8713-e92a31ac46bf None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:02.175196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a0ae2-a1b2-4db9-8713-e92a31ac46bf None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:02.177112 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 664/1335] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:02.182439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ea8af-6fce-4912-9615-46c89dff38d0 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:02.182855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ea8af-6fce-4912-9615-46c89dff38d0 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:02.182995 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ea8af-6fce-4912-9615-46c89dff38d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:02.248394 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-e48ea8af-6fce-4912-9615-46c89dff38d0 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:02.249656 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e48ea8af-6fce-4912-9615-46c89dff38d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:02.329409 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:02.351871 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 672/1336] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:45:02.392101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a0ae2-a1b2-4db9-8713-e92a31ac46bf None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:45:02.393673 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-452a0ae2-a1b2-4db9-8713-e92a31ac46bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:02.495392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a0ae2-a1b2-4db9-8713-e92a31ac46bf None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:45:02.523354 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:02.572084 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d399156-d199-4bbb-9f41-a06709f99519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:45:02.572731 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d399156-d199-4bbb-9f41-a06709f99519 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:02.573018 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d399156-d199-4bbb-9f41-a06709f99519 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:02.573326 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d399156-d199-4bbb-9f41-a06709f99519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:02.574971 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-4d399156-d199-4bbb-9f41-a06709f99519 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:02.681816 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d399156-d199-4bbb-9f41-a06709f99519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:45:02.683255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d399156-d199-4bbb-9f41-a06709f99519 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:45:02.701024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 665/1337] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:45:05.485526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87803432-0b44-4e55-a90c-0e997cfeaa18 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:05.486052 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87803432-0b44-4e55-a90c-0e997cfeaa18 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:05.486052 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87803432-0b44-4e55-a90c-0e997cfeaa18 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:05.487449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 673/1338] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:05.493085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514db4f8-2f83-446f-8613-c269a05274e7 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:05.493490 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514db4f8-2f83-446f-8613-c269a05274e7 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:05.493667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514db4f8-2f83-446f-8613-c269a05274e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:05.557688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-514db4f8-2f83-446f-8613-c269a05274e7 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:05.558887 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-514db4f8-2f83-446f-8613-c269a05274e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:05.566929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:05.653321 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 666/1339] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:45:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:05.688591 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87803432-0b44-4e55-a90c-0e997cfeaa18 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:45:05.690135 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-87803432-0b44-4e55-a90c-0e997cfeaa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:05.789068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87803432-0b44-4e55-a90c-0e997cfeaa18 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:45:05.861856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137a367-677d-40fb-8f5c-5124cb632b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:45:05.862497 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137a367-677d-40fb-8f5c-5124cb632b7e service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:05.862776 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137a367-677d-40fb-8f5c-5124cb632b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:05.863634 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137a367-677d-40fb-8f5c-5124cb632b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:05.865294 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-1137a367-677d-40fb-8f5c-5124cb632b7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:05.903968 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:05.974449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137a367-677d-40fb-8f5c-5124cb632b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:45:05.975860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137a367-677d-40fb-8f5c-5124cb632b7e service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:45:05.993052 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 674/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:45:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:45:10.279388 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7399b-59cb-489b-963c-fdc70346ac24 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:10.279951 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7399b-59cb-489b-963c-fdc70346ac24 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:10.280067 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7399b-59cb-489b-963c-fdc70346ac24 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:10.281468 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 667/1341] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:10.286781 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f26de-d8a7-414f-8d09-f9cd995981e7 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:10.287190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f26de-d8a7-414f-8d09-f9cd995981e7 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:10.287371 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f26de-d8a7-414f-8d09-f9cd995981e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:10.356870 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-eb5f26de-d8a7-414f-8d09-f9cd995981e7 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:10.358004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-eb5f26de-d8a7-414f-8d09-f9cd995981e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:10.447258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:10.461643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 675/1342] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:10.499550 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7399b-59cb-489b-963c-fdc70346ac24 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:45:10.501965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e8c7399b-59cb-489b-963c-fdc70346ac24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:10.597622 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7399b-59cb-489b-963c-fdc70346ac24 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:45:10.601604 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82e132-88b5-4728-a186-913808e19461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:45:10.602248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82e132-88b5-4728-a186-913808e19461 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:10.602530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82e132-88b5-4728-a186-913808e19461 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:10.602803 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82e132-88b5-4728-a186-913808e19461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:10.611725 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82e132-88b5-4728-a186-913808e19461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:45:10.613182 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82e132-88b5-4728-a186-913808e19461 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:45:10.622478 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 668/1343] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:45:13.425329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf482fa-7d28-4532-bfe9-c1c570ea772f None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:13.425852 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf482fa-7d28-4532-bfe9-c1c570ea772f None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:13.425947 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf482fa-7d28-4532-bfe9-c1c570ea772f None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:13.427331 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 676/1344] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:45:13.432618 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500640c-47e5-430f-aa7c-168199464af9 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:13.433065 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500640c-47e5-430f-aa7c-168199464af9 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:13.433161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500640c-47e5-430f-aa7c-168199464af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:13.461406 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-e500640c-47e5-430f-aa7c-168199464af9 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:13.462712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e500640c-47e5-430f-aa7c-168199464af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:13.496037 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:13.544952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 669/1345] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:45:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:13.582591 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf482fa-7d28-4532-bfe9-c1c570ea772f None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:45:13.593125 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf482fa-7d28-4532-bfe9-c1c570ea772f None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:45:13.596548 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debb99c-61c4-48f6-a859-0c7bc85cff72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:45:13.597177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debb99c-61c4-48f6-a859-0c7bc85cff72 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:13.597494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debb99c-61c4-48f6-a859-0c7bc85cff72 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:13.597800 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debb99c-61c4-48f6-a859-0c7bc85cff72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:13.606598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debb99c-61c4-48f6-a859-0c7bc85cff72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:45:13.608017 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debb99c-61c4-48f6-a859-0c7bc85cff72 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:45:13.618031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 677/1346] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:45:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:45:17.714641 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce57115-a1cd-401f-a24c-c1df2cb07077 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:17.715183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce57115-a1cd-401f-a24c-c1df2cb07077 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:17.715545 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce57115-a1cd-401f-a24c-c1df2cb07077 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:17.717158 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 670/1347] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:17.724274 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6fea3-f515-4b50-9f3d-914c67c4cefc None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:17.724788 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6fea3-f515-4b50-9f3d-914c67c4cefc None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:17.725124 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6fea3-f515-4b50-9f3d-914c67c4cefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:17.742928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-9ee6fea3-f515-4b50-9f3d-914c67c4cefc None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:17.744106 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-9ee6fea3-f515-4b50-9f3d-914c67c4cefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:17.752172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 678/1348] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:17.789475 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce57115-a1cd-401f-a24c-c1df2cb07077 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:45:17.800173 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce57115-a1cd-401f-a24c-c1df2cb07077 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:45:17.804225 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59265a-8fa3-43d8-8697-75951ac59ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:45:17.804861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59265a-8fa3-43d8-8697-75951ac59ccf service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:17.805145 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59265a-8fa3-43d8-8697-75951ac59ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:17.805463 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59265a-8fa3-43d8-8697-75951ac59ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:17.814412 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59265a-8fa3-43d8-8697-75951ac59ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:45:17.815839 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59265a-8fa3-43d8-8697-75951ac59ccf service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:45:17.825233 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 671/1349] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:45:23.074693 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d0912-be55-4d0e-8821-7eb7add2585f None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:23.075574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d0912-be55-4d0e-8821-7eb7add2585f None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:23.075999 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d0912-be55-4d0e-8821-7eb7add2585f None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:23.077862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 679/1350] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 13:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:23.083451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15af118-afb8-4a3d-86a5-dfb6a52a4043 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:23.084302 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15af118-afb8-4a3d-86a5-dfb6a52a4043 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:23.084677 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15af118-afb8-4a3d-86a5-dfb6a52a4043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:23.202734 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a15af118-afb8-4a3d-86a5-dfb6a52a4043 None None] MFA Rules not processed for user `8b0db68b7fda4da29eb13689f3fd7b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:23.204076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a15af118-afb8-4a3d-86a5-dfb6a52a4043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:23.288402 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 672/1351] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 13:45:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:45:27.662709 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba4f51-47ef-4fe5-9d32-f3f786dacc94 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:27.663285 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba4f51-47ef-4fe5-9d32-f3f786dacc94 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:27.663285 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba4f51-47ef-4fe5-9d32-f3f786dacc94 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:27.664948 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 680/1352] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 13:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:27.669986 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e6630-b0cc-4cc6-a3f1-93678001ce11 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:27.670430 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e6630-b0cc-4cc6-a3f1-93678001ce11 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:27.670528 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e6630-b0cc-4cc6-a3f1-93678001ce11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:27.693550 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-450e6630-b0cc-4cc6-a3f1-93678001ce11 None None] MFA Rules not processed for user `8b0db68b7fda4da29eb13689f3fd7b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:27.694762 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-450e6630-b0cc-4cc6-a3f1-93678001ce11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:27.704283 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 673/1353] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 13:45:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:27.737329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=13 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:29.222928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0ccc2-5fea-4f6f-a0eb-947a4237f6cc None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:29.223569 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0ccc2-5fea-4f6f-a0eb-947a4237f6cc None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:29.223569 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0ccc2-5fea-4f6f-a0eb-947a4237f6cc None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:29.225639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 681/1354] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 13:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:29.231129 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e4420-cf43-44d5-9fb2-bf603f22c434 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:29.231578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e4420-cf43-44d5-9fb2-bf603f22c434 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:29.231812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e4420-cf43-44d5-9fb2-bf603f22c434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:29.250359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-318e4420-cf43-44d5-9fb2-bf603f22c434 None None] MFA Rules not processed for user `8b0db68b7fda4da29eb13689f3fd7b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:29.251601 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-318e4420-cf43-44d5-9fb2-bf603f22c434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:29.260863 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 674/1355] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 13:45:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:33.096074 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bbfda-1f89-4bb7-b070-4f07d42f25e7 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:33.096961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bbfda-1f89-4bb7-b070-4f07d42f25e7 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:33.097235 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bbfda-1f89-4bb7-b070-4f07d42f25e7 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:33.099348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 682/1356] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:45:33.104663 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b21a98-edd4-47ed-a5c2-1eb5cc9e5ce7 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:33.105454 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b21a98-edd4-47ed-a5c2-1eb5cc9e5ce7 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:33.105915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b21a98-edd4-47ed-a5c2-1eb5cc9e5ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:33.130611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-31b21a98-edd4-47ed-a5c2-1eb5cc9e5ce7 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:33.131847 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-31b21a98-edd4-47ed-a5c2-1eb5cc9e5ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:33.140193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 675/1357] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:33.194192 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9a9e2-d57b-427f-9e06-da9f9d6a1204 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:33.194809 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9a9e2-d57b-427f-9e06-da9f9d6a1204 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:33.195306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9a9e2-d57b-427f-9e06-da9f9d6a1204 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:33.197540 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 683/1358] 10.222.0.45 () {54 vars in 961 bytes} [Thu May 26 13:45:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:45:33.206450 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ca694-20d3-44ca-b5ec-2b1bbb245c62 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:33.207952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ca694-20d3-44ca-b5ec-2b1bbb245c62 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:33.208454 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ca694-20d3-44ca-b5ec-2b1bbb245c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:33.257476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:33.268602 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-494ca694-20d3-44ca-b5ec-2b1bbb245c62 None None] MFA Rules not processed for user `1994043a81bb454297c208839794a479`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:33.269843 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-494ca694-20d3-44ca-b5ec-2b1bbb245c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:33.373193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 676/1359] 10.222.0.45 () {58 vars in 1058 bytes} [Thu May 26 13:45:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:33.381687 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9a9e2-d57b-427f-9e06-da9f9d6a1204 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:45:33.396826 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9a9e2-d57b-427f-9e06-da9f9d6a1204 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:45:33.403185 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f566aa3-1609-4007-bd25-3f66c46bba11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:45:33.403952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f566aa3-1609-4007-bd25-3f66c46bba11 service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:33.404339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f566aa3-1609-4007-bd25-3f66c46bba11 service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:33.404748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f566aa3-1609-4007-bd25-3f66c46bba11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:33.414851 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f566aa3-1609-4007-bd25-3f66c46bba11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:45:33.417449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f566aa3-1609-4007-bd25-3f66c46bba11 service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:45:33.427751 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 684/1360] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:45:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:45:35.858219 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785ee16-ff5c-40f9-a310-6050882c97ea None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:35.858746 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785ee16-ff5c-40f9-a310-6050882c97ea None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:35.858746 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785ee16-ff5c-40f9-a310-6050882c97ea None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:35.860187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 677/1361] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:35.865937 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970f010-a824-498e-a14e-4f19303137ad None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:35.866384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970f010-a824-498e-a14e-4f19303137ad None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:35.866474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970f010-a824-498e-a14e-4f19303137ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:35.884911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-1970f010-a824-498e-a14e-4f19303137ad None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:35.886368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-1970f010-a824-498e-a14e-4f19303137ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:35.894423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 685/1362] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:35.939162 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785ee16-ff5c-40f9-a310-6050882c97ea None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:45:35.954146 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785ee16-ff5c-40f9-a310-6050882c97ea None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:45:35.960371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d3485-0175-4fcd-8ee2-e12d07eeeeae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:45:35.961002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d3485-0175-4fcd-8ee2-e12d07eeeeae service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:35.961354 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d3485-0175-4fcd-8ee2-e12d07eeeeae service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:35.961631 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d3485-0175-4fcd-8ee2-e12d07eeeeae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:35.970190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d3485-0175-4fcd-8ee2-e12d07eeeeae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:45:35.971779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d3485-0175-4fcd-8ee2-e12d07eeeeae service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:45:35.982273 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 678/1363] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:45:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:45:38.533450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90b165-0b19-4950-8c68-bc9574dab1da None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:38.535016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90b165-0b19-4950-8c68-bc9574dab1da None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:38.535016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90b165-0b19-4950-8c68-bc9574dab1da None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:38.536016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 686/1364] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:38.541850 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5285ef-997d-45e1-ba03-11089be876dd None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:38.542330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5285ef-997d-45e1-ba03-11089be876dd None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:38.542443 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5285ef-997d-45e1-ba03-11089be876dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:38.562011 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-3e5285ef-997d-45e1-ba03-11089be876dd None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:38.563191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-3e5285ef-997d-45e1-ba03-11089be876dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:38.571580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 679/1365] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:38.617776 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288ec66-ffc2-45ac-9426-f58c0ec49e1c None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:38.618063 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288ec66-ffc2-45ac-9426-f58c0ec49e1c None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:38.618369 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288ec66-ffc2-45ac-9426-f58c0ec49e1c None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:38.619783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 687/1366] 10.222.0.45 () {54 vars in 961 bytes} [Thu May 26 13:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:38.627134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb232a-8f14-4b20-aa18-1628ad7663f6 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:38.627134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb232a-8f14-4b20-aa18-1628ad7663f6 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:38.627435 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb232a-8f14-4b20-aa18-1628ad7663f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:38.652432 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-ebeb232a-8f14-4b20-aa18-1628ad7663f6 None None] MFA Rules not processed for user `1994043a81bb454297c208839794a479`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:38.653661 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ebeb232a-8f14-4b20-aa18-1628ad7663f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:38.663399 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 680/1367] 10.222.0.45 () {58 vars in 1058 bytes} [Thu May 26 13:45:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:38.671396 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288ec66-ffc2-45ac-9426-f58c0ec49e1c None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:45:38.686706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288ec66-ffc2-45ac-9426-f58c0ec49e1c None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:45:38.692865 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba074cba-8799-47ce-a5ce-9a009dec3421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:45:38.693557 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba074cba-8799-47ce-a5ce-9a009dec3421 service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:38.693842 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba074cba-8799-47ce-a5ce-9a009dec3421 service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:38.694117 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba074cba-8799-47ce-a5ce-9a009dec3421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:38.702465 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba074cba-8799-47ce-a5ce-9a009dec3421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:45:38.704036 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba074cba-8799-47ce-a5ce-9a009dec3421 service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:45:38.714001 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 688/1368] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:45:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:45:41.027292 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50ddf5-9216-494f-8ddb-345118b680dd None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:41.027873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50ddf5-9216-494f-8ddb-345118b680dd None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:41.027873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50ddf5-9216-494f-8ddb-345118b680dd None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:41.029204 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 681/1369] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:41.034599 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05840393-21d0-4236-9340-5b18a7960280 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:41.035032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05840393-21d0-4236-9340-5b18a7960280 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:41.035348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05840393-21d0-4236-9340-5b18a7960280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:41.053795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-05840393-21d0-4236-9340-5b18a7960280 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:41.055243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-05840393-21d0-4236-9340-5b18a7960280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:41.063543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 689/1370] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:41.108055 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50ddf5-9216-494f-8ddb-345118b680dd None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:45:41.123154 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50ddf5-9216-494f-8ddb-345118b680dd None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:45:41.129305 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606f2dc-ae78-46d5-b4c2-25589140ccfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:45:41.130670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606f2dc-ae78-46d5-b4c2-25589140ccfd service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:41.131118 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606f2dc-ae78-46d5-b4c2-25589140ccfd service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:41.131558 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606f2dc-ae78-46d5-b4c2-25589140ccfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:41.140550 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606f2dc-ae78-46d5-b4c2-25589140ccfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:45:41.142661 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606f2dc-ae78-46d5-b4c2-25589140ccfd service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:45:41.155974 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 682/1371] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:45:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:45:41.350660 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5b165-6b69-41dc-bc46-281c8c920bec None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:41.352080 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5b165-6b69-41dc-bc46-281c8c920bec None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:41.352589 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5b165-6b69-41dc-bc46-281c8c920bec None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:41.357302 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 690/1372] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:45:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:45:41.360183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba2f06-49c5-44c1-aae9-2f10370ff0a6 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:41.360462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba2f06-49c5-44c1-aae9-2f10370ff0a6 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:41.360923 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba2f06-49c5-44c1-aae9-2f10370ff0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:41.383763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-e3ba2f06-49c5-44c1-aae9-2f10370ff0a6 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:41.385261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e3ba2f06-49c5-44c1-aae9-2f10370ff0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:41.397309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 683/1373] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:41.688874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0435b-aaa5-4db6-805d-fbde30574503 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:41.689484 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0435b-aaa5-4db6-805d-fbde30574503 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:41.690019 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0435b-aaa5-4db6-805d-fbde30574503 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:41.691607 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 691/1374] 10.222.0.45 () {54 vars in 963 bytes} [Thu May 26 13:45:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:41.697189 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce9454-7ff4-4cef-b46d-9375b84e26c4 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:41.697631 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce9454-7ff4-4cef-b46d-9375b84e26c4 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:41.698036 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce9454-7ff4-4cef-b46d-9375b84e26c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:41.753393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-82ce9454-7ff4-4cef-b46d-9375b84e26c4 None None] MFA Rules not processed for user `c8aed4c31eb14a3bbba08bef799ee450`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:41.755082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-82ce9454-7ff4-4cef-b46d-9375b84e26c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:41.821951 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 684/1375] 10.222.0.45 () {58 vars in 1060 bytes} [Thu May 26 13:45:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:41.829120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0435b-aaa5-4db6-805d-fbde30574503 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:45:41.840200 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0435b-aaa5-4db6-805d-fbde30574503 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:45:41.844388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97ca94-fd2e-4841-802b-806eed604dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:45:41.845097 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ca94-fd2e-4841-802b-806eed604dbc service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:41.845480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ca94-fd2e-4841-802b-806eed604dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:41.845830 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ca94-fd2e-4841-802b-806eed604dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:41.856018 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97ca94-fd2e-4841-802b-806eed604dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:45:41.857555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97ca94-fd2e-4841-802b-806eed604dbc service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:45:41.867993 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 692/1376] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:45:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:45:43.413573 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87490b02-efbf-4a46-a30e-8d4ace76c6cb None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:43.414154 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87490b02-efbf-4a46-a30e-8d4ace76c6cb None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:43.414154 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87490b02-efbf-4a46-a30e-8d4ace76c6cb None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:43.415511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 685/1377] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:43.421680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e30ad-a81a-41a7-a7f3-6f6967042c0d None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:43.422199 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e30ad-a81a-41a7-a7f3-6f6967042c0d None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:43.422280 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e30ad-a81a-41a7-a7f3-6f6967042c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:43.440964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-ad3e30ad-a81a-41a7-a7f3-6f6967042c0d None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:43.442865 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ad3e30ad-a81a-41a7-a7f3-6f6967042c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:43.451081 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 693/1378] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:43.497173 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87490b02-efbf-4a46-a30e-8d4ace76c6cb None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:45:43.513036 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87490b02-efbf-4a46-a30e-8d4ace76c6cb None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:45:43.518684 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3fa4d-a33f-426f-84ab-5d148e372456 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:45:43.519347 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3fa4d-a33f-426f-84ab-5d148e372456 service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:43.519634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3fa4d-a33f-426f-84ab-5d148e372456 service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:43.519914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3fa4d-a33f-426f-84ab-5d148e372456 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:43.529426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3fa4d-a33f-426f-84ab-5d148e372456 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:45:43.531067 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3fa4d-a33f-426f-84ab-5d148e372456 service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:45:43.535586 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:43.542954 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 686/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:45:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:45:45.784529 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c479b-61af-49f2-a4c0-7bc87adc0383 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:45.785075 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c479b-61af-49f2-a4c0-7bc87adc0383 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:45.785075 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c479b-61af-49f2-a4c0-7bc87adc0383 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:45.787085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 694/1380] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:45:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:45.792434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56383cb-d4b2-46ba-97a2-45ff50b2e2d0 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:45.792854 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56383cb-d4b2-46ba-97a2-45ff50b2e2d0 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:45.792995 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56383cb-d4b2-46ba-97a2-45ff50b2e2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:45.812251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-c56383cb-d4b2-46ba-97a2-45ff50b2e2d0 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:45.813477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c56383cb-d4b2-46ba-97a2-45ff50b2e2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:45.821576 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 687/1381] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:45.865445 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c479b-61af-49f2-a4c0-7bc87adc0383 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:45:45.883541 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c479b-61af-49f2-a4c0-7bc87adc0383 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:45:45.888358 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc63e8d-21bd-446b-8da1-64086b5eec27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:45:45.889116 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc63e8d-21bd-446b-8da1-64086b5eec27 service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:45.889531 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc63e8d-21bd-446b-8da1-64086b5eec27 service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:45.889916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc63e8d-21bd-446b-8da1-64086b5eec27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:45.898966 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc63e8d-21bd-446b-8da1-64086b5eec27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:45:45.900643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc63e8d-21bd-446b-8da1-64086b5eec27 service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:45:45.910828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 695/1382] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:45:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:45:48.162193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c807e-15af-40ef-be81-18df4ff30374 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:48.162788 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c807e-15af-40ef-be81-18df4ff30374 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:48.162788 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c807e-15af-40ef-be81-18df4ff30374 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:48.164096 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 688/1383] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:48.169611 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05b078-6e48-4a89-b8f4-872175733768 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:48.170052 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05b078-6e48-4a89-b8f4-872175733768 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:48.170175 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05b078-6e48-4a89-b8f4-872175733768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:48.188327 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-ea05b078-6e48-4a89-b8f4-872175733768 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:48.189706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ea05b078-6e48-4a89-b8f4-872175733768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:48.201138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 696/1384] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:48.240685 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c807e-15af-40ef-be81-18df4ff30374 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:45:48.257946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c807e-15af-40ef-be81-18df4ff30374 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:45:48.264190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79a15c-3b3e-4d39-8a89-cf2d9dfc83c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:45:48.265195 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79a15c-3b3e-4d39-8a89-cf2d9dfc83c1 service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:48.265692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79a15c-3b3e-4d39-8a89-cf2d9dfc83c1 service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:48.266127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79a15c-3b3e-4d39-8a89-cf2d9dfc83c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:48.276955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79a15c-3b3e-4d39-8a89-cf2d9dfc83c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:45:48.278977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79a15c-3b3e-4d39-8a89-cf2d9dfc83c1 service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:45:48.290957 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 689/1385] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:45:50.704920 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af50860-cda7-43f7-a4ae-b1a5dbdddb4b None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:50.705456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af50860-cda7-43f7-a4ae-b1a5dbdddb4b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:50.705664 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af50860-cda7-43f7-a4ae-b1a5dbdddb4b None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:50.707444 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 697/1386] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:50.713637 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c90171-9476-43b4-8e1a-9548fff68d36 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:50.714121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c90171-9476-43b4-8e1a-9548fff68d36 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:50.714203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c90171-9476-43b4-8e1a-9548fff68d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:50.732083 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a0c90171-9476-43b4-8e1a-9548fff68d36 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:50.733694 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a0c90171-9476-43b4-8e1a-9548fff68d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:50.743648 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 690/1387] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:50.788609 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af50860-cda7-43f7-a4ae-b1a5dbdddb4b None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:45:50.803417 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af50860-cda7-43f7-a4ae-b1a5dbdddb4b None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:45:50.808849 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e7429-238a-42c8-8168-836f819c7d6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:45:50.809513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e7429-238a-42c8-8168-836f819c7d6b service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:50.809794 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e7429-238a-42c8-8168-836f819c7d6b service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:50.810070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e7429-238a-42c8-8168-836f819c7d6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:50.819108 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e7429-238a-42c8-8168-836f819c7d6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:45:50.820672 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e7429-238a-42c8-8168-836f819c7d6b service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:45:50.830461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 698/1388] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:45:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:45:53.180596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b68c7e-36e2-44f8-a58c-8391f00d463e None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:53.181187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b68c7e-36e2-44f8-a58c-8391f00d463e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:53.181187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b68c7e-36e2-44f8-a58c-8391f00d463e None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:53.182427 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 691/1389] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:53.188159 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936eea0-1b6b-4fc2-bf9b-aca13726529b None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:53.188604 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936eea0-1b6b-4fc2-bf9b-aca13726529b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:53.189138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936eea0-1b6b-4fc2-bf9b-aca13726529b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:53.211069 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-7936eea0-1b6b-4fc2-bf9b-aca13726529b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:53.212568 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7936eea0-1b6b-4fc2-bf9b-aca13726529b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:53.222844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 699/1390] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:53.267691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b68c7e-36e2-44f8-a58c-8391f00d463e None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:45:53.285450 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b68c7e-36e2-44f8-a58c-8391f00d463e None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:45:53.292951 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad94ff-d767-4d58-b69d-06302b072443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:45:53.293800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad94ff-d767-4d58-b69d-06302b072443 service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:53.294424 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad94ff-d767-4d58-b69d-06302b072443 service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:53.294775 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad94ff-d767-4d58-b69d-06302b072443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:53.305533 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad94ff-d767-4d58-b69d-06302b072443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:45:53.307131 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad94ff-d767-4d58-b69d-06302b072443 service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:45:53.316636 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 692/1391] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:45:55.569797 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cde58-0397-406f-91e2-bdbd6a4bc017 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:55.570410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cde58-0397-406f-91e2-bdbd6a4bc017 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:55.570410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cde58-0397-406f-91e2-bdbd6a4bc017 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:55.571775 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 700/1392] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:55.577166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44af47-3a7b-467f-924d-898e2bae2479 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:55.577694 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44af47-3a7b-467f-924d-898e2bae2479 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:55.577861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44af47-3a7b-467f-924d-898e2bae2479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:55.595227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-6d44af47-3a7b-467f-924d-898e2bae2479 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:55.596401 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6d44af47-3a7b-467f-924d-898e2bae2479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:55.604025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 693/1393] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:55.648027 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3cde58-0397-406f-91e2-bdbd6a4bc017 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:45:55.663764 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3cde58-0397-406f-91e2-bdbd6a4bc017 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:45:55.669106 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8013ef-370f-47ed-afd7-19cbaab9403f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:45:55.669773 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8013ef-370f-47ed-afd7-19cbaab9403f service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:55.670055 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8013ef-370f-47ed-afd7-19cbaab9403f service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:55.670329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8013ef-370f-47ed-afd7-19cbaab9403f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:55.683647 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8013ef-370f-47ed-afd7-19cbaab9403f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:45:55.685371 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8013ef-370f-47ed-afd7-19cbaab9403f service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:45:55.696833 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 701/1394] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:45:57.495518 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1363962-a3e9-4276-8f0c-826ef240f288 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:57.496087 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1363962-a3e9-4276-8f0c-826ef240f288 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:57.496087 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1363962-a3e9-4276-8f0c-826ef240f288 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:57.497452 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 694/1395] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:57.502703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e812404-581e-4a7b-94f7-6e541d031de1 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:57.503156 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e812404-581e-4a7b-94f7-6e541d031de1 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:57.503648 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e812404-581e-4a7b-94f7-6e541d031de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:57.523055 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-7e812404-581e-4a7b-94f7-6e541d031de1 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:57.524247 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7e812404-581e-4a7b-94f7-6e541d031de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:57.532225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 702/1396] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:57.589254 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b2a04-9def-4ce7-b710-0545b203d243 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:57.589564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b2a04-9def-4ce7-b710-0545b203d243 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:57.589839 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b2a04-9def-4ce7-b710-0545b203d243 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:57.591175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 695/1397] 10.222.0.45 () {54 vars in 962 bytes} [Thu May 26 13:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:57.596113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c89ef7-e638-4b7f-9b46-620b417b1632 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:57.596395 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c89ef7-e638-4b7f-9b46-620b417b1632 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:57.596690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c89ef7-e638-4b7f-9b46-620b417b1632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:57.645130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-d1c89ef7-e638-4b7f-9b46-620b417b1632 None None] MFA Rules not processed for user `e3039ec7e613464c8a71f4440dfe8bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:57.646930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d1c89ef7-e638-4b7f-9b46-620b417b1632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:57.715163 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 703/1398] 10.222.0.45 () {58 vars in 1059 bytes} [Thu May 26 13:45:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:57.723324 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b2a04-9def-4ce7-b710-0545b203d243 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:45:57.734621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b2a04-9def-4ce7-b710-0545b203d243 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:45:57.738343 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50052ac8-83f8-44d9-8fe0-80f0fbd00d43 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3039ec7e613464c8a71f4440dfe8bc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:45:57.739718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50052ac8-83f8-44d9-8fe0-80f0fbd00d43 service glance] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:57.740006 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50052ac8-83f8-44d9-8fe0-80f0fbd00d43 service glance] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:57.740282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50052ac8-83f8-44d9-8fe0-80f0fbd00d43 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:57.750255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50052ac8-83f8-44d9-8fe0-80f0fbd00d43 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:45:57.751693 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50052ac8-83f8-44d9-8fe0-80f0fbd00d43 service glance] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:45:57.762175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 696/1399] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:45:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:45:57.907019 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192517c-614f-45b8-beaf-d5b4396afdc8 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:57.907317 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192517c-614f-45b8-beaf-d5b4396afdc8 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:57.907600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192517c-614f-45b8-beaf-d5b4396afdc8 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:57.909000 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 704/1400] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:57.914462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866449a-6f3c-4642-8f40-c5aa11c8d3fe None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:57.914818 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866449a-6f3c-4642-8f40-c5aa11c8d3fe None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:57.915187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866449a-6f3c-4642-8f40-c5aa11c8d3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:57.933191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-1866449a-6f3c-4642-8f40-c5aa11c8d3fe None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:57.934487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1866449a-6f3c-4642-8f40-c5aa11c8d3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:57.942933 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 697/1401] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:57.987350 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192517c-614f-45b8-beaf-d5b4396afdc8 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:45:57.998178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=93 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:58.007669 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192517c-614f-45b8-beaf-d5b4396afdc8 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:45:58.012967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed19ff-3830-4ece-b31d-56108e01e23f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:45:58.013671 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed19ff-3830-4ece-b31d-56108e01e23f service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:58.013959 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed19ff-3830-4ece-b31d-56108e01e23f service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:58.014239 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed19ff-3830-4ece-b31d-56108e01e23f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:58.029382 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed19ff-3830-4ece-b31d-56108e01e23f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:45:58.030906 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed19ff-3830-4ece-b31d-56108e01e23f service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:45:58.042108 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 705/1402] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:45:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:45:58.297071 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5fbbc-4609-4756-baf0-ab29c17605be None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:58.297398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5fbbc-4609-4756-baf0-ab29c17605be None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:58.297679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5fbbc-4609-4756-baf0-ab29c17605be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:58.345007 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-14f5fbbc-4609-4756-baf0-ab29c17605be None None] MFA Rules not processed for user `135410329e56486c8ccb65b1f2d87aca`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:58.346226 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-14f5fbbc-4609-4756-baf0-ab29c17605be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:58.410242 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 698/1403] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 13:45:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:58.453568 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59514d-fa47-4c56-ac6b-7a3a734f4076 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:58.454001 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59514d-fa47-4c56-ac6b-7a3a734f4076 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:58.454508 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59514d-fa47-4c56-ac6b-7a3a734f4076 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:58.456367 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 706/1404] 10.222.0.45 () {54 vars in 942 bytes} [Thu May 26 13:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:45:58.464880 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e767bc-1ee1-43f2-9d5c-e2c34f833fe6 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:58.465457 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e767bc-1ee1-43f2-9d5c-e2c34f833fe6 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:58.465795 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e767bc-1ee1-43f2-9d5c-e2c34f833fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:58.513905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-59e767bc-1ee1-43f2-9d5c-e2c34f833fe6 None None] MFA Rules not processed for user `e517dc43cc6d401e820c65ad4c941386`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:45:58.515104 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-59e767bc-1ee1-43f2-9d5c-e2c34f833fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:45:58.548671 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:58.586827 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 699/1405] 10.222.0.45 () {58 vars in 1039 bytes} [Thu May 26 13:45:58 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:45:58.596250 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59514d-fa47-4c56-ac6b-7a3a734f4076 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:45:58.610421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59514d-fa47-4c56-ac6b-7a3a734f4076 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:45:58.615491 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b6efe-cece-4eb9-9748-1db1bb08e21e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e517dc43cc6d401e820c65ad4c941386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:45:58.616135 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b6efe-cece-4eb9-9748-1db1bb08e21e service swift] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:45:58.616427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b6efe-cece-4eb9-9748-1db1bb08e21e service swift] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:45:58.616710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b6efe-cece-4eb9-9748-1db1bb08e21e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:45:58.625323 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b6efe-cece-4eb9-9748-1db1bb08e21e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:45:58.626874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b6efe-cece-4eb9-9748-1db1bb08e21e service swift] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:45:58.635404 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 707/1406] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 13:45:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 13:46:00.288574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41830fd7-4d0a-424f-9212-1b1849cdcdaf None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:00.289114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41830fd7-4d0a-424f-9212-1b1849cdcdaf None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:00.289114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41830fd7-4d0a-424f-9212-1b1849cdcdaf None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:00.290562 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 700/1407] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:00.313291 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed80b9f-5bf8-426b-b53f-6f7bb7fa2e03 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:00.313291 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed80b9f-5bf8-426b-b53f-6f7bb7fa2e03 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:00.313291 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed80b9f-5bf8-426b-b53f-6f7bb7fa2e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:00.326474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-1ed80b9f-5bf8-426b-b53f-6f7bb7fa2e03 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:00.328170 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-1ed80b9f-5bf8-426b-b53f-6f7bb7fa2e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:00.337551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 708/1408] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:00.384488 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41830fd7-4d0a-424f-9212-1b1849cdcdaf None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:00.403953 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41830fd7-4d0a-424f-9212-1b1849cdcdaf None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:00.416451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ea7d2-d37d-429d-b12b-932c2f9c10bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:00.417435 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ea7d2-d37d-429d-b12b-932c2f9c10bd service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:00.417982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ea7d2-d37d-429d-b12b-932c2f9c10bd service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:00.418156 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ea7d2-d37d-429d-b12b-932c2f9c10bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:00.435019 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ea7d2-d37d-429d-b12b-932c2f9c10bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:00.435256 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ea7d2-d37d-429d-b12b-932c2f9c10bd service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:00.445500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 701/1409] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:46:10.319877 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=14 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:46:10.441153 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=21 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:46:22.047602 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f5a97-6184-4943-8966-910f3c194277 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:22.048216 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f5a97-6184-4943-8966-910f3c194277 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:22.048216 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f5a97-6184-4943-8966-910f3c194277 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:22.049610 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 709/1410] 10.222.0.45 () {54 vars in 918 bytes} [Thu May 26 13:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:22.054723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d86fc-3848-47b9-b9c9-2a8fb1e78404 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:22.055203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d86fc-3848-47b9-b9c9-2a8fb1e78404 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:22.055301 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d86fc-3848-47b9-b9c9-2a8fb1e78404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:22.073259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-658d86fc-3848-47b9-b9c9-2a8fb1e78404 None None] MFA Rules not processed for user `8b0db68b7fda4da29eb13689f3fd7b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:22.074473 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-658d86fc-3848-47b9-b9c9-2a8fb1e78404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:22.082722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 702/1411] 10.222.0.45 () {58 vars in 1015 bytes} [Thu May 26 13:46:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:22.096706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178b767-34a4-4d61-8d4c-f94724da8946 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:22.096997 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178b767-34a4-4d61-8d4c-f94724da8946 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:22.097296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178b767-34a4-4d61-8d4c-f94724da8946 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:22.098628 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 710/1412] 10.222.0.45 () {54 vars in 918 bytes} [Thu May 26 13:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:22.103039 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd57bd8-5d8b-4cfa-bec3-07c605462b9a None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:22.103325 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd57bd8-5d8b-4cfa-bec3-07c605462b9a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:22.103601 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd57bd8-5d8b-4cfa-bec3-07c605462b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:22.121038 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-4cd57bd8-5d8b-4cfa-bec3-07c605462b9a None None] MFA Rules not processed for user `1994043a81bb454297c208839794a479`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:22.122313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-4cd57bd8-5d8b-4cfa-bec3-07c605462b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:22.132034 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 703/1413] 10.222.0.45 () {58 vars in 1015 bytes} [Thu May 26 13:46:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:46:24.877049 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401394d5-9e4a-47e8-a3ad-811aca87bedf None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:24.877643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401394d5-9e4a-47e8-a3ad-811aca87bedf None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:24.877643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401394d5-9e4a-47e8-a3ad-811aca87bedf None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:24.879016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 13:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:24.887777 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b66896-1a03-413d-9cbf-2d6226291b0f None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:24.888250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b66896-1a03-413d-9cbf-2d6226291b0f None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:24.888409 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b66896-1a03-413d-9cbf-2d6226291b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:24.906157 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-98b66896-1a03-413d-9cbf-2d6226291b0f None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:24.907439 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-98b66896-1a03-413d-9cbf-2d6226291b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:24.915040 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 13:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:24.957668 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401394d5-9e4a-47e8-a3ad-811aca87bedf None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:24.971759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401394d5-9e4a-47e8-a3ad-811aca87bedf None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:24.977634 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69deaa-b2c6-4348-8859-ab4d673df476 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:24.978264 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69deaa-b2c6-4348-8859-ab4d673df476 service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:24.978547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69deaa-b2c6-4348-8859-ab4d673df476 service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:24.978823 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69deaa-b2c6-4348-8859-ab4d673df476 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:24.986807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69deaa-b2c6-4348-8859-ab4d673df476 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:24.988371 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69deaa-b2c6-4348-8859-ab4d673df476 service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:24.998192 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 712/1416] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:46:25.972424 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e805e8-1d5e-4ca4-9efc-89a13bd3296b None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:25.972998 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e805e8-1d5e-4ca4-9efc-89a13bd3296b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:25.972998 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e805e8-1d5e-4ca4-9efc-89a13bd3296b None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:25.974351 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 13:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:25.979183 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bf194-6f04-43e0-a5ec-8b0ea29992e2 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:25.979627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bf194-6f04-43e0-a5ec-8b0ea29992e2 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:25.979819 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bf194-6f04-43e0-a5ec-8b0ea29992e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:25.997952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-995bf194-6f04-43e0-a5ec-8b0ea29992e2 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:25.999486 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-995bf194-6f04-43e0-a5ec-8b0ea29992e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:26.007971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 13:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:26.189549 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e805e8-1d5e-4ca4-9efc-89a13bd3296b None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:26.204269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e805e8-1d5e-4ca4-9efc-89a13bd3296b None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:26.209533 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae223ebc-206f-4a00-82ca-1e04bba6c873 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:26.210158 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae223ebc-206f-4a00-82ca-1e04bba6c873 service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:26.210436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae223ebc-206f-4a00-82ca-1e04bba6c873 service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:26.210706 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae223ebc-206f-4a00-82ca-1e04bba6c873 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:26.218679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae223ebc-206f-4a00-82ca-1e04bba6c873 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:26.220247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae223ebc-206f-4a00-82ca-1e04bba6c873 service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:26.229383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 706/1419] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:46:27.151324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee892a3-5d8d-48d3-a804-66066e911cf8 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:27.151898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee892a3-5d8d-48d3-a804-66066e911cf8 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:27.151898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee892a3-5d8d-48d3-a804-66066e911cf8 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:27.153258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 13:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:27.158265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa948e-4dc7-43b7-aa54-d9614abd8667 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:27.158698 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa948e-4dc7-43b7-aa54-d9614abd8667 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:27.158825 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa948e-4dc7-43b7-aa54-d9614abd8667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:27.177245 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-5eaa948e-4dc7-43b7-aa54-d9614abd8667 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:27.178457 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-5eaa948e-4dc7-43b7-aa54-d9614abd8667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:27.186177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 13:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:27.338115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee892a3-5d8d-48d3-a804-66066e911cf8 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:27.353042 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee892a3-5d8d-48d3-a804-66066e911cf8 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:27.358565 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143a49d-3e4c-47b7-929c-836c344b7c03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:27.359189 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143a49d-3e4c-47b7-929c-836c344b7c03 service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:27.359469 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143a49d-3e4c-47b7-929c-836c344b7c03 service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:27.359744 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143a49d-3e4c-47b7-929c-836c344b7c03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:27.368031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143a49d-3e4c-47b7-929c-836c344b7c03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:27.369629 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143a49d-3e4c-47b7-929c-836c344b7c03 service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:27.378786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 715/1422] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:46:28.277126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651b8df-58b3-4835-8b41-f9d3b06e7e1a None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:28.277730 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651b8df-58b3-4835-8b41-f9d3b06e7e1a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:28.277730 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651b8df-58b3-4835-8b41-f9d3b06e7e1a None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:28.279254 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 13:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:28.284326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b91abe-0d62-4558-b542-f4b4cb8d9598 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:28.284787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b91abe-0d62-4558-b542-f4b4cb8d9598 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:28.284884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b91abe-0d62-4558-b542-f4b4cb8d9598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:28.304396 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-41b91abe-0d62-4558-b542-f4b4cb8d9598 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:28.305637 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-41b91abe-0d62-4558-b542-f4b4cb8d9598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:28.313467 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 13:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:28.469102 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651b8df-58b3-4835-8b41-f9d3b06e7e1a None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:28.484041 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651b8df-58b3-4835-8b41-f9d3b06e7e1a None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:28.489240 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14670e42-9fc7-4ebc-84ce-bf4f65524cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:28.489885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14670e42-9fc7-4ebc-84ce-bf4f65524cf2 service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:28.490233 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14670e42-9fc7-4ebc-84ce-bf4f65524cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:28.490508 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14670e42-9fc7-4ebc-84ce-bf4f65524cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:28.498372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14670e42-9fc7-4ebc-84ce-bf4f65524cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:28.499933 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14670e42-9fc7-4ebc-84ce-bf4f65524cf2 service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:28.509384 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 709/1425] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:46:29.422139 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08282cc9-59d4-4f67-961a-7a49860ef625 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:29.422586 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08282cc9-59d4-4f67-961a-7a49860ef625 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:29.422732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08282cc9-59d4-4f67-961a-7a49860ef625 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:29.424147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 13:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:29.428924 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3114c-457a-4dd4-8c2e-df40c3c4f33b None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:29.429374 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3114c-457a-4dd4-8c2e-df40c3c4f33b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:29.429524 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3114c-457a-4dd4-8c2e-df40c3c4f33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:29.447726 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-f6c3114c-457a-4dd4-8c2e-df40c3c4f33b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:29.448915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f6c3114c-457a-4dd4-8c2e-df40c3c4f33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:29.456667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 13:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:29.606327 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08282cc9-59d4-4f67-961a-7a49860ef625 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:29.620168 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08282cc9-59d4-4f67-961a-7a49860ef625 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:29.625435 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360bec5-cccf-4c1f-b167-60477d8b0eaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:29.626062 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360bec5-cccf-4c1f-b167-60477d8b0eaa service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:29.626341 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360bec5-cccf-4c1f-b167-60477d8b0eaa service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:29.626617 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360bec5-cccf-4c1f-b167-60477d8b0eaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:29.635295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360bec5-cccf-4c1f-b167-60477d8b0eaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:29.636786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360bec5-cccf-4c1f-b167-60477d8b0eaa service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:29.645855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 718/1428] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:46:30.495939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec981f5-e946-4588-98b8-3d8ebd4af3e2 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:30.496542 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec981f5-e946-4588-98b8-3d8ebd4af3e2 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:30.496542 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec981f5-e946-4588-98b8-3d8ebd4af3e2 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:30.497944 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 13:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:30.502967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ac06f-8787-4be8-abb1-dd0042ad1bf4 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:30.503401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ac06f-8787-4be8-abb1-dd0042ad1bf4 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:30.503555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ac06f-8787-4be8-abb1-dd0042ad1bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:30.523545 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-039ac06f-8787-4be8-abb1-dd0042ad1bf4 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:30.524821 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-039ac06f-8787-4be8-abb1-dd0042ad1bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:30.532824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 13:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:30.681475 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec981f5-e946-4588-98b8-3d8ebd4af3e2 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:30.695580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec981f5-e946-4588-98b8-3d8ebd4af3e2 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:30.701169 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613f5f2-1a2d-487d-a557-1133a2fd6808 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:30.701831 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613f5f2-1a2d-487d-a557-1133a2fd6808 service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:30.702114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613f5f2-1a2d-487d-a557-1133a2fd6808 service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:30.702389 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613f5f2-1a2d-487d-a557-1133a2fd6808 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:30.711058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613f5f2-1a2d-487d-a557-1133a2fd6808 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:30.712640 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613f5f2-1a2d-487d-a557-1133a2fd6808 service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:30.721932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 712/1431] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:46:31.567658 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871de1be-8611-4c19-b584-713026db608c None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:31.568802 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871de1be-8611-4c19-b584-713026db608c None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:31.568932 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871de1be-8611-4c19-b584-713026db608c None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:31.570354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 13:46:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:31.575489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da846b4d-8c7a-4592-a18f-d4cdc081d66d None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:31.575913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da846b4d-8c7a-4592-a18f-d4cdc081d66d None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:31.576053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da846b4d-8c7a-4592-a18f-d4cdc081d66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:31.593656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-da846b4d-8c7a-4592-a18f-d4cdc081d66d None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:31.594851 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-da846b4d-8c7a-4592-a18f-d4cdc081d66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:31.605679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 13:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:31.760716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871de1be-8611-4c19-b584-713026db608c None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:31.775080 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871de1be-8611-4c19-b584-713026db608c None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:31.780462 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423f89e-5be6-4d02-b120-bd3c55f750f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:31.781097 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423f89e-5be6-4d02-b120-bd3c55f750f9 service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:31.781416 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423f89e-5be6-4d02-b120-bd3c55f750f9 service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:31.781698 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423f89e-5be6-4d02-b120-bd3c55f750f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:31.790357 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423f89e-5be6-4d02-b120-bd3c55f750f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:31.791925 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423f89e-5be6-4d02-b120-bd3c55f750f9 service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:31.801221 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 721/1434] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:46:32.654430 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9ff98-e586-4ae4-87cc-e080f1f3f0b4 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:32.655024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9ff98-e586-4ae4-87cc-e080f1f3f0b4 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:32.655024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9ff98-e586-4ae4-87cc-e080f1f3f0b4 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:32.656419 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 13:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:32.665483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18a7f5-86b6-4bad-a6ed-81e1bf3b5353 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:32.665938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18a7f5-86b6-4bad-a6ed-81e1bf3b5353 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:32.666054 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18a7f5-86b6-4bad-a6ed-81e1bf3b5353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:32.686884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-ad18a7f5-86b6-4bad-a6ed-81e1bf3b5353 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:32.688097 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ad18a7f5-86b6-4bad-a6ed-81e1bf3b5353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:32.696759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 13:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:32.844896 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9ff98-e586-4ae4-87cc-e080f1f3f0b4 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:32.859063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9ff98-e586-4ae4-87cc-e080f1f3f0b4 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:32.864380 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc27faa-cca3-4a7a-aa76-8a12fbba2656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:32.865009 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc27faa-cca3-4a7a-aa76-8a12fbba2656 service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:32.865323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc27faa-cca3-4a7a-aa76-8a12fbba2656 service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:32.865604 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc27faa-cca3-4a7a-aa76-8a12fbba2656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:32.874177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc27faa-cca3-4a7a-aa76-8a12fbba2656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:32.875752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc27faa-cca3-4a7a-aa76-8a12fbba2656 service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:32.885716 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 715/1437] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:46:33.732478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c874590-e875-413e-a32a-19e4ae8a02ec None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:33.733075 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c874590-e875-413e-a32a-19e4ae8a02ec None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:33.733075 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c874590-e875-413e-a32a-19e4ae8a02ec None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:33.734466 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 13:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:33.739406 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2ce70-f469-4064-9dee-edf81c8eb018 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:33.739832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2ce70-f469-4064-9dee-edf81c8eb018 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:33.739944 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2ce70-f469-4064-9dee-edf81c8eb018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:33.759728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-c0d2ce70-f469-4064-9dee-edf81c8eb018 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:33.760946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c0d2ce70-f469-4064-9dee-edf81c8eb018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:33.768646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:33.916380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c874590-e875-413e-a32a-19e4ae8a02ec None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:33.930874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c874590-e875-413e-a32a-19e4ae8a02ec None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:33.936163 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4244e-9d2a-4c1b-93e7-2098352ba97d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:33.936722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4244e-9d2a-4c1b-93e7-2098352ba97d service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:33.937003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4244e-9d2a-4c1b-93e7-2098352ba97d service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:33.937302 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4244e-9d2a-4c1b-93e7-2098352ba97d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:33.945662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4244e-9d2a-4c1b-93e7-2098352ba97d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:33.947247 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4244e-9d2a-4c1b-93e7-2098352ba97d service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:33.956467 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 724/1440] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:46:36.038059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac2952-e1f6-440d-9b2d-06971240bbac None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:36.039171 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac2952-e1f6-440d-9b2d-06971240bbac None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:36.039171 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac2952-e1f6-440d-9b2d-06971240bbac None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:36.040564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 13:46:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:36.045816 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660244b8-fe3c-4988-88d5-e2a0d08d10b7 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:36.046266 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660244b8-fe3c-4988-88d5-e2a0d08d10b7 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:36.046364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660244b8-fe3c-4988-88d5-e2a0d08d10b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:36.063631 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-660244b8-fe3c-4988-88d5-e2a0d08d10b7 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:36.064814 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-660244b8-fe3c-4988-88d5-e2a0d08d10b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:36.072422 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 13:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:36.110746 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac2952-e1f6-440d-9b2d-06971240bbac None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:36.121448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac2952-e1f6-440d-9b2d-06971240bbac None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:36.124867 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c4841-00b0-421b-8199-98ce800aee97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:36.125514 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c4841-00b0-421b-8199-98ce800aee97 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:36.125794 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c4841-00b0-421b-8199-98ce800aee97 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:36.126061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c4841-00b0-421b-8199-98ce800aee97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:36.134942 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c4841-00b0-421b-8199-98ce800aee97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:36.136357 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c4841-00b0-421b-8199-98ce800aee97 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:36.145570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 718/1443] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:46:38.558681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38b0fb-1b6c-4e80-82c6-acddb9e2b0ba None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:38.559218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38b0fb-1b6c-4e80-82c6-acddb9e2b0ba None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:38.559218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38b0fb-1b6c-4e80-82c6-acddb9e2b0ba None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:38.560632 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 13:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:38.566013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc67152-247d-469b-bcf5-2210f015e05a None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:38.566413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc67152-247d-469b-bcf5-2210f015e05a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:38.566675 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc67152-247d-469b-bcf5-2210f015e05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:38.584445 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-5fc67152-247d-469b-bcf5-2210f015e05a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:38.586219 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-5fc67152-247d-469b-bcf5-2210f015e05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:38.593879 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 13:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:38.631012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38b0fb-1b6c-4e80-82c6-acddb9e2b0ba None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:38.642050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38b0fb-1b6c-4e80-82c6-acddb9e2b0ba None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:38.645496 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b895fe1-b3fc-4be5-95fe-23b430a625a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:38.646118 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b895fe1-b3fc-4be5-95fe-23b430a625a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:38.646395 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b895fe1-b3fc-4be5-95fe-23b430a625a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:38.646671 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b895fe1-b3fc-4be5-95fe-23b430a625a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:38.655765 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b895fe1-b3fc-4be5-95fe-23b430a625a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:38.657160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b895fe1-b3fc-4be5-95fe-23b430a625a8 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:38.666546 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 727/1446] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:46:41.185955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cce551-c30f-4299-b535-1aff1b1f45d7 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:41.186499 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cce551-c30f-4299-b535-1aff1b1f45d7 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:41.186499 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cce551-c30f-4299-b535-1aff1b1f45d7 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:41.187861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 13:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:41.193156 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb4c20-3e43-45ed-bc08-31b2db3b72f4 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:41.193613 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb4c20-3e43-45ed-bc08-31b2db3b72f4 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:41.193753 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb4c20-3e43-45ed-bc08-31b2db3b72f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:41.211545 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-38eb4c20-3e43-45ed-bc08-31b2db3b72f4 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:41.212735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-38eb4c20-3e43-45ed-bc08-31b2db3b72f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:41.220413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 13:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:41.258855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cce551-c30f-4299-b535-1aff1b1f45d7 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:41.269348 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cce551-c30f-4299-b535-1aff1b1f45d7 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:41.272804 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af6aab-f3f9-4ce5-9abf-c3811e56f6a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:41.273425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af6aab-f3f9-4ce5-9abf-c3811e56f6a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:41.273747 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af6aab-f3f9-4ce5-9abf-c3811e56f6a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:41.274022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af6aab-f3f9-4ce5-9abf-c3811e56f6a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:41.282926 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af6aab-f3f9-4ce5-9abf-c3811e56f6a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:41.284350 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af6aab-f3f9-4ce5-9abf-c3811e56f6a6 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:41.293490 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 721/1449] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:46:43.586038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebfd04-37dd-4293-b23c-00835d02da0a None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:43.586612 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebfd04-37dd-4293-b23c-00835d02da0a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:43.586612 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebfd04-37dd-4293-b23c-00835d02da0a None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:43.587874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 13:46:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:43.593239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537a873-f6ce-482a-bf24-2822429aff33 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:43.593673 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537a873-f6ce-482a-bf24-2822429aff33 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:43.593861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537a873-f6ce-482a-bf24-2822429aff33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:43.611733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-0537a873-f6ce-482a-bf24-2822429aff33 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:43.612914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-0537a873-f6ce-482a-bf24-2822429aff33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:43.620673 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 13:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:43.658437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebfd04-37dd-4293-b23c-00835d02da0a None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:43.669784 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebfd04-37dd-4293-b23c-00835d02da0a None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:43.673233 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d0f68-f997-46b6-a543-d0e2ab7de329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:43.673890 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d0f68-f997-46b6-a543-d0e2ab7de329 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:43.674174 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d0f68-f997-46b6-a543-d0e2ab7de329 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:43.674450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d0f68-f997-46b6-a543-d0e2ab7de329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:43.683936 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d0f68-f997-46b6-a543-d0e2ab7de329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:43.685406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d0f68-f997-46b6-a543-d0e2ab7de329 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:43.695128 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 730/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:46:45.952585 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1cd73-3a75-470e-b759-893d6b0abfaf None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:45.953137 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1cd73-3a75-470e-b759-893d6b0abfaf None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:45.953137 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1cd73-3a75-470e-b759-893d6b0abfaf None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:45.954455 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 13:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:45.959824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124bc78-89e5-494a-a185-829d72dbe7e8 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:45.960251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124bc78-89e5-494a-a185-829d72dbe7e8 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:45.960977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124bc78-89e5-494a-a185-829d72dbe7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:45.979105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-4124bc78-89e5-494a-a185-829d72dbe7e8 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:45.980523 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-4124bc78-89e5-494a-a185-829d72dbe7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:45.989141 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 13:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:46.027600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1cd73-3a75-470e-b759-893d6b0abfaf None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:46.038124 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1cd73-3a75-470e-b759-893d6b0abfaf None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:46.041673 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bad440-c6a3-4bc6-9f12-d1ce513b84f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:46.042300 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bad440-c6a3-4bc6-9f12-d1ce513b84f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:46.042601 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bad440-c6a3-4bc6-9f12-d1ce513b84f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:46.042862 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bad440-c6a3-4bc6-9f12-d1ce513b84f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:46.051583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bad440-c6a3-4bc6-9f12-d1ce513b84f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:46.053006 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bad440-c6a3-4bc6-9f12-d1ce513b84f8 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:46.064865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 724/1455] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:46:48.311415 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191365d5-0f00-4980-bc5d-a5569b176a89 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:48.311981 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191365d5-0f00-4980-bc5d-a5569b176a89 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:48.311981 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191365d5-0f00-4980-bc5d-a5569b176a89 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:48.313359 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 13:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:48.318546 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859a73b-1a1b-4a06-88aa-e00bc7a55f4b None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:48.318980 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859a73b-1a1b-4a06-88aa-e00bc7a55f4b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:48.319195 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859a73b-1a1b-4a06-88aa-e00bc7a55f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:48.337474 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-e859a73b-1a1b-4a06-88aa-e00bc7a55f4b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:48.338673 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e859a73b-1a1b-4a06-88aa-e00bc7a55f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:48.346223 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 13:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:48.386828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191365d5-0f00-4980-bc5d-a5569b176a89 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:48.397509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191365d5-0f00-4980-bc5d-a5569b176a89 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:48.401636 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0610b-33f9-4f34-b1ff-c63f6a4fb94b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:48.402258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0610b-33f9-4f34-b1ff-c63f6a4fb94b service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:48.402537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0610b-33f9-4f34-b1ff-c63f6a4fb94b service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:48.402807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0610b-33f9-4f34-b1ff-c63f6a4fb94b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:48.411645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0610b-33f9-4f34-b1ff-c63f6a4fb94b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:48.413047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0610b-33f9-4f34-b1ff-c63f6a4fb94b service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:48.422150 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 733/1458] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:46:50.671501 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed546326-de2a-41e5-a553-b52b35688689 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:50.672042 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed546326-de2a-41e5-a553-b52b35688689 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:50.672141 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed546326-de2a-41e5-a553-b52b35688689 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:50.673551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 13:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:50.679096 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216438c-3356-4212-8307-338146e949fa None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:50.679525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216438c-3356-4212-8307-338146e949fa None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:50.679683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216438c-3356-4212-8307-338146e949fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:50.685707 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=70 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:46:50.699216 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-8216438c-3356-4212-8307-338146e949fa None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:50.700399 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8216438c-3356-4212-8307-338146e949fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:50.707981 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 13:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:46:50.746271 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed546326-de2a-41e5-a553-b52b35688689 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:50.751703 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=73 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:46:50.758934 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed546326-de2a-41e5-a553-b52b35688689 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:50.762407 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a85701-1f09-40aa-9173-fe73d38a60c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:50.763040 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a85701-1f09-40aa-9173-fe73d38a60c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:50.763327 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a85701-1f09-40aa-9173-fe73d38a60c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:50.763607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a85701-1f09-40aa-9173-fe73d38a60c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:50.772311 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a85701-1f09-40aa-9173-fe73d38a60c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:50.774306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a85701-1f09-40aa-9173-fe73d38a60c6 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:50.783527 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 727/1461] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:46:53.011657 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14247b49-6353-4f4d-bd69-beb20a771fba None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:53.012215 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14247b49-6353-4f4d-bd69-beb20a771fba None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:53.012215 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14247b49-6353-4f4d-bd69-beb20a771fba None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:53.013590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 13:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:53.018767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bebfe-be31-498e-be61-18c2a3cbb117 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:53.019156 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bebfe-be31-498e-be61-18c2a3cbb117 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:53.019327 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bebfe-be31-498e-be61-18c2a3cbb117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:53.037237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-6b3bebfe-be31-498e-be61-18c2a3cbb117 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:53.038448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6b3bebfe-be31-498e-be61-18c2a3cbb117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:53.046252 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:53.082838 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14247b49-6353-4f4d-bd69-beb20a771fba None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:53.093880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14247b49-6353-4f4d-bd69-beb20a771fba None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:53.097328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196bc85-a020-4e2f-801d-7fa69e30601e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:53.097950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196bc85-a020-4e2f-801d-7fa69e30601e service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:53.098226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196bc85-a020-4e2f-801d-7fa69e30601e service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:53.098497 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196bc85-a020-4e2f-801d-7fa69e30601e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:53.107299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196bc85-a020-4e2f-801d-7fa69e30601e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:53.108715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196bc85-a020-4e2f-801d-7fa69e30601e service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:53.118294 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 736/1464] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:46:55.319135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3457e0d-858f-4b1a-a68a-d07ed55ecb48 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:55.320166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3457e0d-858f-4b1a-a68a-d07ed55ecb48 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:55.320264 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3457e0d-858f-4b1a-a68a-d07ed55ecb48 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:55.321610 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 13:46:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:55.326943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8766715-3b60-4188-aea8-a05408f0ed93 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:55.327369 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8766715-3b60-4188-aea8-a05408f0ed93 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:55.327505 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8766715-3b60-4188-aea8-a05408f0ed93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:55.345503 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-d8766715-3b60-4188-aea8-a05408f0ed93 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:55.346683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d8766715-3b60-4188-aea8-a05408f0ed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:55.354330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 13:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:55.390623 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3457e0d-858f-4b1a-a68a-d07ed55ecb48 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:55.401108 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3457e0d-858f-4b1a-a68a-d07ed55ecb48 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:55.404554 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16887fde-e500-4b59-9412-efc51a6ed998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:55.405225 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16887fde-e500-4b59-9412-efc51a6ed998 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:55.405531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16887fde-e500-4b59-9412-efc51a6ed998 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:55.405801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16887fde-e500-4b59-9412-efc51a6ed998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:55.414398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16887fde-e500-4b59-9412-efc51a6ed998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:55.415815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16887fde-e500-4b59-9412-efc51a6ed998 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:55.424849 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 730/1467] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:46:57.621249 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245f5c4-e3b2-4164-a3d6-2e58a1e7b37d None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:57.621834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245f5c4-e3b2-4164-a3d6-2e58a1e7b37d None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:57.621834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245f5c4-e3b2-4164-a3d6-2e58a1e7b37d None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:57.623304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 13:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:46:57.628611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293dae7-d2b1-4fbe-86c9-5878ed884b95 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:57.629013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293dae7-d2b1-4fbe-86c9-5878ed884b95 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:57.629232 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293dae7-d2b1-4fbe-86c9-5878ed884b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:57.647498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-2293dae7-d2b1-4fbe-86c9-5878ed884b95 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:46:57.648628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-2293dae7-d2b1-4fbe-86c9-5878ed884b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:46:57.656432 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:46:57.692300 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245f5c4-e3b2-4164-a3d6-2e58a1e7b37d None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:46:57.703296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245f5c4-e3b2-4164-a3d6-2e58a1e7b37d None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:46:57.706677 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b0949-89c6-4151-87f2-80bdb95f1568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:46:57.707298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b0949-89c6-4151-87f2-80bdb95f1568 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:46:57.707576 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b0949-89c6-4151-87f2-80bdb95f1568 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:46:57.707847 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b0949-89c6-4151-87f2-80bdb95f1568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:46:57.716419 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b0949-89c6-4151-87f2-80bdb95f1568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:46:57.717849 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b0949-89c6-4151-87f2-80bdb95f1568 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:46:57.726913 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 739/1470] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:47:07.642421 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=17 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:07.722859 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=17 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:30.719653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50311fd8-0528-4bc7-8fb8-dfe595391859 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:30.720172 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50311fd8-0528-4bc7-8fb8-dfe595391859 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:30.720277 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50311fd8-0528-4bc7-8fb8-dfe595391859 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:30.721626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 732/1471] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:47:30.727434 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b01e44-be8d-4a55-96d2-15967130bbc8 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:30.727866 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b01e44-be8d-4a55-96d2-15967130bbc8 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:30.727979 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b01e44-be8d-4a55-96d2-15967130bbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:30.745169 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-b5b01e44-be8d-4a55-96d2-15967130bbc8 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:47:30.746400 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-b5b01e44-be8d-4a55-96d2-15967130bbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:47:30.754094 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 740/1472] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:47:30.800808 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb88028-d3bf-469d-9b90-72ec877bc20b None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:30.801096 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb88028-d3bf-469d-9b90-72ec877bc20b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:30.801430 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb88028-d3bf-469d-9b90-72ec877bc20b None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:30.802755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 733/1473] 10.222.0.45 () {54 vars in 962 bytes} [Thu May 26 13:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:47:30.807566 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e107f4c-680b-4aa7-95ea-3e7949c61108 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:30.807860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e107f4c-680b-4aa7-95ea-3e7949c61108 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:30.808142 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e107f4c-680b-4aa7-95ea-3e7949c61108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:30.825658 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-1e107f4c-680b-4aa7-95ea-3e7949c61108 None None] MFA Rules not processed for user `e3039ec7e613464c8a71f4440dfe8bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:47:30.826842 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-1e107f4c-680b-4aa7-95ea-3e7949c61108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:47:30.833212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 741/1474] 10.222.0.45 () {58 vars in 1059 bytes} [Thu May 26 13:47:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:47:30.841006 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb88028-d3bf-469d-9b90-72ec877bc20b None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:47:30.851935 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb88028-d3bf-469d-9b90-72ec877bc20b None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:47:30.855543 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2cb4f-1690-43e2-bd72-def3955dfc7e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3039ec7e613464c8a71f4440dfe8bc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:47:30.856166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2cb4f-1690-43e2-bd72-def3955dfc7e service glance] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:30.856444 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2cb4f-1690-43e2-bd72-def3955dfc7e service glance] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:30.856715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2cb4f-1690-43e2-bd72-def3955dfc7e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:30.865889 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2cb4f-1690-43e2-bd72-def3955dfc7e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:47:30.867357 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2cb4f-1690-43e2-bd72-def3955dfc7e service glance] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:47:30.876590 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 734/1475] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:47:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:47:33.169159 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b7d61-b5f1-406b-a63a-4bfffbb6561f None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:33.169737 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b7d61-b5f1-406b-a63a-4bfffbb6561f None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:33.169737 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b7d61-b5f1-406b-a63a-4bfffbb6561f None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:33.171118 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 742/1476] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:47:33.176247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d4338-b1f7-45c7-bff3-9d85bca1af13 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:33.176649 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d4338-b1f7-45c7-bff3-9d85bca1af13 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:33.176804 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d4338-b1f7-45c7-bff3-9d85bca1af13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:33.195379 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-cc0d4338-b1f7-45c7-bff3-9d85bca1af13 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:47:33.196545 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-cc0d4338-b1f7-45c7-bff3-9d85bca1af13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:47:33.204155 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 735/1477] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:47:33.227765 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b7d61-b5f1-406b-a63a-4bfffbb6561f None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:47:33.239890 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b7d61-b5f1-406b-a63a-4bfffbb6561f None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:47:33.244954 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce793710-0c5c-4061-accf-85599a542d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:47:33.245619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce793710-0c5c-4061-accf-85599a542d45 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:33.245902 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce793710-0c5c-4061-accf-85599a542d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:33.246179 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce793710-0c5c-4061-accf-85599a542d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:33.246900 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce793710-0c5c-4061-accf-85599a542d45 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:47:33.248627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: WARNING py.warnings [None req-ce793710-0c5c-4061-accf-85599a542d45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 13:47:33.248627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: warnings.warn(msg) May 26 13:47:33.248627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: May 26 13:47:33.249803 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce793710-0c5c-4061-accf-85599a542d45 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:47:33.268819 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 743/1478] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 13:47:33 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:47:35.484238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a3ce5-9c58-49d5-8551-e8605bef6bd9 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:35.484781 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a3ce5-9c58-49d5-8551-e8605bef6bd9 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:35.484781 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a3ce5-9c58-49d5-8551-e8605bef6bd9 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:35.486152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 736/1479] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:47:35.492128 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a10ec-589b-4e5d-9e05-4c3d97553905 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:35.492535 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a10ec-589b-4e5d-9e05-4c3d97553905 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:35.492718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a10ec-589b-4e5d-9e05-4c3d97553905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:35.510957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-c82a10ec-589b-4e5d-9e05-4c3d97553905 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:47:35.512146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-c82a10ec-589b-4e5d-9e05-4c3d97553905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:47:35.519765 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 744/1480] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:47:35.562613 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a3ce5-9c58-49d5-8551-e8605bef6bd9 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:47:35.576744 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a3ce5-9c58-49d5-8551-e8605bef6bd9 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:47:35.582314 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572b85b-5d10-4bbe-8570-3796f38dc25a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:47:35.582942 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572b85b-5d10-4bbe-8570-3796f38dc25a service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:35.583226 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572b85b-5d10-4bbe-8570-3796f38dc25a service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:35.583510 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572b85b-5d10-4bbe-8570-3796f38dc25a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:35.591401 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572b85b-5d10-4bbe-8570-3796f38dc25a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:47:35.592977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572b85b-5d10-4bbe-8570-3796f38dc25a service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:47:35.602613 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 737/1481] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:47:37.988471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14200906-c461-4a36-9317-eafe5f64c19e None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:37.988978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14200906-c461-4a36-9317-eafe5f64c19e None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:37.988978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14200906-c461-4a36-9317-eafe5f64c19e None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:37.990353 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 745/1482] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:47:37.995737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9159a-f8bf-493f-a25f-52b3f29168fd None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:37.996145 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9159a-f8bf-493f-a25f-52b3f29168fd None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:37.996390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9159a-f8bf-493f-a25f-52b3f29168fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:38.014400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-c1a9159a-f8bf-493f-a25f-52b3f29168fd None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:47:38.015566 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c1a9159a-f8bf-493f-a25f-52b3f29168fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:47:38.023811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 738/1483] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:47:38.058817 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14200906-c461-4a36-9317-eafe5f64c19e None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:47:38.069816 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14200906-c461-4a36-9317-eafe5f64c19e None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:47:38.073219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58d24d-7979-49ba-926f-829f63cede1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:47:38.073859 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58d24d-7979-49ba-926f-829f63cede1d service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:38.074138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58d24d-7979-49ba-926f-829f63cede1d service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:38.074411 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58d24d-7979-49ba-926f-829f63cede1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:38.082980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58d24d-7979-49ba-926f-829f63cede1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:47:38.084402 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58d24d-7979-49ba-926f-829f63cede1d service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:47:38.094342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 746/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:47:40.355058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fa6bb-29ee-4a68-99f1-71ef4a54a866 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:40.355648 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fa6bb-29ee-4a68-99f1-71ef4a54a866 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:40.355648 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fa6bb-29ee-4a68-99f1-71ef4a54a866 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:40.357035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 739/1485] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:47:40.362329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4254e-6431-4e5e-8702-6be0ea38d844 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:40.362748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4254e-6431-4e5e-8702-6be0ea38d844 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:40.362885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4254e-6431-4e5e-8702-6be0ea38d844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:40.381953 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-47e4254e-6431-4e5e-8702-6be0ea38d844 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:47:40.383146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-47e4254e-6431-4e5e-8702-6be0ea38d844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:47:40.390934 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 747/1486] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:47:40.429036 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fa6bb-29ee-4a68-99f1-71ef4a54a866 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:47:40.439703 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fa6bb-29ee-4a68-99f1-71ef4a54a866 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:47:40.443201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bc7b3-e39b-4453-bd12-8dd45e939f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:47:40.443860 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bc7b3-e39b-4453-bd12-8dd45e939f35 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:40.444145 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bc7b3-e39b-4453-bd12-8dd45e939f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:40.444424 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bc7b3-e39b-4453-bd12-8dd45e939f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:40.453201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bc7b3-e39b-4453-bd12-8dd45e939f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:47:40.454670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bc7b3-e39b-4453-bd12-8dd45e939f35 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:47:40.464362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 740/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:47:42.757946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf0dc5-cb69-4a9f-91d7-7ee1e814989e None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:42.758712 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf0dc5-cb69-4a9f-91d7-7ee1e814989e None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:42.758712 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf0dc5-cb69-4a9f-91d7-7ee1e814989e None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:42.760119 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 748/1488] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:47:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:47:42.765479 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c42bc-636e-4c6e-933c-e330d65700a6 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:42.765921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c42bc-636e-4c6e-933c-e330d65700a6 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:42.766062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c42bc-636e-4c6e-933c-e330d65700a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:42.783880 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-b01c42bc-636e-4c6e-933c-e330d65700a6 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:47:42.785076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-b01c42bc-636e-4c6e-933c-e330d65700a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:47:42.793552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 741/1489] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:47:42.832712 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf0dc5-cb69-4a9f-91d7-7ee1e814989e None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:47:42.843643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf0dc5-cb69-4a9f-91d7-7ee1e814989e None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:47:42.847082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82bdb3-fbb7-4ea5-b292-7ad5d6e93cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:47:42.847701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82bdb3-fbb7-4ea5-b292-7ad5d6e93cfb service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:42.847981 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82bdb3-fbb7-4ea5-b292-7ad5d6e93cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:42.848255 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82bdb3-fbb7-4ea5-b292-7ad5d6e93cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:42.857771 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82bdb3-fbb7-4ea5-b292-7ad5d6e93cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:47:42.859181 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82bdb3-fbb7-4ea5-b292-7ad5d6e93cfb service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:47:42.868261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 749/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:47:45.234390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa332cae-6c3e-48ae-b4a0-ecd71417c0a5 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:45.234999 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa332cae-6c3e-48ae-b4a0-ecd71417c0a5 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:45.234999 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa332cae-6c3e-48ae-b4a0-ecd71417c0a5 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:45.236283 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 742/1491] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 13:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:47:45.241544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12d715-d7f1-4d55-87f4-b68ada943967 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:45.241999 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12d715-d7f1-4d55-87f4-b68ada943967 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:45.242109 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12d715-d7f1-4d55-87f4-b68ada943967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:45.260385 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-cf12d715-d7f1-4d55-87f4-b68ada943967 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:47:45.261615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-cf12d715-d7f1-4d55-87f4-b68ada943967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:47:45.269534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 750/1492] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 13:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:47:45.307494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa332cae-6c3e-48ae-b4a0-ecd71417c0a5 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:47:45.318278 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa332cae-6c3e-48ae-b4a0-ecd71417c0a5 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:47:45.322360 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6441b6-96c1-4110-9638-5f276c8c4e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:47:45.322989 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6441b6-96c1-4110-9638-5f276c8c4e0c service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:47:45.323273 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6441b6-96c1-4110-9638-5f276c8c4e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:47:45.323551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6441b6-96c1-4110-9638-5f276c8c4e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:47:45.332313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6441b6-96c1-4110-9638-5f276c8c4e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:47:45.333779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6441b6-96c1-4110-9638-5f276c8c4e0c service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:47:45.343607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 743/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:47:55.254269 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=33 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:55.339509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=33 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:49:25.422292 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13cb91-1b8a-40d7-b28e-266e04cd0b3b None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:49:25.422890 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13cb91-1b8a-40d7-b28e-266e04cd0b3b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:49:25.422890 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13cb91-1b8a-40d7-b28e-266e04cd0b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:49:25.441149 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-5f13cb91-1b8a-40d7-b28e-266e04cd0b3b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:49:25.442911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-5f13cb91-1b8a-40d7-b28e-266e04cd0b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:49:25.451271 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 751/1494] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:49:25.460344 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fb234-da0a-4f57-836a-0d54e5060918 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:49:25.460853 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fb234-da0a-4f57-836a-0d54e5060918 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:49:25.460959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fb234-da0a-4f57-836a-0d54e5060918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:49:25.478883 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-e50fb234-da0a-4f57-836a-0d54e5060918 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:49:25.480082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e50fb234-da0a-4f57-836a-0d54e5060918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:49:25.487877 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 744/1495] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:49:25.493076 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13cb91-1b8a-40d7-b28e-266e04cd0b3b None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:49:25.502722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13cb91-1b8a-40d7-b28e-266e04cd0b3b None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:49:25.507949 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512539fa-1910-4829-8afe-31b5b6bc29f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:49:25.508596 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512539fa-1910-4829-8afe-31b5b6bc29f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:49:25.508880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512539fa-1910-4829-8afe-31b5b6bc29f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:49:25.509159 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512539fa-1910-4829-8afe-31b5b6bc29f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:49:25.510002 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512539fa-1910-4829-8afe-31b5b6bc29f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:49:25.510339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512539fa-1910-4829-8afe-31b5b6bc29f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:49:25.511344 dv-cinder-842130-1-smb devstack@keystone.service[91767]: WARNING py.warnings [None req-512539fa-1910-4829-8afe-31b5b6bc29f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:49:25.511344 dv-cinder-842130-1-smb devstack@keystone.service[91767]: warnings.warn(msg) May 26 13:49:25.511344 dv-cinder-842130-1-smb devstack@keystone.service[91767]: May 26 13:49:25.512212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512539fa-1910-4829-8afe-31b5b6bc29f3 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:49:25.523469 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 752/1496] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:49:25.531324 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fb234-da0a-4f57-836a-0d54e5060918 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:49:25.540279 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fb234-da0a-4f57-836a-0d54e5060918 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:49:25.544744 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7038e6-b93c-4f6e-97fb-d6f2ab05dc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:49:25.545422 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7038e6-b93c-4f6e-97fb-d6f2ab05dc56 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:49:25.545711 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7038e6-b93c-4f6e-97fb-d6f2ab05dc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:49:25.545991 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7038e6-b93c-4f6e-97fb-d6f2ab05dc56 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:49:25.546678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7038e6-b93c-4f6e-97fb-d6f2ab05dc56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:49:25.548563 dv-cinder-842130-1-smb devstack@keystone.service[91766]: WARNING py.warnings [None req-bb7038e6-b93c-4f6e-97fb-d6f2ab05dc56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 13:49:25.548563 dv-cinder-842130-1-smb devstack@keystone.service[91766]: warnings.warn(msg) May 26 13:49:25.548563 dv-cinder-842130-1-smb devstack@keystone.service[91766]: May 26 13:49:25.549793 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7038e6-b93c-4f6e-97fb-d6f2ab05dc56 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:49:25.586497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 745/1497] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:49:25 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:49:25.590810 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512539fa-1910-4829-8afe-31b5b6bc29f3 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:49:25.600448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512539fa-1910-4829-8afe-31b5b6bc29f3 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:49:25.661961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dd0b3-82c7-4549-81b3-9d91306cbeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:49:25.662627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dd0b3-82c7-4549-81b3-9d91306cbeec admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:49:25.662910 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dd0b3-82c7-4549-81b3-9d91306cbeec admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:49:25.663184 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dd0b3-82c7-4549-81b3-9d91306cbeec admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:49:25.663904 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dd0b3-82c7-4549-81b3-9d91306cbeec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:49:25.664901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: WARNING py.warnings [None req-287dd0b3-82c7-4549-81b3-9d91306cbeec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 13:49:25.664901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: warnings.warn(msg) May 26 13:49:25.664901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: May 26 13:49:25.666120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dd0b3-82c7-4549-81b3-9d91306cbeec admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:49:25.686579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 753/1498] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:49:25 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:49:25.690691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7038e6-b93c-4f6e-97fb-d6f2ab05dc56 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:49:25.701298 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7038e6-b93c-4f6e-97fb-d6f2ab05dc56 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:49:25.705738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e9ed6-6856-42fd-b6f5-ce7e5a0de26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:49:25.706394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e9ed6-6856-42fd-b6f5-ce7e5a0de26c admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:49:25.706682 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e9ed6-6856-42fd-b6f5-ce7e5a0de26c admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:49:25.706963 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e9ed6-6856-42fd-b6f5-ce7e5a0de26c admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:49:25.707686 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e9ed6-6856-42fd-b6f5-ce7e5a0de26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:49:25.708695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: WARNING py.warnings [None req-752e9ed6-6856-42fd-b6f5-ce7e5a0de26c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:49:25.708695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: warnings.warn(msg) May 26 13:49:25.708695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: May 26 13:49:25.709611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e9ed6-6856-42fd-b6f5-ce7e5a0de26c admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:49:25.723351 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 746/1499] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:49:25.727342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dd0b3-82c7-4549-81b3-9d91306cbeec admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:49:25.737002 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dd0b3-82c7-4549-81b3-9d91306cbeec admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:49:25.742170 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde41cb2-11ba-4872-ba2a-8c4b19572374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:49:25.742808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde41cb2-11ba-4872-ba2a-8c4b19572374 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:49:25.743088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde41cb2-11ba-4872-ba2a-8c4b19572374 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:49:25.743359 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde41cb2-11ba-4872-ba2a-8c4b19572374 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:49:25.744065 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde41cb2-11ba-4872-ba2a-8c4b19572374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:49:25.745085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: WARNING py.warnings [None req-dde41cb2-11ba-4872-ba2a-8c4b19572374 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:49:25.745085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: warnings.warn(msg) May 26 13:49:25.745085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: May 26 13:49:25.745995 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde41cb2-11ba-4872-ba2a-8c4b19572374 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:49:25.759377 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 754/1500] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:49:25.763478 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e9ed6-6856-42fd-b6f5-ce7e5a0de26c admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:49:25.773231 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e9ed6-6856-42fd-b6f5-ce7e5a0de26c admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:49:25.777758 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c711f4-f31a-4dee-8c3c-8f0062ce995d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:49:25.778626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c711f4-f31a-4dee-8c3c-8f0062ce995d admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:49:25.778909 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c711f4-f31a-4dee-8c3c-8f0062ce995d admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:49:25.779190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c711f4-f31a-4dee-8c3c-8f0062ce995d admin admin] PATH_INFO: `/v3/projects/21405dbd6a8645f6a47f6af45abe2876/users/f7ff29058e8e45e2aa792953ec0041a1/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:49:25.794197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c711f4-f31a-4dee-8c3c-8f0062ce995d admin admin] RBAC: Authorizing `identity:create_grant(project_id=21405dbd6a8645f6a47f6af45abe2876, user_id=f7ff29058e8e45e2aa792953ec0041a1, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:49:25.795222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: WARNING py.warnings [None req-31c711f4-f31a-4dee-8c3c-8f0062ce995d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 13:49:25.795222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: warnings.warn(msg) May 26 13:49:25.795222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: May 26 13:49:25.797164 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c711f4-f31a-4dee-8c3c-8f0062ce995d admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:49:25.810951 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 747/1501] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:49:25 2022] PUT /identity/v3/projects/21405dbd6a8645f6a47f6af45abe2876/users/f7ff29058e8e45e2aa792953ec0041a1/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:49:25.822120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acf748-3573-4faf-a466-9d390aca24b6 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:49:25.822411 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acf748-3573-4faf-a466-9d390aca24b6 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:49:25.822688 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acf748-3573-4faf-a466-9d390aca24b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:49:25.847612 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-01acf748-3573-4faf-a466-9d390aca24b6 None None] MFA Rules not processed for user `f7ff29058e8e45e2aa792953ec0041a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:49:25.849496 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-01acf748-3573-4faf-a466-9d390aca24b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:49:25.912139 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 755/1502] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:49:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:49:25.925046 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2b77c-2463-47b1-bd08-3af003b29908 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:49:25.925374 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2b77c-2463-47b1-bd08-3af003b29908 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:49:25.925660 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2b77c-2463-47b1-bd08-3af003b29908 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:49:25.927566 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 748/1503] 10.222.0.45 () {54 vars in 963 bytes} [Thu May 26 13:49:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:49:25.932365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7c350-c352-4d60-95e8-0700728c7164 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:49:25.932708 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7c350-c352-4d60-95e8-0700728c7164 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:49:25.932948 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7c350-c352-4d60-95e8-0700728c7164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:49:25.950125 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-caa7c350-c352-4d60-95e8-0700728c7164 None None] MFA Rules not processed for user `c8aed4c31eb14a3bbba08bef799ee450`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:49:25.951319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-caa7c350-c352-4d60-95e8-0700728c7164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:49:25.993262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:49:26.001068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 756/1504] 10.222.0.45 () {58 vars in 1060 bytes} [Thu May 26 13:49:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:49:26.111391 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2b77c-2463-47b1-bd08-3af003b29908 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:49:26.122010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2b77c-2463-47b1-bd08-3af003b29908 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:49:26.125487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa702ab5-6ee0-4f0f-bd97-10a12fd04d86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:49:26.126117 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa702ab5-6ee0-4f0f-bd97-10a12fd04d86 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:49:26.126399 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa702ab5-6ee0-4f0f-bd97-10a12fd04d86 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:49:26.126674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa702ab5-6ee0-4f0f-bd97-10a12fd04d86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:49:26.134992 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa702ab5-6ee0-4f0f-bd97-10a12fd04d86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:49:26.136415 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa702ab5-6ee0-4f0f-bd97-10a12fd04d86 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:49:26.145512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 749/1505] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:49:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:49:26.187989 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b18eb-de01-4b2b-856a-8130161c49c2 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:49:26.188278 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b18eb-de01-4b2b-856a-8130161c49c2 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:49:26.188560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b18eb-de01-4b2b-856a-8130161c49c2 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:49:26.189872 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 757/1506] 10.222.0.45 () {52 vars in 829 bytes} [Thu May 26 13:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:49:26.193337 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa702ab5-6ee0-4f0f-bd97-10a12fd04d86 service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:49:26.255035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa702ab5-6ee0-4f0f-bd97-10a12fd04d86 service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:49:26.259806 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9b446-49d6-4b22-af84-59477a0094f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:49:26.260662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9b446-49d6-4b22-af84-59477a0094f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:49:26.260941 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9b446-49d6-4b22-af84-59477a0094f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:49:26.261215 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9b446-49d6-4b22-af84-59477a0094f2 admin admin] PATH_INFO: `/v3/users/f7ff29058e8e45e2aa792953ec0041a1` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:49:26.262403 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9b446-49d6-4b22-af84-59477a0094f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ff29058e8e45e2aa792953ec0041a1)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:49:26.263417 dv-cinder-842130-1-smb devstack@keystone.service[91766]: WARNING py.warnings [None req-ffd9b446-49d6-4b22-af84-59477a0094f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 13:49:26.263417 dv-cinder-842130-1-smb devstack@keystone.service[91766]: warnings.warn(msg) May 26 13:49:26.263417 dv-cinder-842130-1-smb devstack@keystone.service[91766]: May 26 13:49:26.264621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9b446-49d6-4b22-af84-59477a0094f2 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:49:26.327192 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ffd9b446-49d6-4b22-af84-59477a0094f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ff29058e8e45e2aa792953ec0041a1'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:49:26.344964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ffd9b446-49d6-4b22-af84-59477a0094f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ff29058e8e45e2aa792953ec0041a1'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:49:26.345744 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ffd9b446-49d6-4b22-af84-59477a0094f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ff29058e8e45e2aa792953ec0041a1'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:49:26.346391 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ffd9b446-49d6-4b22-af84-59477a0094f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ff29058e8e45e2aa792953ec0041a1'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:49:26.355352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ffd9b446-49d6-4b22-af84-59477a0094f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ff29058e8e45e2aa792953ec0041a1'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:49:26.364308 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:49:26.375325 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 750/1507] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:49:26 2022] DELETE /identity/v3/users/f7ff29058e8e45e2aa792953ec0041a1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:49:26.380582 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625a37c-c634-4633-961b-36e6ab9b7d22 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:49:26.380868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625a37c-c634-4633-961b-36e6ab9b7d22 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:49:26.381142 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625a37c-c634-4633-961b-36e6ab9b7d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:49:26.398352 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-5625a37c-c634-4633-961b-36e6ab9b7d22 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:49:26.399540 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-5625a37c-c634-4633-961b-36e6ab9b7d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:49:26.456261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 758/1508] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:49:26.465578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9b446-49d6-4b22-af84-59477a0094f2 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:49:26.466962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ffd9b446-49d6-4b22-af84-59477a0094f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:49:26.521924 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9b446-49d6-4b22-af84-59477a0094f2 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:49:26.525455 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81041d7-6555-4162-aaf0-038eb5913f1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:49:26.526090 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81041d7-6555-4162-aaf0-038eb5913f1b service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:49:26.526369 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81041d7-6555-4162-aaf0-038eb5913f1b service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:49:26.526644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81041d7-6555-4162-aaf0-038eb5913f1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:49:26.535255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81041d7-6555-4162-aaf0-038eb5913f1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:49:26.537162 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81041d7-6555-4162-aaf0-038eb5913f1b service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:49:26.546217 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 751/1509] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:49:26.952488 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625a37c-c634-4633-961b-36e6ab9b7d22 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:49:26.954004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-5625a37c-c634-4633-961b-36e6ab9b7d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:49:26.966907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625a37c-c634-4633-961b-36e6ab9b7d22 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:49:26.972367 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80391c37-9cdb-4220-ba99-a621343c8a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:49:26.975579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80391c37-9cdb-4220-ba99-a621343c8a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:49:26.976057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80391c37-9cdb-4220-ba99-a621343c8a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:49:26.976534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80391c37-9cdb-4220-ba99-a621343c8a44 admin admin] PATH_INFO: `/v3/projects/21405dbd6a8645f6a47f6af45abe2876` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:49:26.978222 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80391c37-9cdb-4220-ba99-a621343c8a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21405dbd6a8645f6a47f6af45abe2876)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:49:26.980314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: WARNING py.warnings [None req-80391c37-9cdb-4220-ba99-a621343c8a44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 13:49:26.980314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: warnings.warn(msg) May 26 13:49:26.980314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: May 26 13:49:26.982570 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80391c37-9cdb-4220-ba99-a621343c8a44 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:49:27.042287 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-80391c37-9cdb-4220-ba99-a621343c8a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21405dbd6a8645f6a47f6af45abe2876', 'request_id': 'req-80391c37-9cdb-4220-ba99-a621343c8a44'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:49:27.055233 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-80391c37-9cdb-4220-ba99-a621343c8a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21405dbd6a8645f6a47f6af45abe2876', 'request_id': 'req-80391c37-9cdb-4220-ba99-a621343c8a44'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:49:27.065337 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-80391c37-9cdb-4220-ba99-a621343c8a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21405dbd6a8645f6a47f6af45abe2876', 'request_id': 'req-80391c37-9cdb-4220-ba99-a621343c8a44'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:49:27.075997 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-80391c37-9cdb-4220-ba99-a621343c8a44 admin admin] The token cache is being invalidate because project 21405dbd6a8645f6a47f6af45abe2876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:49:27.076284 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-80391c37-9cdb-4220-ba99-a621343c8a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:49:27.076997 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-80391c37-9cdb-4220-ba99-a621343c8a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:49:27.078553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 759/1510] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:49:26 2022] DELETE /identity/v3/projects/21405dbd6a8645f6a47f6af45abe2876 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:49:36.542201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=29 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:49:37.073040 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:51:22.059855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dc37e-a109-481d-bbba-3c5bd196b967 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:22.060467 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dc37e-a109-481d-bbba-3c5bd196b967 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:22.060467 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dc37e-a109-481d-bbba-3c5bd196b967 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:22.061854 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 13:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:51:22.066582 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b07cc-e97b-465d-8733-90e4f1f3fe06 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:22.066994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b07cc-e97b-465d-8733-90e4f1f3fe06 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:22.067152 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b07cc-e97b-465d-8733-90e4f1f3fe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:22.086172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-cc2b07cc-e97b-465d-8733-90e4f1f3fe06 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:51:22.087384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-cc2b07cc-e97b-465d-8733-90e4f1f3fe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:51:22.143862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 13:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:51:22.310350 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3dc37e-a109-481d-bbba-3c5bd196b967 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:51:22.311972 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1f3dc37e-a109-481d-bbba-3c5bd196b967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:51:22.383443 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3dc37e-a109-481d-bbba-3c5bd196b967 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:51:22.389370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf32146-1d1f-45c6-b267-a811453c9cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:51:22.390011 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf32146-1d1f-45c6-b267-a811453c9cbc service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:22.390293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf32146-1d1f-45c6-b267-a811453c9cbc service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:22.390617 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf32146-1d1f-45c6-b267-a811453c9cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:22.402941 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf32146-1d1f-45c6-b267-a811453c9cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:51:22.404797 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf32146-1d1f-45c6-b267-a811453c9cbc service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:51:22.414683 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 753/1513] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:51:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:51:23.286220 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cedafd-29df-4f1d-bf8c-12de9561f264 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:23.286780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cedafd-29df-4f1d-bf8c-12de9561f264 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:23.286780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cedafd-29df-4f1d-bf8c-12de9561f264 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:23.288089 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 13:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:51:23.293418 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ce543-4a0f-404b-b63a-180820941b11 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:23.293852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ce543-4a0f-404b-b63a-180820941b11 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:23.293962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ce543-4a0f-404b-b63a-180820941b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:23.311935 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a70ce543-4a0f-404b-b63a-180820941b11 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:51:23.313136 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a70ce543-4a0f-404b-b63a-180820941b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:51:23.320889 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 13:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:51:23.470177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cedafd-29df-4f1d-bf8c-12de9561f264 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:51:23.484852 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cedafd-29df-4f1d-bf8c-12de9561f264 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:51:23.490205 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c8958-b94a-4e27-a432-e08b8ad9c569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:51:23.490834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c8958-b94a-4e27-a432-e08b8ad9c569 service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:23.491122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c8958-b94a-4e27-a432-e08b8ad9c569 service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:23.491405 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c8958-b94a-4e27-a432-e08b8ad9c569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:23.500155 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c8958-b94a-4e27-a432-e08b8ad9c569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:51:23.501784 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c8958-b94a-4e27-a432-e08b8ad9c569 service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:51:23.511448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 762/1516] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:51:25.235577 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e5f98-224c-4cf9-af0d-1fafd4430602 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:25.236157 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e5f98-224c-4cf9-af0d-1fafd4430602 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:25.236157 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e5f98-224c-4cf9-af0d-1fafd4430602 None None] PATH_INFO: `/v3` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:25.237464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 755/1517] 10.222.0.55 () {54 vars in 925 bytes} [Thu May 26 13:51:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:51:25.244547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a2f95-972a-4b3d-8179-aeceb0fd9f8a None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:25.244981 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a2f95-972a-4b3d-8179-aeceb0fd9f8a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:25.245099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a2f95-972a-4b3d-8179-aeceb0fd9f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:25.262901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-616a2f95-972a-4b3d-8179-aeceb0fd9f8a None None] MFA Rules not processed for user `8b0db68b7fda4da29eb13689f3fd7b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:51:25.264085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-616a2f95-972a-4b3d-8179-aeceb0fd9f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:51:25.323186 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 763/1518] 10.222.0.55 () {58 vars in 1015 bytes} [Thu May 26 13:51:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:51:29.879596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d9d72-e702-4d21-be69-b81dd7e36c9c None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:29.880128 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d9d72-e702-4d21-be69-b81dd7e36c9c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:29.880128 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d9d72-e702-4d21-be69-b81dd7e36c9c None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:29.881783 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 756/1519] 10.222.0.45 () {54 vars in 960 bytes} [Thu May 26 13:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:51:29.887209 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa85004-af3b-44c6-a15c-2b979963e638 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:29.887644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa85004-af3b-44c6-a15c-2b979963e638 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:29.887816 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa85004-af3b-44c6-a15c-2b979963e638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:29.906888 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-ffa85004-af3b-44c6-a15c-2b979963e638 None None] MFA Rules not processed for user `8b0db68b7fda4da29eb13689f3fd7b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:51:29.908074 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ffa85004-af3b-44c6-a15c-2b979963e638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:51:29.916570 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 764/1520] 10.222.0.45 () {58 vars in 1057 bytes} [Thu May 26 13:51:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:51:29.923964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d9d72-e702-4d21-be69-b81dd7e36c9c None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:51:29.937640 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d9d72-e702-4d21-be69-b81dd7e36c9c None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:51:29.942682 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42654f-ef06-4c17-a8cf-6fed684f0546 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0db68b7fda4da29eb13689f3fd7b5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:51:29.943335 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42654f-ef06-4c17-a8cf-6fed684f0546 service placement] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:29.943617 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42654f-ef06-4c17-a8cf-6fed684f0546 service placement] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:29.943892 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42654f-ef06-4c17-a8cf-6fed684f0546 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:29.952667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42654f-ef06-4c17-a8cf-6fed684f0546 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:51:29.954282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42654f-ef06-4c17-a8cf-6fed684f0546 service placement] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:51:29.963608 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 757/1521] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:51:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:51:34.773550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fb126-ddf6-4e22-831d-d0b86390a7e4 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:34.774115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fb126-ddf6-4e22-831d-d0b86390a7e4 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:34.774115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fb126-ddf6-4e22-831d-d0b86390a7e4 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:34.775498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 13:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:51:34.780490 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7718cfd-c476-4ca1-9195-815cae9cf194 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:34.780921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7718cfd-c476-4ca1-9195-815cae9cf194 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:34.781017 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7718cfd-c476-4ca1-9195-815cae9cf194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:34.799909 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-c7718cfd-c476-4ca1-9195-815cae9cf194 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:51:34.801098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c7718cfd-c476-4ca1-9195-815cae9cf194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:51:34.809423 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 13:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:51:34.963905 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fb126-ddf6-4e22-831d-d0b86390a7e4 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:51:34.978803 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fb126-ddf6-4e22-831d-d0b86390a7e4 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:51:34.984074 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fdcd2-3329-4f63-969d-da6cbafce059 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:51:34.984704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fdcd2-3329-4f63-969d-da6cbafce059 service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:34.984982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fdcd2-3329-4f63-969d-da6cbafce059 service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:34.985253 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fdcd2-3329-4f63-969d-da6cbafce059 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:34.993169 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fdcd2-3329-4f63-969d-da6cbafce059 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:51:34.994779 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fdcd2-3329-4f63-969d-da6cbafce059 service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:51:35.003848 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 766/1524] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:51:35.872104 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8efb51-f969-4d1c-b4f3-5582cdd60a75 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:35.872669 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8efb51-f969-4d1c-b4f3-5582cdd60a75 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:35.872669 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8efb51-f969-4d1c-b4f3-5582cdd60a75 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:35.874015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 13:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:51:35.879031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e48c0c-3dda-4a68-850c-6bc510e1a08e None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:35.879444 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e48c0c-3dda-4a68-850c-6bc510e1a08e None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:35.879595 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e48c0c-3dda-4a68-850c-6bc510e1a08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:35.898299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-e4e48c0c-3dda-4a68-850c-6bc510e1a08e None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:51:35.899498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e4e48c0c-3dda-4a68-850c-6bc510e1a08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:51:35.907152 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 13:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:51:36.057762 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8efb51-f969-4d1c-b4f3-5582cdd60a75 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:51:36.071704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8efb51-f969-4d1c-b4f3-5582cdd60a75 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:51:36.076962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab6458-b152-48dd-a7f3-fe8d4c639845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:51:36.077615 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab6458-b152-48dd-a7f3-fe8d4c639845 service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:36.077893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab6458-b152-48dd-a7f3-fe8d4c639845 service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:36.078169 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab6458-b152-48dd-a7f3-fe8d4c639845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:36.085998 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab6458-b152-48dd-a7f3-fe8d4c639845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:51:36.087568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab6458-b152-48dd-a7f3-fe8d4c639845 service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:51:36.096611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 760/1527] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:51:40.159309 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0019dba-a828-4d00-8e7d-beff87fa26a4 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:40.159892 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0019dba-a828-4d00-8e7d-beff87fa26a4 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:40.160128 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0019dba-a828-4d00-8e7d-beff87fa26a4 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:40.161557 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 13:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:51:40.168040 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332b577-be65-427f-9ce4-bff60b4b3c20 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:40.168490 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332b577-be65-427f-9ce4-bff60b4b3c20 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:40.168588 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332b577-be65-427f-9ce4-bff60b4b3c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:40.186451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-c332b577-be65-427f-9ce4-bff60b4b3c20 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:51:40.187632 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c332b577-be65-427f-9ce4-bff60b4b3c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:51:40.195343 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 13:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:51:40.232313 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0019dba-a828-4d00-8e7d-beff87fa26a4 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:51:40.233972 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d0019dba-a828-4d00-8e7d-beff87fa26a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:51:40.290134 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0019dba-a828-4d00-8e7d-beff87fa26a4 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:51:40.293669 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f87003-b1b4-4059-9b0f-efcb8e270649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:51:40.294302 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f87003-b1b4-4059-9b0f-efcb8e270649 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:40.294585 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f87003-b1b4-4059-9b0f-efcb8e270649 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:40.294863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f87003-b1b4-4059-9b0f-efcb8e270649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:40.303652 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f87003-b1b4-4059-9b0f-efcb8e270649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:51:40.305094 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f87003-b1b4-4059-9b0f-efcb8e270649 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:51:40.310025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:51:40.315039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 769/1530] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:51:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:51:42.508273 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2273bb-e793-4b42-90b5-da9cd6ac574a None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:42.508847 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2273bb-e793-4b42-90b5-da9cd6ac574a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:42.508847 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2273bb-e793-4b42-90b5-da9cd6ac574a None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:42.510221 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 13:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:51:42.515604 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac3212-0d16-45da-82c6-6f227be79cf6 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:42.516046 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac3212-0d16-45da-82c6-6f227be79cf6 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:42.516196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac3212-0d16-45da-82c6-6f227be79cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:42.534330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-a3ac3212-0d16-45da-82c6-6f227be79cf6 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:51:42.535525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-a3ac3212-0d16-45da-82c6-6f227be79cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:51:42.543869 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 13:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:51:42.578464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2273bb-e793-4b42-90b5-da9cd6ac574a None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:51:42.589578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2273bb-e793-4b42-90b5-da9cd6ac574a None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:51:42.593054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d8ee4-f3dc-4d75-976a-ec94f0b116dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:51:42.593712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d8ee4-f3dc-4d75-976a-ec94f0b116dc service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:42.593994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d8ee4-f3dc-4d75-976a-ec94f0b116dc service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:42.594268 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d8ee4-f3dc-4d75-976a-ec94f0b116dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:42.603436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d8ee4-f3dc-4d75-976a-ec94f0b116dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:51:42.604860 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d8ee4-f3dc-4d75-976a-ec94f0b116dc service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:51:42.613984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 763/1533] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:51:46.470556 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2ce00-b490-48e8-a81d-91e94484e507 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:46.471140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2ce00-b490-48e8-a81d-91e94484e507 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:46.471140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2ce00-b490-48e8-a81d-91e94484e507 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:46.472479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 13:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:51:46.478443 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88f5bf-a6f6-46ac-9efa-2075d8b14136 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:46.478852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88f5bf-a6f6-46ac-9efa-2075d8b14136 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:46.479030 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88f5bf-a6f6-46ac-9efa-2075d8b14136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:46.497164 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-6f88f5bf-a6f6-46ac-9efa-2075d8b14136 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:51:46.498373 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6f88f5bf-a6f6-46ac-9efa-2075d8b14136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:51:46.506470 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 13:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:51:46.775538 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2ce00-b490-48e8-a81d-91e94484e507 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:51:46.777198 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-5ca2ce00-b490-48e8-a81d-91e94484e507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:51:46.834051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2ce00-b490-48e8-a81d-91e94484e507 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:51:46.838121 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e06ff-b3a6-4543-80d4-6681f35ef6ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:51:46.838759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e06ff-b3a6-4543-80d4-6681f35ef6ba service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:46.839042 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e06ff-b3a6-4543-80d4-6681f35ef6ba service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:46.839317 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e06ff-b3a6-4543-80d4-6681f35ef6ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:46.848028 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e06ff-b3a6-4543-80d4-6681f35ef6ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:51:46.849477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e06ff-b3a6-4543-80d4-6681f35ef6ba service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:51:46.859906 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 772/1536] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:51:49.066337 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc06c21-8483-4f5f-92f6-7e8073a85b3e None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:49.066981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc06c21-8483-4f5f-92f6-7e8073a85b3e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:49.066981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc06c21-8483-4f5f-92f6-7e8073a85b3e None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:49.068271 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 13:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:51:49.073687 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c5fad-8269-4ee4-813c-877fbf25e89c None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:49.074113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c5fad-8269-4ee4-813c-877fbf25e89c None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:49.074254 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c5fad-8269-4ee4-813c-877fbf25e89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:49.092802 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-401c5fad-8269-4ee4-813c-877fbf25e89c None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:51:49.094041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-401c5fad-8269-4ee4-813c-877fbf25e89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:51:49.102364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 13:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:51:49.367929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc06c21-8483-4f5f-92f6-7e8073a85b3e None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:51:49.369625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-0dc06c21-8483-4f5f-92f6-7e8073a85b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:51:49.377141 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=65 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:51:49.383749 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc06c21-8483-4f5f-92f6-7e8073a85b3e None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:51:49.387267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e712cd1-31a2-40de-a568-fe51716d0be5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:51:49.387894 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e712cd1-31a2-40de-a568-fe51716d0be5 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:51:49.388180 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e712cd1-31a2-40de-a568-fe51716d0be5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:51:49.388461 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e712cd1-31a2-40de-a568-fe51716d0be5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:51:49.397196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e712cd1-31a2-40de-a568-fe51716d0be5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:51:49.399155 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e712cd1-31a2-40de-a568-fe51716d0be5 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:51:49.408361 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 766/1539] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:51:59.087586 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=32 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:51:59.404327 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=5 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:25.107799 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687b2f0-4545-486c-aac1-97e65e2ab2a1 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.108489 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687b2f0-4545-486c-aac1-97e65e2ab2a1 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.108592 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687b2f0-4545-486c-aac1-97e65e2ab2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.141757 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-b687b2f0-4545-486c-aac1-97e65e2ab2a1 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:25.143157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-b687b2f0-4545-486c-aac1-97e65e2ab2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:25.155221 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 774/1540] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:25.167154 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65dae6-d441-4a5b-ab33-23146716aa9d None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.167742 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65dae6-d441-4a5b-ab33-23146716aa9d None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.167742 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65dae6-d441-4a5b-ab33-23146716aa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.198347 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-ee65dae6-d441-4a5b-ab33-23146716aa9d None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:25.200429 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ee65dae6-d441-4a5b-ab33-23146716aa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:25.212399 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 767/1541] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:25.217462 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687b2f0-4545-486c-aac1-97e65e2ab2a1 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:25.232864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687b2f0-4545-486c-aac1-97e65e2ab2a1 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:25.239566 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28eb284-934d-4a83-92e6-786e0495ff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:25.240890 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eb284-934d-4a83-92e6-786e0495ff47 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.241177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eb284-934d-4a83-92e6-786e0495ff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.241482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eb284-934d-4a83-92e6-786e0495ff47 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.242216 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28eb284-934d-4a83-92e6-786e0495ff47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:53:25.242527 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28eb284-934d-4a83-92e6-786e0495ff47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:25.244113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28eb284-934d-4a83-92e6-786e0495ff47 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:25.260431 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 775/1542] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:53:25.268475 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65dae6-d441-4a5b-ab33-23146716aa9d None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:25.283269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65dae6-d441-4a5b-ab33-23146716aa9d None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:25.298659 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998786ea-30ee-45a7-9231-6511201fd1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:25.299337 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998786ea-30ee-45a7-9231-6511201fd1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.299619 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998786ea-30ee-45a7-9231-6511201fd1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.299893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998786ea-30ee-45a7-9231-6511201fd1f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.300584 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998786ea-30ee-45a7-9231-6511201fd1f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:25.303905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998786ea-30ee-45a7-9231-6511201fd1f8 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:25.353674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 768/1543] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:53:25 2022] POST /identity/v3/projects => generated 379 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:53:25.358462 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28eb284-934d-4a83-92e6-786e0495ff47 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:25.378111 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28eb284-934d-4a83-92e6-786e0495ff47 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:25.463287 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb544f5-7d2f-4381-92aa-239631723063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:25.464003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb544f5-7d2f-4381-92aa-239631723063 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.464286 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb544f5-7d2f-4381-92aa-239631723063 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.464566 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb544f5-7d2f-4381-92aa-239631723063 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.465325 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb544f5-7d2f-4381-92aa-239631723063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:25.467478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb544f5-7d2f-4381-92aa-239631723063 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:25.502856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 776/1544] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:53:25 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:53:25.508439 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998786ea-30ee-45a7-9231-6511201fd1f8 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:25.526065 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998786ea-30ee-45a7-9231-6511201fd1f8 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:25.534691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd108f-4dc0-4930-bbff-a383345d194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:25.535383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd108f-4dc0-4930-bbff-a383345d194d admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.535661 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd108f-4dc0-4930-bbff-a383345d194d admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.535934 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd108f-4dc0-4930-bbff-a383345d194d admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.536677 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd108f-4dc0-4930-bbff-a383345d194d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:25.539171 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd108f-4dc0-4930-bbff-a383345d194d admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:25.560860 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 769/1545] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:25.564551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb544f5-7d2f-4381-92aa-239631723063 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:25.567265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507f9d8-5352-4099-8c57-a6c97c29618f None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.568194 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507f9d8-5352-4099-8c57-a6c97c29618f None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.569092 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507f9d8-5352-4099-8c57-a6c97c29618f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.580739 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb544f5-7d2f-4381-92aa-239631723063 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:25.589636 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197fb16-d892-44cb-a130-167fbe9d0e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:25.590331 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197fb16-d892-44cb-a130-167fbe9d0e06 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.590614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197fb16-d892-44cb-a130-167fbe9d0e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.590893 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197fb16-d892-44cb-a130-167fbe9d0e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.594732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197fb16-d892-44cb-a130-167fbe9d0e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:25.596456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197fb16-d892-44cb-a130-167fbe9d0e06 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:25.606430 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-5507f9d8-5352-4099-8c57-a6c97c29618f None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:25.607723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-5507f9d8-5352-4099-8c57-a6c97c29618f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:25.618644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 777/1546] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:25.622953 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197fb16-d892-44cb-a130-167fbe9d0e06 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:25.624089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 770/1547] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:53:25.637704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197fb16-d892-44cb-a130-167fbe9d0e06 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:25.638718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fadf2-3c75-4989-a6f4-0145ad0f71fe None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.639127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fadf2-3c75-4989-a6f4-0145ad0f71fe None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.640046 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fadf2-3c75-4989-a6f4-0145ad0f71fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.643959 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d16d81-602a-45e2-bbb6-b855f38dbb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:25.645015 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d16d81-602a-45e2-bbb6-b855f38dbb34 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.645549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d16d81-602a-45e2-bbb6-b855f38dbb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.645947 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d16d81-602a-45e2-bbb6-b855f38dbb34 admin admin] PATH_INFO: `/v3/projects/e39e464f5b2b4873a8596c77fa0da348/users/5084491710d34261b91001f5161d8a64/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.667210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d16d81-602a-45e2-bbb6-b855f38dbb34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39e464f5b2b4873a8596c77fa0da348, user_id=5084491710d34261b91001f5161d8a64, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:25.668422 dv-cinder-842130-1-smb devstack@keystone.service[91767]: WARNING py.warnings [None req-b7d16d81-602a-45e2-bbb6-b855f38dbb34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 13:53:25.668422 dv-cinder-842130-1-smb devstack@keystone.service[91767]: warnings.warn(msg) May 26 13:53:25.668422 dv-cinder-842130-1-smb devstack@keystone.service[91767]: May 26 13:53:25.670792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d16d81-602a-45e2-bbb6-b855f38dbb34 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:25.676399 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-fa9fadf2-3c75-4989-a6f4-0145ad0f71fe None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:25.677832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-fa9fadf2-3c75-4989-a6f4-0145ad0f71fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:25.701501 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 778/1548] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:53:25 2022] PUT /identity/v3/projects/e39e464f5b2b4873a8596c77fa0da348/users/5084491710d34261b91001f5161d8a64/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:53:25.707664 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 771/1549] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:53:25.709925 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92dde2-1fa6-4760-8728-14203b943ab5 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.710466 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92dde2-1fa6-4760-8728-14203b943ab5 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.710981 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92dde2-1fa6-4760-8728-14203b943ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.711474 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4164fd1-5250-453a-9a17-b1c2e46c6284 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.713428 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4164fd1-5250-453a-9a17-b1c2e46c6284 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.714002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4164fd1-5250-453a-9a17-b1c2e46c6284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.747374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-dd92dde2-1fa6-4760-8728-14203b943ab5 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:25.748680 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-f4164fd1-5250-453a-9a17-b1c2e46c6284 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:25.753637 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f4164fd1-5250-453a-9a17-b1c2e46c6284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:25.755155 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-dd92dde2-1fa6-4760-8728-14203b943ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:25.829224 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 779/1550] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:25.830223 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92dde2-1fa6-4760-8728-14203b943ab5 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:25.839789 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92dde2-1fa6-4760-8728-14203b943ab5 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:25.842538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 772/1551] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:25.843953 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff6c2b-ce6e-4944-9785-8c6ce1cee14f None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.844244 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff6c2b-ce6e-4944-9785-8c6ce1cee14f None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.844524 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff6c2b-ce6e-4944-9785-8c6ce1cee14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.848002 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d18da-3f35-4e3d-9713-32db48bf8ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:25.848759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d18da-3f35-4e3d-9713-32db48bf8ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.849050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d18da-3f35-4e3d-9713-32db48bf8ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.849362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d18da-3f35-4e3d-9713-32db48bf8ff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.850140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d18da-3f35-4e3d-9713-32db48bf8ff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:53:25.850585 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d18da-3f35-4e3d-9713-32db48bf8ff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:25.853472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d18da-3f35-4e3d-9713-32db48bf8ff8 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:25.862840 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-71ff6c2b-ce6e-4944-9785-8c6ce1cee14f None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:25.863992 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-71ff6c2b-ce6e-4944-9785-8c6ce1cee14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:25.866805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 780/1552] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:53:25.868099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dd2b7-6b65-453c-b38e-cdd3486e3f6a None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.868390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dd2b7-6b65-453c-b38e-cdd3486e3f6a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.868731 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dd2b7-6b65-453c-b38e-cdd3486e3f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.872861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 773/1553] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:25.874015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d80a2-50eb-46aa-aba7-49958a74fb12 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.874308 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d80a2-50eb-46aa-aba7-49958a74fb12 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.874588 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d80a2-50eb-46aa-aba7-49958a74fb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.893597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-755d80a2-50eb-46aa-aba7-49958a74fb12 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:25.894811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-755d80a2-50eb-46aa-aba7-49958a74fb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:25.900105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-511dd2b7-6b65-453c-b38e-cdd3486e3f6a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:25.902598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-511dd2b7-6b65-453c-b38e-cdd3486e3f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:25.903462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 774/1554] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:25.906656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b011a-e6ce-4c7e-a2c8-3e5cc07ac970 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.907209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b011a-e6ce-4c7e-a2c8-3e5cc07ac970 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.907716 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b011a-e6ce-4c7e-a2c8-3e5cc07ac970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.920190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 781/1555] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:25.921687 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6eda1-e9fd-49ce-a982-4fabb6dba0cf None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.921985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6eda1-e9fd-49ce-a982-4fabb6dba0cf None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.922266 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6eda1-e9fd-49ce-a982-4fabb6dba0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.928837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-988b011a-e6ce-4c7e-a2c8-3e5cc07ac970 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:25.930083 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-988b011a-e6ce-4c7e-a2c8-3e5cc07ac970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:25.937995 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 775/1556] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:25.939208 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dae19-1499-4126-9246-28e1becbd08d None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.939585 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dae19-1499-4126-9246-28e1becbd08d None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.939789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dae19-1499-4126-9246-28e1becbd08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.942335 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-b7e6eda1-e9fd-49ce-a982-4fabb6dba0cf None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:25.944109 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-b7e6eda1-e9fd-49ce-a982-4fabb6dba0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:25.953290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 782/1557] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:25.954454 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6eda1-e9fd-49ce-a982-4fabb6dba0cf None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:25.963116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-cd9dae19-1499-4126-9246-28e1becbd08d None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:25.964190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:25.964353 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-cd9dae19-1499-4126-9246-28e1becbd08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:25.972533 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 776/1558] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:25.973987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dae19-1499-4126-9246-28e1becbd08d None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:25.983273 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dae19-1499-4126-9246-28e1becbd08d None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:25.987820 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441267f1-0809-490c-a2b5-ec033ac0453b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:25.988456 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441267f1-0809-490c-a2b5-ec033ac0453b admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:25.988743 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441267f1-0809-490c-a2b5-ec033ac0453b admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:25.989022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441267f1-0809-490c-a2b5-ec033ac0453b admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:25.989736 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441267f1-0809-490c-a2b5-ec033ac0453b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:25.992309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441267f1-0809-490c-a2b5-ec033ac0453b admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.012465 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6eda1-e9fd-49ce-a982-4fabb6dba0cf None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:26.016255 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2d22d-b972-43a9-a937-78588a7c5503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:26.016904 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2d22d-b972-43a9-a937-78588a7c5503 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.017346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2d22d-b972-43a9-a937-78588a7c5503 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.017488 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2d22d-b972-43a9-a937-78588a7c5503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.018953 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 777/1559] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:53:25 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:26.020259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa59f64-7e89-46b3-8147-f27a33fd2502 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.020605 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa59f64-7e89-46b3-8147-f27a33fd2502 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.020947 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa59f64-7e89-46b3-8147-f27a33fd2502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.026959 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2d22d-b972-43a9-a937-78588a7c5503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:26.028392 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2d22d-b972-43a9-a937-78588a7c5503 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.038484 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 783/1560] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:26.039714 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-6aa59f64-7e89-46b3-8147-f27a33fd2502 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:26.039861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea882cbf-39fc-41bd-aefd-dc9e725acef3 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.040071 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea882cbf-39fc-41bd-aefd-dc9e725acef3 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.040359 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea882cbf-39fc-41bd-aefd-dc9e725acef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.040914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6aa59f64-7e89-46b3-8147-f27a33fd2502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:26.059141 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-ea882cbf-39fc-41bd-aefd-dc9e725acef3 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:26.060454 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ea882cbf-39fc-41bd-aefd-dc9e725acef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:26.099513 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:26.116527 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 778/1561] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:26.116527 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae197c6-a37f-43d4-9b4c-4c34028207b1 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.116527 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae197c6-a37f-43d4-9b4c-4c34028207b1 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.116527 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae197c6-a37f-43d4-9b4c-4c34028207b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.126087 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 784/1562] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:26.127428 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e9e5a-99aa-4dbb-b007-0a0b6608a3ee None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.127723 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e9e5a-99aa-4dbb-b007-0a0b6608a3ee None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.128005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e9e5a-99aa-4dbb-b007-0a0b6608a3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.142193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-7ae197c6-a37f-43d4-9b4c-4c34028207b1 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:26.146158 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-7ae197c6-a37f-43d4-9b4c-4c34028207b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:26.149280 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-382e9e5a-99aa-4dbb-b007-0a0b6608a3ee None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:26.150632 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-382e9e5a-99aa-4dbb-b007-0a0b6608a3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:26.155900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 779/1563] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:26.157543 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ef72e-6c88-44cc-82f0-c461d503f849 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.157829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ef72e-6c88-44cc-82f0-c461d503f849 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.158112 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ef72e-6c88-44cc-82f0-c461d503f849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.159590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 785/1564] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:26.161421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e9e5a-99aa-4dbb-b007-0a0b6608a3ee None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:26.173225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e9e5a-99aa-4dbb-b007-0a0b6608a3ee None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:26.180188 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a842f0-b7d8-41b3-803d-fbc8e3e231e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:26.181018 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a842f0-b7d8-41b3-803d-fbc8e3e231e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.181521 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a842f0-b7d8-41b3-803d-fbc8e3e231e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.181925 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a842f0-b7d8-41b3-803d-fbc8e3e231e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.182884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a842f0-b7d8-41b3-803d-fbc8e3e231e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:53:26.183313 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a842f0-b7d8-41b3-803d-fbc8e3e231e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:26.185434 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a842f0-b7d8-41b3-803d-fbc8e3e231e1 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.189514 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-3a4ef72e-6c88-44cc-82f0-c461d503f849 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:26.190747 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-3a4ef72e-6c88-44cc-82f0-c461d503f849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:26.201114 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 786/1565] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:53:26.202869 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a842f0-b7d8-41b3-803d-fbc8e3e231e1 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:26.214070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 780/1566] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:26.214070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ef72e-6c88-44cc-82f0-c461d503f849 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:26.214553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a842f0-b7d8-41b3-803d-fbc8e3e231e1 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:26.219498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f7ce5-0ecd-4014-a289-edbe41188a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:26.220624 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f7ce5-0ecd-4014-a289-edbe41188a53 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.221016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f7ce5-0ecd-4014-a289-edbe41188a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.222014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f7ce5-0ecd-4014-a289-edbe41188a53 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.222297 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f7ce5-0ecd-4014-a289-edbe41188a53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:26.225357 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f7ce5-0ecd-4014-a289-edbe41188a53 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.226901 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ef72e-6c88-44cc-82f0-c461d503f849 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:26.236493 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cc2e7-4b89-49db-b7b7-728c1b7468c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:26.238972 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cc2e7-4b89-49db-b7b7-728c1b7468c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.239145 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cc2e7-4b89-49db-b7b7-728c1b7468c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.239313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cc2e7-4b89-49db-b7b7-728c1b7468c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.240237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cc2e7-4b89-49db-b7b7-728c1b7468c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:53:26.242023 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cc2e7-4b89-49db-b7b7-728c1b7468c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:26.243238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: WARNING py.warnings [None req-698cc2e7-4b89-49db-b7b7-728c1b7468c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:53:26.243238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: warnings.warn(msg) May 26 13:53:26.243238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: May 26 13:53:26.244227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cc2e7-4b89-49db-b7b7-728c1b7468c3 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.260074 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 787/1567] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:53:26 2022] POST /identity/v3/users => generated 283 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:26.261205 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f7ce5-0ecd-4014-a289-edbe41188a53 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:26.261571 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 781/1568] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:53:26.262413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cc2e7-4b89-49db-b7b7-728c1b7468c3 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:26.272609 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f7ce5-0ecd-4014-a289-edbe41188a53 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:26.274767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cc2e7-4b89-49db-b7b7-728c1b7468c3 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:26.277868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2611c77-e6fa-4a46-bef4-25b6d35cc818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:26.278601 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2611c77-e6fa-4a46-bef4-25b6d35cc818 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.278959 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2611c77-e6fa-4a46-bef4-25b6d35cc818 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.279245 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2611c77-e6fa-4a46-bef4-25b6d35cc818 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.279798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5fb34-e7f1-41e9-90be-314a0c2111f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:26.279966 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2611c77-e6fa-4a46-bef4-25b6d35cc818 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:53:26.280278 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2611c77-e6fa-4a46-bef4-25b6d35cc818 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:26.280637 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5fb34-e7f1-41e9-90be-314a0c2111f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.280997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5fb34-e7f1-41e9-90be-314a0c2111f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.281380 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5fb34-e7f1-41e9-90be-314a0c2111f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.281903 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2611c77-e6fa-4a46-bef4-25b6d35cc818 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.282267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5fb34-e7f1-41e9-90be-314a0c2111f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:53:26.282626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5fb34-e7f1-41e9-90be-314a0c2111f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:26.284286 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5fb34-e7f1-41e9-90be-314a0c2111f0 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.297848 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 782/1569] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:53:26.305602 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5fb34-e7f1-41e9-90be-314a0c2111f0 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:26.305785 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 788/1570] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:53:26.305785 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2611c77-e6fa-4a46-bef4-25b6d35cc818 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:26.316339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2611c77-e6fa-4a46-bef4-25b6d35cc818 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:26.316667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5fb34-e7f1-41e9-90be-314a0c2111f0 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:26.321361 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fc3db-08b5-49ea-b99b-93fcddc739b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:26.321829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009a5ff-5183-431c-a50a-e06b33653a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:26.322017 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fc3db-08b5-49ea-b99b-93fcddc739b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.322290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fc3db-08b5-49ea-b99b-93fcddc739b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.322565 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fc3db-08b5-49ea-b99b-93fcddc739b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.322662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009a5ff-5183-431c-a50a-e06b33653a41 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.323053 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009a5ff-5183-431c-a50a-e06b33653a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.323276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fc3db-08b5-49ea-b99b-93fcddc739b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:53:26.323426 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009a5ff-5183-431c-a50a-e06b33653a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.323573 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fc3db-08b5-49ea-b99b-93fcddc739b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:26.324324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009a5ff-5183-431c-a50a-e06b33653a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:26.325164 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fc3db-08b5-49ea-b99b-93fcddc739b7 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.325483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: WARNING py.warnings [None req-1009a5ff-5183-431c-a50a-e06b33653a41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 13:53:26.325483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: warnings.warn(msg) May 26 13:53:26.325483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: May 26 13:53:26.326785 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009a5ff-5183-431c-a50a-e06b33653a41 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.345322 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 783/1571] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:53:26.345322 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fc3db-08b5-49ea-b99b-93fcddc739b7 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:26.354011 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fc3db-08b5-49ea-b99b-93fcddc739b7 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:26.358740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77480071-e173-4c40-a845-ceb5693041a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:26.359396 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77480071-e173-4c40-a845-ceb5693041a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.359707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77480071-e173-4c40-a845-ceb5693041a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.359987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77480071-e173-4c40-a845-ceb5693041a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.360711 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77480071-e173-4c40-a845-ceb5693041a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:53:26.361024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77480071-e173-4c40-a845-ceb5693041a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:26.361300 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 789/1572] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:53:26 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:26.362222 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009a5ff-5183-431c-a50a-e06b33653a41 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:26.362651 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77480071-e173-4c40-a845-ceb5693041a5 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.376761 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 784/1573] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:53:26.378034 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77480071-e173-4c40-a845-ceb5693041a5 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:26.389118 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77480071-e173-4c40-a845-ceb5693041a5 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:26.417038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:26.454344 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009a5ff-5183-431c-a50a-e06b33653a41 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:26.461605 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa8fc5-c99b-4ea8-8fa0-dedb3d8f114c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:26.462385 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa8fc5-c99b-4ea8-8fa0-dedb3d8f114c admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.463018 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa8fc5-c99b-4ea8-8fa0-dedb3d8f114c admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.463358 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa8fc5-c99b-4ea8-8fa0-dedb3d8f114c admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.465090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa8fc5-c99b-4ea8-8fa0-dedb3d8f114c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:26.467474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa8fc5-c99b-4ea8-8fa0-dedb3d8f114c admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.482288 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 790/1574] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:26.482288 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa8fc5-c99b-4ea8-8fa0-dedb3d8f114c admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:26.490938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ca0b9-cb98-4486-bd1d-820a9239182d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:26.492019 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ca0b9-cb98-4486-bd1d-820a9239182d admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.492616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ca0b9-cb98-4486-bd1d-820a9239182d admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.493195 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ca0b9-cb98-4486-bd1d-820a9239182d admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.494029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ca0b9-cb98-4486-bd1d-820a9239182d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:26.495179 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa8fc5-c99b-4ea8-8fa0-dedb3d8f114c admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:26.496313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ca0b9-cb98-4486-bd1d-820a9239182d admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.502556 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a0b7f-d6f0-4529-9ae3-da249e6aeba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:26.503227 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a0b7f-d6f0-4529-9ae3-da249e6aeba7 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.504621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a0b7f-d6f0-4529-9ae3-da249e6aeba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.504896 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a0b7f-d6f0-4529-9ae3-da249e6aeba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.505679 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a0b7f-d6f0-4529-9ae3-da249e6aeba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:26.507837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a0b7f-d6f0-4529-9ae3-da249e6aeba7 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.538378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 785/1575] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:53:26 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:26.539317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ca0b9-cb98-4486-bd1d-820a9239182d admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:26.557580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 791/1576] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:53:26 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:26.562660 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a0b7f-d6f0-4529-9ae3-da249e6aeba7 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:26.618287 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ca0b9-cb98-4486-bd1d-820a9239182d admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:26.635815 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a0b7f-d6f0-4529-9ae3-da249e6aeba7 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:26.643627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144728a-fe73-46a7-814d-068e5a8bfd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:26.644304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144728a-fe73-46a7-814d-068e5a8bfd26 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.644492 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:26.644657 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144728a-fe73-46a7-814d-068e5a8bfd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.645084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144728a-fe73-46a7-814d-068e5a8bfd26 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.646360 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144728a-fe73-46a7-814d-068e5a8bfd26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:26.649150 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144728a-fe73-46a7-814d-068e5a8bfd26 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.684179 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 792/1577] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:53:26 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:26.685193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144728a-fe73-46a7-814d-068e5a8bfd26 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:26.690798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9d9c0-a730-4345-9117-4045efc70970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:26.691800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9d9c0-a730-4345-9117-4045efc70970 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.692500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9d9c0-a730-4345-9117-4045efc70970 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.692793 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9d9c0-a730-4345-9117-4045efc70970 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.693559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9d9c0-a730-4345-9117-4045efc70970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:26.695485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9d9c0-a730-4345-9117-4045efc70970 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.724351 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 786/1578] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:53:26 2022] POST /identity/v3/projects => generated 391 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:26.726374 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9d9c0-a730-4345-9117-4045efc70970 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:26.756685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144728a-fe73-46a7-814d-068e5a8bfd26 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:26.811540 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:26.812538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9d9c0-a730-4345-9117-4045efc70970 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:26.820751 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8779c0-5299-4433-bd6b-25a76caefc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:26.821627 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8779c0-5299-4433-bd6b-25a76caefc5e admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.821914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8779c0-5299-4433-bd6b-25a76caefc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.822217 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8779c0-5299-4433-bd6b-25a76caefc5e admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.823954 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8779c0-5299-4433-bd6b-25a76caefc5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:26.827030 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add81505-52a5-434a-9762-ccf1bb8f2501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:26.827555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8779c0-5299-4433-bd6b-25a76caefc5e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.828286 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add81505-52a5-434a-9762-ccf1bb8f2501 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.828286 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add81505-52a5-434a-9762-ccf1bb8f2501 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.828286 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add81505-52a5-434a-9762-ccf1bb8f2501 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.828929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add81505-52a5-434a-9762-ccf1bb8f2501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:26.831005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add81505-52a5-434a-9762-ccf1bb8f2501 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.860294 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 793/1579] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:53:26 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:26.860294 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add81505-52a5-434a-9762-ccf1bb8f2501 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:26.878992 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add81505-52a5-434a-9762-ccf1bb8f2501 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:26.883236 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 787/1580] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:53:26 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:26.884387 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8779c0-5299-4433-bd6b-25a76caefc5e admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:26.887490 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c35f3b-9da4-459c-b4da-8a0848d417a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:26.888284 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c35f3b-9da4-459c-b4da-8a0848d417a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.888413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c35f3b-9da4-459c-b4da-8a0848d417a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.888721 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c35f3b-9da4-459c-b4da-8a0848d417a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.889387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c35f3b-9da4-459c-b4da-8a0848d417a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:26.890968 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c35f3b-9da4-459c-b4da-8a0848d417a4 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.907010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 794/1581] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:26.907010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c35f3b-9da4-459c-b4da-8a0848d417a4 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:26.915784 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c35f3b-9da4-459c-b4da-8a0848d417a4 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:26.960747 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8779c0-5299-4433-bd6b-25a76caefc5e admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:26.966456 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acee25f-e445-4520-abcc-1a071f8e054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:26.967427 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acee25f-e445-4520-abcc-1a071f8e054a admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.968008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acee25f-e445-4520-abcc-1a071f8e054a admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.968296 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acee25f-e445-4520-abcc-1a071f8e054a admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.969131 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acee25f-e445-4520-abcc-1a071f8e054a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:26.970430 dv-cinder-842130-1-smb devstack@keystone.service[91766]: WARNING py.warnings [None req-8acee25f-e445-4520-abcc-1a071f8e054a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 13:53:26.970430 dv-cinder-842130-1-smb devstack@keystone.service[91766]: warnings.warn(msg) May 26 13:53:26.970430 dv-cinder-842130-1-smb devstack@keystone.service[91766]: May 26 13:53:26.971819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acee25f-e445-4520-abcc-1a071f8e054a admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.981228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bbcb1-ac27-4931-b55b-047c3faaf34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:26.983633 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bbcb1-ac27-4931-b55b-047c3faaf34e admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:26.983633 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bbcb1-ac27-4931-b55b-047c3faaf34e admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:26.983859 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bbcb1-ac27-4931-b55b-047c3faaf34e admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:26.984977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bbcb1-ac27-4931-b55b-047c3faaf34e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:26.987361 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bbcb1-ac27-4931-b55b-047c3faaf34e admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:26.994738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 788/1582] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:53:26 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:26.995568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acee25f-e445-4520-abcc-1a071f8e054a admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.007046 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acee25f-e445-4520-abcc-1a071f8e054a admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.011626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db023aa-4ed8-4ca7-bcf6-370e19a620ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.012293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db023aa-4ed8-4ca7-bcf6-370e19a620ab admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.012576 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db023aa-4ed8-4ca7-bcf6-370e19a620ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.012861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db023aa-4ed8-4ca7-bcf6-370e19a620ab admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.013623 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 795/1583] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:53:26 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:27.013940 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db023aa-4ed8-4ca7-bcf6-370e19a620ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.014877 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bbcb1-ac27-4931-b55b-047c3faaf34e admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.015866 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db023aa-4ed8-4ca7-bcf6-370e19a620ab admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.028632 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bbcb1-ac27-4931-b55b-047c3faaf34e admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.034153 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3ae72-a88b-42b3-839f-4c1888fa28a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.034820 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3ae72-a88b-42b3-839f-4c1888fa28a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.035100 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3ae72-a88b-42b3-839f-4c1888fa28a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.035374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3ae72-a88b-42b3-839f-4c1888fa28a7 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.036123 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3ae72-a88b-42b3-839f-4c1888fa28a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.037497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 789/1584] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:53:26 2022] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:27.038131 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3ae72-a88b-42b3-839f-4c1888fa28a7 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.038384 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db023aa-4ed8-4ca7-bcf6-370e19a620ab admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.050463 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db023aa-4ed8-4ca7-bcf6-370e19a620ab admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.055715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94656b8f-14b7-4742-87e7-3cf80904263d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.056507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656b8f-14b7-4742-87e7-3cf80904263d admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.056780 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656b8f-14b7-4742-87e7-3cf80904263d admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.057058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656b8f-14b7-4742-87e7-3cf80904263d admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.057830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94656b8f-14b7-4742-87e7-3cf80904263d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.058801 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 796/1585] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:53:27 2022] POST /identity/v3/users => generated 296 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:27.059450 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94656b8f-14b7-4742-87e7-3cf80904263d admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.062191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:27.063159 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeda60-7ac0-4995-8213-2c401744b6ac None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.063440 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeda60-7ac0-4995-8213-2c401744b6ac None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.063957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeda60-7ac0-4995-8213-2c401744b6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.075269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 790/1586] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:27.076103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94656b8f-14b7-4742-87e7-3cf80904263d admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.086858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94656b8f-14b7-4742-87e7-3cf80904263d admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.091505 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913a310-3a90-408e-a527-cc39dd8d7b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.092711 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913a310-3a90-408e-a527-cc39dd8d7b68 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.093000 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913a310-3a90-408e-a527-cc39dd8d7b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.093098 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-6fdeda60-7ac0-4995-8213-2c401744b6ac None None] MFA Rules not processed for user `5084491710d34261b91001f5161d8a64`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:27.093421 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913a310-3a90-408e-a527-cc39dd8d7b68 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.094115 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913a310-3a90-408e-a527-cc39dd8d7b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.094259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-6fdeda60-7ac0-4995-8213-2c401744b6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:27.096067 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913a310-3a90-408e-a527-cc39dd8d7b68 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.115523 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 791/1587] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:53:27 2022] POST /identity/v3/users => generated 292 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:27.116433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913a310-3a90-408e-a527-cc39dd8d7b68 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.125875 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913a310-3a90-408e-a527-cc39dd8d7b68 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.130805 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec11ef-8fbd-4ea7-82ec-03737caf5b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.132210 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec11ef-8fbd-4ea7-82ec-03737caf5b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.132497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec11ef-8fbd-4ea7-82ec-03737caf5b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.132777 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec11ef-8fbd-4ea7-82ec-03737caf5b82 admin admin] PATH_INFO: `/v3/projects/a6c7f2a7475446bc8b7108f2ac1f5ed3/users/6a2e4a01c3034c0cbe72a8083fd4ff93/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.147617 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec11ef-8fbd-4ea7-82ec-03737caf5b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c7f2a7475446bc8b7108f2ac1f5ed3, user_id=6a2e4a01c3034c0cbe72a8083fd4ff93, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.150263 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec11ef-8fbd-4ea7-82ec-03737caf5b82 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.161545 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 797/1588] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:27.162475 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdeda60-7ac0-4995-8213-2c401744b6ac None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.168719 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 792/1589] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:53:27 2022] PUT /identity/v3/projects/a6c7f2a7475446bc8b7108f2ac1f5ed3/users/6a2e4a01c3034c0cbe72a8083fd4ff93/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:27.169378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec11ef-8fbd-4ea7-82ec-03737caf5b82 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.178792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdeda60-7ac0-4995-8213-2c401744b6ac None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.203216 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:27.236164 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0d2df-4142-4511-9cac-37469a52b55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.236834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0d2df-4142-4511-9cac-37469a52b55f admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.237119 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0d2df-4142-4511-9cac-37469a52b55f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.237425 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0d2df-4142-4511-9cac-37469a52b55f admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.238147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0d2df-4142-4511-9cac-37469a52b55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.239562 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec11ef-8fbd-4ea7-82ec-03737caf5b82 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.240034 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0d2df-4142-4511-9cac-37469a52b55f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.244057 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293bd90-7393-4e60-b251-a1238a883a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.244703 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293bd90-7393-4e60-b251-a1238a883a1e admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.244988 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293bd90-7393-4e60-b251-a1238a883a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.245262 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293bd90-7393-4e60-b251-a1238a883a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.245993 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293bd90-7393-4e60-b251-a1238a883a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.247609 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293bd90-7393-4e60-b251-a1238a883a1e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.250141 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 798/1590] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:27.250981 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0d2df-4142-4511-9cac-37469a52b55f admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.258701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 793/1591] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:27.259697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293bd90-7393-4e60-b251-a1238a883a1e admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.264051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0d2df-4142-4511-9cac-37469a52b55f admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.268673 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b00cf-6aff-4e7f-b7ce-c9554f6d1930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.268824 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293bd90-7393-4e60-b251-a1238a883a1e admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.269349 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b00cf-6aff-4e7f-b7ce-c9554f6d1930 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.269635 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b00cf-6aff-4e7f-b7ce-c9554f6d1930 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.269914 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b00cf-6aff-4e7f-b7ce-c9554f6d1930 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.270629 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b00cf-6aff-4e7f-b7ce-c9554f6d1930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.272758 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b00cf-6aff-4e7f-b7ce-c9554f6d1930 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.274297 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2fc23-d86f-4aac-b286-38f04809a31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.274916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2fc23-d86f-4aac-b286-38f04809a31e admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.275195 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2fc23-d86f-4aac-b286-38f04809a31e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.275491 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2fc23-d86f-4aac-b286-38f04809a31e admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.276185 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2fc23-d86f-4aac-b286-38f04809a31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.277771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2fc23-d86f-4aac-b286-38f04809a31e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.285658 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 799/1592] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:27.285658 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b00cf-6aff-4e7f-b7ce-c9554f6d1930 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.290244 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 794/1593] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:27.290244 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2fc23-d86f-4aac-b286-38f04809a31e admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.293040 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b00cf-6aff-4e7f-b7ce-c9554f6d1930 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.298157 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2fc23-d86f-4aac-b286-38f04809a31e admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.298528 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5bd12-a5b3-4833-b90d-f7ac68afd362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.299171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5bd12-a5b3-4833-b90d-f7ac68afd362 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.299458 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5bd12-a5b3-4833-b90d-f7ac68afd362 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.299735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5bd12-a5b3-4833-b90d-f7ac68afd362 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.300555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5bd12-a5b3-4833-b90d-f7ac68afd362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.302281 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5bd12-a5b3-4833-b90d-f7ac68afd362 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.303372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4f38a-caff-4c95-ab84-1a0722ca7d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.304012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4f38a-caff-4c95-ab84-1a0722ca7d89 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.304292 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4f38a-caff-4c95-ab84-1a0722ca7d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.304564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4f38a-caff-4c95-ab84-1a0722ca7d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.305290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4f38a-caff-4c95-ab84-1a0722ca7d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.306890 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4f38a-caff-4c95-ab84-1a0722ca7d89 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.312993 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 800/1594] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:27.314257 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5df911-e7f7-4e81-bc85-9a762878ba9b None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.314552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5df911-e7f7-4e81-bc85-9a762878ba9b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.314834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5df911-e7f7-4e81-bc85-9a762878ba9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.320166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 795/1595] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:27.322591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea874c8-14d0-4eab-b778-8a94a0e18723 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.323192 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea874c8-14d0-4eab-b778-8a94a0e18723 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.323327 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea874c8-14d0-4eab-b778-8a94a0e18723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.332339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-0a5df911-e7f7-4e81-bc85-9a762878ba9b None None] MFA Rules not processed for user `5084491710d34261b91001f5161d8a64`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:27.333579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0a5df911-e7f7-4e81-bc85-9a762878ba9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:27.350428 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-fea874c8-14d0-4eab-b778-8a94a0e18723 None None] MFA Rules not processed for user `6a2e4a01c3034c0cbe72a8083fd4ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:27.351654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-fea874c8-14d0-4eab-b778-8a94a0e18723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:27.387390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 801/1596] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:27.388025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5df911-e7f7-4e81-bc85-9a762878ba9b None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.402230 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5df911-e7f7-4e81-bc85-9a762878ba9b None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.408597 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86185173-398e-4e27-bef2-ff55854b8aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.409535 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86185173-398e-4e27-bef2-ff55854b8aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.410006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86185173-398e-4e27-bef2-ff55854b8aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.410329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86185173-398e-4e27-bef2-ff55854b8aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.411544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86185173-398e-4e27-bef2-ff55854b8aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.414065 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86185173-398e-4e27-bef2-ff55854b8aa4 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.421122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 796/1597] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:27.422328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea874c8-14d0-4eab-b778-8a94a0e18723 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.430696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 802/1598] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:27.431756 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86185173-398e-4e27-bef2-ff55854b8aa4 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.436321 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea874c8-14d0-4eab-b778-8a94a0e18723 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.441041 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1c1ec-ef54-44cc-8d6c-f8dacf0d6042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.441734 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1c1ec-ef54-44cc-8d6c-f8dacf0d6042 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.441843 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86185173-398e-4e27-bef2-ff55854b8aa4 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.442021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1c1ec-ef54-44cc-8d6c-f8dacf0d6042 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.442297 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1c1ec-ef54-44cc-8d6c-f8dacf0d6042 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.443015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1c1ec-ef54-44cc-8d6c-f8dacf0d6042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.444619 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1c1ec-ef54-44cc-8d6c-f8dacf0d6042 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.446713 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073da123-4a5b-42b3-a1e7-9ec67407e8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.447360 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073da123-4a5b-42b3-a1e7-9ec67407e8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.447643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073da123-4a5b-42b3-a1e7-9ec67407e8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.447916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073da123-4a5b-42b3-a1e7-9ec67407e8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.448624 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073da123-4a5b-42b3-a1e7-9ec67407e8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.450351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073da123-4a5b-42b3-a1e7-9ec67407e8e0 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.458470 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 797/1599] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:27.458470 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1c1ec-ef54-44cc-8d6c-f8dacf0d6042 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.461718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 803/1600] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:27.463035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073da123-4a5b-42b3-a1e7-9ec67407e8e0 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.468059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1c1ec-ef54-44cc-8d6c-f8dacf0d6042 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.472367 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073da123-4a5b-42b3-a1e7-9ec67407e8e0 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.472666 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8ada0-c339-4d06-99bd-488e2e5219dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.473349 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8ada0-c339-4d06-99bd-488e2e5219dd admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.473637 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8ada0-c339-4d06-99bd-488e2e5219dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.473921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8ada0-c339-4d06-99bd-488e2e5219dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.475226 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8ada0-c339-4d06-99bd-488e2e5219dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.476810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8ada0-c339-4d06-99bd-488e2e5219dd admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.477579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fed51-a423-4403-a98d-3a4174b56826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.478931 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:27.479067 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fed51-a423-4403-a98d-3a4174b56826 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.479566 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fed51-a423-4403-a98d-3a4174b56826 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.479699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fed51-a423-4403-a98d-3a4174b56826 admin admin] PATH_INFO: `/v3/projects/53ec3ebc7d724ff28f91016733ae9134/users/ff4a8240c1f4495eb3f518a7f1b741bf/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.488178 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 798/1601] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:27.489306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8ada0-c339-4d06-99bd-488e2e5219dd admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.495649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fed51-a423-4403-a98d-3a4174b56826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ec3ebc7d724ff28f91016733ae9134, user_id=ff4a8240c1f4495eb3f518a7f1b741bf, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.498808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fed51-a423-4403-a98d-3a4174b56826 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.500611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8ada0-c339-4d06-99bd-488e2e5219dd admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.506288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09385aba-33ee-49de-809a-4f53afac2772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.507104 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09385aba-33ee-49de-809a-4f53afac2772 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.507389 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09385aba-33ee-49de-809a-4f53afac2772 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.507671 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09385aba-33ee-49de-809a-4f53afac2772 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.508392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09385aba-33ee-49de-809a-4f53afac2772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.510023 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09385aba-33ee-49de-809a-4f53afac2772 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.512297 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 804/1602] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:53:27 2022] PUT /identity/v3/projects/53ec3ebc7d724ff28f91016733ae9134/users/ff4a8240c1f4495eb3f518a7f1b741bf/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:27.513400 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5e341-be78-4be9-a3ec-77715e0f225c None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.513689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5e341-be78-4be9-a3ec-77715e0f225c None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.513965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5e341-be78-4be9-a3ec-77715e0f225c None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.515788 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 805/1603] 10.222.0.45 () {54 vars in 961 bytes} [Thu May 26 13:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:53:27.516573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5e341-be78-4be9-a3ec-77715e0f225c None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.524615 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 799/1604] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:27.524615 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09385aba-33ee-49de-809a-4f53afac2772 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.577498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09385aba-33ee-49de-809a-4f53afac2772 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.580332 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5e341-be78-4be9-a3ec-77715e0f225c None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.585947 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ebfb6-86be-4507-a56e-3375b6563943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.586869 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ebfb6-86be-4507-a56e-3375b6563943 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.587153 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ebfb6-86be-4507-a56e-3375b6563943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.587431 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ebfb6-86be-4507-a56e-3375b6563943 admin admin] PATH_INFO: `/v3/projects/8714a3fc5c744e2e9a5def18919b7a0d/users/63cf85b13c87481095acb4d3a84156cc/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.589793 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:27.605811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ebfb6-86be-4507-a56e-3375b6563943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8714a3fc5c744e2e9a5def18919b7a0d, user_id=63cf85b13c87481095acb4d3a84156cc, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.608495 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ebfb6-86be-4507-a56e-3375b6563943 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.622091 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 806/1605] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:53:27 2022] PUT /identity/v3/projects/8714a3fc5c744e2e9a5def18919b7a0d/users/63cf85b13c87481095acb4d3a84156cc/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:27.626015 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ebfb6-86be-4507-a56e-3375b6563943 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.628637 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f2a7a-60b8-4ddb-8d89-b2f88f236a84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.629577 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f2a7a-60b8-4ddb-8d89-b2f88f236a84 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.629859 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f2a7a-60b8-4ddb-8d89-b2f88f236a84 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.630131 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f2a7a-60b8-4ddb-8d89-b2f88f236a84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.687697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f2a7a-60b8-4ddb-8d89-b2f88f236a84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.688422 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ebfb6-86be-4507-a56e-3375b6563943 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.689147 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f2a7a-60b8-4ddb-8d89-b2f88f236a84 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.693034 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e5e6f-d07e-406e-921d-3e87053b0549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.694542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e5e6f-d07e-406e-921d-3e87053b0549 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.694829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e5e6f-d07e-406e-921d-3e87053b0549 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.695106 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e5e6f-d07e-406e-921d-3e87053b0549 admin admin] PATH_INFO: `/v3/projects/48a302e0f56c4109b00f4e7e965a3518/users/19e1cd18478149568ea9c15a175fdd38/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.698970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 800/1606] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:27 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:27.699782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f2a7a-60b8-4ddb-8d89-b2f88f236a84 service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.710765 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f2a7a-60b8-4ddb-8d89-b2f88f236a84 service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.711225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e5e6f-d07e-406e-921d-3e87053b0549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a302e0f56c4109b00f4e7e965a3518, user_id=19e1cd18478149568ea9c15a175fdd38, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.714769 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e5e6f-d07e-406e-921d-3e87053b0549 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.715398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b447a0b-e0a3-44ba-9cff-8be9ed973fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.716277 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b447a0b-e0a3-44ba-9cff-8be9ed973fac admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.716561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b447a0b-e0a3-44ba-9cff-8be9ed973fac admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.716846 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b447a0b-e0a3-44ba-9cff-8be9ed973fac admin admin] PATH_INFO: `/v3/projects/8ae6a45905d645b4b5da8bfa917955a6/users/000330dc3f1a4b38b58686ee37b3b78c/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.729682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 807/1607] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:53:27 2022] PUT /identity/v3/projects/48a302e0f56c4109b00f4e7e965a3518/users/19e1cd18478149568ea9c15a175fdd38/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:27.730623 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e5e6f-d07e-406e-921d-3e87053b0549 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.733642 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b447a0b-e0a3-44ba-9cff-8be9ed973fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae6a45905d645b4b5da8bfa917955a6, user_id=000330dc3f1a4b38b58686ee37b3b78c, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.736306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b447a0b-e0a3-44ba-9cff-8be9ed973fac admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.751370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 801/1608] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:53:27 2022] PUT /identity/v3/projects/8ae6a45905d645b4b5da8bfa917955a6/users/000330dc3f1a4b38b58686ee37b3b78c/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:27.753100 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f392ef2-ad91-4ec2-9f17-13098d74acbe None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.753676 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f392ef2-ad91-4ec2-9f17-13098d74acbe None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.754226 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f392ef2-ad91-4ec2-9f17-13098d74acbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.774422 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-2f392ef2-ad91-4ec2-9f17-13098d74acbe None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:27.775670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-2f392ef2-ad91-4ec2-9f17-13098d74acbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:27.804551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e5e6f-d07e-406e-921d-3e87053b0549 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:27.812326 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:27.864250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 802/1609] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:27.866057 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cef66d-b177-45ab-bb0a-5b463c03378e None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.866677 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cef66d-b177-45ab-bb0a-5b463c03378e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.867102 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cef66d-b177-45ab-bb0a-5b463c03378e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.883693 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b243520-ebe8-4f29-a7a5-728e36e4618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:27.884590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b243520-ebe8-4f29-a7a5-728e36e4618e admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.884875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b243520-ebe8-4f29-a7a5-728e36e4618e admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.885152 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b243520-ebe8-4f29-a7a5-728e36e4618e admin admin] PATH_INFO: `/v3/projects/147701dfbae64d0a85318187af9dcf2e/users/81f42e71a4d24250874f31f4e8269e04/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.888789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-c0cef66d-b177-45ab-bb0a-5b463c03378e None None] MFA Rules not processed for user `1994043a81bb454297c208839794a479`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:27.890048 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c0cef66d-b177-45ab-bb0a-5b463c03378e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:27.902489 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b243520-ebe8-4f29-a7a5-728e36e4618e admin admin] RBAC: Authorizing `identity:create_grant(project_id=147701dfbae64d0a85318187af9dcf2e, user_id=81f42e71a4d24250874f31f4e8269e04, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:27.905786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b243520-ebe8-4f29-a7a5-728e36e4618e admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:27.909362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:27.924545 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 808/1610] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:53:27 2022] PUT /identity/v3/projects/147701dfbae64d0a85318187af9dcf2e/users/81f42e71a4d24250874f31f4e8269e04/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:27.925516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b243520-ebe8-4f29-a7a5-728e36e4618e admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:27.964302 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 803/1611] 10.222.0.45 () {58 vars in 1058 bytes} [Thu May 26 13:53:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:27.965597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc55f8c-eb30-447b-a42f-5c5d8f31c766 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:27.965895 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc55f8c-eb30-447b-a42f-5c5d8f31c766 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:27.966172 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc55f8c-eb30-447b-a42f-5c5d8f31c766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:27.983505 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-bfc55f8c-eb30-447b-a42f-5c5d8f31c766 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:27.984690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-bfc55f8c-eb30-447b-a42f-5c5d8f31c766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:27.996470 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b243520-ebe8-4f29-a7a5-728e36e4618e admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:28.002201 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142b8af-fc39-4f63-b89a-a94beba39b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:28.003613 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142b8af-fc39-4f63-b89a-a94beba39b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:28.004493 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142b8af-fc39-4f63-b89a-a94beba39b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:28.005176 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142b8af-fc39-4f63-b89a-a94beba39b59 admin admin] PATH_INFO: `/v3/projects/babfeb9d78e84702bb198e870bf921ba/users/a77b045cc6db4aab87bd85100474caf9/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:28.023156 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142b8af-fc39-4f63-b89a-a94beba39b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=babfeb9d78e84702bb198e870bf921ba, user_id=a77b045cc6db4aab87bd85100474caf9, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:28.025929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142b8af-fc39-4f63-b89a-a94beba39b59 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:28.041431 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 809/1612] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:53:27 2022] PUT /identity/v3/projects/babfeb9d78e84702bb198e870bf921ba/users/a77b045cc6db4aab87bd85100474caf9/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:28.042764 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952a551-f765-4a08-95f7-be28ea7a772f None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:28.043051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952a551-f765-4a08-95f7-be28ea7a772f None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:28.043329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952a551-f765-4a08-95f7-be28ea7a772f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:28.070139 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 804/1613] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:28.071549 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86c4e9-6e4c-4c4b-8722-e4cd71bb1841 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:28.071969 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86c4e9-6e4c-4c4b-8722-e4cd71bb1841 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:28.072256 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86c4e9-6e4c-4c4b-8722-e4cd71bb1841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:28.080167 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-8952a551-f765-4a08-95f7-be28ea7a772f None None] MFA Rules not processed for user `19e1cd18478149568ea9c15a175fdd38`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:28.081466 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8952a551-f765-4a08-95f7-be28ea7a772f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:28.095387 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-ee86c4e9-6e4c-4c4b-8722-e4cd71bb1841 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:28.096734 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ee86c4e9-6e4c-4c4b-8722-e4cd71bb1841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:28.155949 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 810/1614] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:28.157446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952a551-f765-4a08-95f7-be28ea7a772f None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:28.158913 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8952a551-f765-4a08-95f7-be28ea7a772f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:28.174584 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 805/1615] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:28.176240 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464071e-4f27-438b-8927-afd8780607d9 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:28.176631 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464071e-4f27-438b-8927-afd8780607d9 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:28.177008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464071e-4f27-438b-8927-afd8780607d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:28.194088 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:28.201860 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-c464071e-4f27-438b-8927-afd8780607d9 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:28.203319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c464071e-4f27-438b-8927-afd8780607d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:28.213488 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 806/1616] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:28.214479 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464071e-4f27-438b-8927-afd8780607d9 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:28.248105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952a551-f765-4a08-95f7-be28ea7a772f None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:28.253501 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee6ef3-e413-45f2-9ca0-d0c08fd482e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:28.254549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee6ef3-e413-45f2-9ca0-d0c08fd482e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:28.254836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee6ef3-e413-45f2-9ca0-d0c08fd482e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:28.255116 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee6ef3-e413-45f2-9ca0-d0c08fd482e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:28.265836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee6ef3-e413-45f2-9ca0-d0c08fd482e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:28.267355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee6ef3-e413-45f2-9ca0-d0c08fd482e9 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:28.278437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 811/1617] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:28.279633 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfe6c4-9135-4035-a0c3-511d27e13547 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:28.279927 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfe6c4-9135-4035-a0c3-511d27e13547 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:28.280214 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfe6c4-9135-4035-a0c3-511d27e13547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:28.309423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:28.321210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-e4dfe6c4-9135-4035-a0c3-511d27e13547 None None] MFA Rules not processed for user `a77b045cc6db4aab87bd85100474caf9`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:28.323494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e4dfe6c4-9135-4035-a0c3-511d27e13547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:28.350461 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464071e-4f27-438b-8927-afd8780607d9 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:28.367917 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631004d-4b1a-4f45-9879-880160b86e7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:28.369643 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631004d-4b1a-4f45-9879-880160b86e7f service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:28.370019 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631004d-4b1a-4f45-9879-880160b86e7f service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:28.370669 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631004d-4b1a-4f45-9879-880160b86e7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:28.415594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 812/1618] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:28.417931 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfe6c4-9135-4035-a0c3-511d27e13547 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:28.437974 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfe6c4-9135-4035-a0c3-511d27e13547 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:28.442489 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4810a93-b273-41fa-a51b-ce3e68684fe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:28.443151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4810a93-b273-41fa-a51b-ce3e68684fe9 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:28.443538 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4810a93-b273-41fa-a51b-ce3e68684fe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:28.444324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4810a93-b273-41fa-a51b-ce3e68684fe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:28.455002 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4810a93-b273-41fa-a51b-ce3e68684fe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:28.456695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4810a93-b273-41fa-a51b-ce3e68684fe9 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:28.462896 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631004d-4b1a-4f45-9879-880160b86e7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:28.465313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631004d-4b1a-4f45-9879-880160b86e7f service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:28.468006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 813/1619] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:28.468919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4810a93-b273-41fa-a51b-ce3e68684fe9 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:28.478135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 807/1620] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:28.479540 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20cb67-e49e-4d9e-8964-440d646a4278 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:28.479983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20cb67-e49e-4d9e-8964-440d646a4278 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:28.480258 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20cb67-e49e-4d9e-8964-440d646a4278 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:28.486547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 808/1621] 10.222.0.45 () {54 vars in 961 bytes} [Thu May 26 13:53:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:53:28.487406 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20cb67-e49e-4d9e-8964-440d646a4278 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:28.492962 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4810a93-b273-41fa-a51b-ce3e68684fe9 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:28.500835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20cb67-e49e-4d9e-8964-440d646a4278 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:28.501026 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4d8e4-de74-4ae0-9777-54d9b22854be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:28.501700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4d8e4-de74-4ae0-9777-54d9b22854be service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:28.502565 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4d8e4-de74-4ae0-9777-54d9b22854be service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:28.502897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4d8e4-de74-4ae0-9777-54d9b22854be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:28.505005 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981e54a-0399-47c3-9773-783daab707a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:28.505728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981e54a-0399-47c3-9773-783daab707a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:28.506056 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981e54a-0399-47c3-9773-783daab707a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:28.506341 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981e54a-0399-47c3-9773-783daab707a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:28.517694 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981e54a-0399-47c3-9773-783daab707a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:28.519594 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981e54a-0399-47c3-9773-783daab707a2 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:28.526893 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4d8e4-de74-4ae0-9777-54d9b22854be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:28.528346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4d8e4-de74-4ae0-9777-54d9b22854be service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:28.530954 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 809/1622] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:28.532588 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18214677-6cdc-4b5b-b18b-693771e82ee9 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:28.532914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18214677-6cdc-4b5b-b18b-693771e82ee9 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:28.533156 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18214677-6cdc-4b5b-b18b-693771e82ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:28.541982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 814/1623] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:28.554378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-18214677-6cdc-4b5b-b18b-693771e82ee9 None None] MFA Rules not processed for user `1994043a81bb454297c208839794a479`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:28.555618 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-18214677-6cdc-4b5b-b18b-693771e82ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:28.565429 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 810/1624] 10.222.0.45 () {58 vars in 1058 bytes} [Thu May 26 13:53:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:28.574238 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4d8e4-de74-4ae0-9777-54d9b22854be service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:28.587750 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4d8e4-de74-4ae0-9777-54d9b22854be service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:28.593466 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7c4a1-27df-4254-98c7-2a79320d528d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:28.594111 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7c4a1-27df-4254-98c7-2a79320d528d service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:28.594396 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7c4a1-27df-4254-98c7-2a79320d528d service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:28.594673 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7c4a1-27df-4254-98c7-2a79320d528d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:28.604248 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7c4a1-27df-4254-98c7-2a79320d528d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:28.605893 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7c4a1-27df-4254-98c7-2a79320d528d service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:28.616356 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 815/1625] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:28.790811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf1d4e-18e7-4b02-b741-65b0887e5717 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:28.791102 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf1d4e-18e7-4b02-b741-65b0887e5717 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:28.791385 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf1d4e-18e7-4b02-b741-65b0887e5717 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:28.793018 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 811/1626] 10.222.0.45 () {54 vars in 912 bytes} [Thu May 26 13:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:53:28.798155 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf834f88-9e0f-40e4-9437-567dc5d4fd75 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:28.798622 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf834f88-9e0f-40e4-9437-567dc5d4fd75 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:28.799068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf834f88-9e0f-40e4-9437-567dc5d4fd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:28.821425 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-cf834f88-9e0f-40e4-9437-567dc5d4fd75 None None] MFA Rules not processed for user `1994043a81bb454297c208839794a479`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:28.823221 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-cf834f88-9e0f-40e4-9437-567dc5d4fd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:28.851926 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf1d4e-18e7-4b02-b741-65b0887e5717 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:28.853760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-65cf1d4e-18e7-4b02-b741-65b0887e5717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:28.862459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 816/1627] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 13:53:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:28.924121 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf834f88-9e0f-40e4-9437-567dc5d4fd75 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:28.943006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf834f88-9e0f-40e4-9437-567dc5d4fd75 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:28.955791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ef63c-6ead-475b-b3c6-1a2b4f0c54d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:28.957867 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf1d4e-18e7-4b02-b741-65b0887e5717 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:28.959851 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ef63c-6ead-475b-b3c6-1a2b4f0c54d4 service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:28.960259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ef63c-6ead-475b-b3c6-1a2b4f0c54d4 service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:28.960898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ef63c-6ead-475b-b3c6-1a2b4f0c54d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:28.970141 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dce617-e7ac-4532-b9e4-a8ebf52124f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3039ec7e613464c8a71f4440dfe8bc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:28.970953 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dce617-e7ac-4532-b9e4-a8ebf52124f1 service glance] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:28.971512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dce617-e7ac-4532-b9e4-a8ebf52124f1 service glance] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:28.973724 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dce617-e7ac-4532-b9e4-a8ebf52124f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:28.986198 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ef63c-6ead-475b-b3c6-1a2b4f0c54d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:28.991986 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ef63c-6ead-475b-b3c6-1a2b4f0c54d4 service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:29.003246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dce617-e7ac-4532-b9e4-a8ebf52124f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:29.008236 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dce617-e7ac-4532-b9e4-a8ebf52124f1 service glance] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:29.018742 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 817/1628] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:53:29.027530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 812/1629] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:53:29.065724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462b5e0-4889-4402-ad2d-5cb70c8cb84a None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:29.066583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462b5e0-4889-4402-ad2d-5cb70c8cb84a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:29.066997 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462b5e0-4889-4402-ad2d-5cb70c8cb84a None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:29.070634 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 818/1630] 10.222.0.45 () {54 vars in 912 bytes} [Thu May 26 13:53:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:53:29.079742 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e236ec-de7f-4225-ad34-825a79e80f34 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:29.080915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e236ec-de7f-4225-ad34-825a79e80f34 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:29.080915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e236ec-de7f-4225-ad34-825a79e80f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:29.115179 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-c2e236ec-de7f-4225-ad34-825a79e80f34 None None] MFA Rules not processed for user `1994043a81bb454297c208839794a479`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:29.116930 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c2e236ec-de7f-4225-ad34-825a79e80f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:29.133793 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 813/1631] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 13:53:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:29.143127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462b5e0-4889-4402-ad2d-5cb70c8cb84a None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:29.220839 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462b5e0-4889-4402-ad2d-5cb70c8cb84a None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:29.225795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58fae9-4f96-4919-8777-4164122e8ddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:29.226562 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58fae9-4f96-4919-8777-4164122e8ddc service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:29.227912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58fae9-4f96-4919-8777-4164122e8ddc service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:29.228706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58fae9-4f96-4919-8777-4164122e8ddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:29.245997 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58fae9-4f96-4919-8777-4164122e8ddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:29.247870 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58fae9-4f96-4919-8777-4164122e8ddc service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:29.264116 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 819/1632] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:29.535671 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7d7a2-2679-451f-a111-8af6295ad95d None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:29.536184 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7d7a2-2679-451f-a111-8af6295ad95d None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:29.536269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7d7a2-2679-451f-a111-8af6295ad95d None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:29.537937 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 814/1633] 10.222.0.45 () {54 vars in 912 bytes} [Thu May 26 13:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:53:29.546384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbbf72-d6b2-4d8e-b6bb-aa1894becdf9 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:29.547011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbbf72-d6b2-4d8e-b6bb-aa1894becdf9 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:29.547533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbbf72-d6b2-4d8e-b6bb-aa1894becdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:29.625579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-e8bbbf72-d6b2-4d8e-b6bb-aa1894becdf9 None None] MFA Rules not processed for user `45105360300a4cae802fdbda91b9d5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:29.626950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e8bbbf72-d6b2-4d8e-b6bb-aa1894becdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:29.647372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 820/1634] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 13:53:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:53:29.664126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7d7a2-2679-451f-a111-8af6295ad95d None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:29.693586 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7d7a2-2679-451f-a111-8af6295ad95d None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:29.701201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809c497-b780-45c5-83ff-047fd26f82ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:29.703005 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809c497-b780-45c5-83ff-047fd26f82ef service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:29.703005 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809c497-b780-45c5-83ff-047fd26f82ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:29.703005 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809c497-b780-45c5-83ff-047fd26f82ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:29.718510 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809c497-b780-45c5-83ff-047fd26f82ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:29.722515 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809c497-b780-45c5-83ff-047fd26f82ef service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:29.732755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:29.741443 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 815/1635] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:30.423174 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbbf72-d6b2-4d8e-b6bb-aa1894becdf9 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:30.444520 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbbf72-d6b2-4d8e-b6bb-aa1894becdf9 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:30.453062 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084a325-fca1-4323-88d2-58dda2881804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:30.454143 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084a325-fca1-4323-88d2-58dda2881804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:30.454529 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084a325-fca1-4323-88d2-58dda2881804 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:30.455073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084a325-fca1-4323-88d2-58dda2881804 admin admin] PATH_INFO: `/v3/users/19e1cd18478149568ea9c15a175fdd38` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:30.458054 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084a325-fca1-4323-88d2-58dda2881804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e1cd18478149568ea9c15a175fdd38)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:30.459259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: WARNING py.warnings [None req-d084a325-fca1-4323-88d2-58dda2881804 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 13:53:30.459259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: warnings.warn(msg) May 26 13:53:30.459259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: May 26 13:53:30.461093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084a325-fca1-4323-88d2-58dda2881804 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:30.508790 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:30.569409 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d084a325-fca1-4323-88d2-58dda2881804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e1cd18478149568ea9c15a175fdd38'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:30.570396 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d084a325-fca1-4323-88d2-58dda2881804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e1cd18478149568ea9c15a175fdd38'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:30.571363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d084a325-fca1-4323-88d2-58dda2881804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e1cd18478149568ea9c15a175fdd38'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:30.590569 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d084a325-fca1-4323-88d2-58dda2881804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e1cd18478149568ea9c15a175fdd38'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:30.604181 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d084a325-fca1-4323-88d2-58dda2881804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e1cd18478149568ea9c15a175fdd38'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:30.653317 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 821/1636] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:53:30 2022] DELETE /identity/v3/users/19e1cd18478149568ea9c15a175fdd38 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:30.656561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610396e-bb53-49b6-accf-0f19073475d2 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:30.657096 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610396e-bb53-49b6-accf-0f19073475d2 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:30.657096 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610396e-bb53-49b6-accf-0f19073475d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:30.723765 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-e610396e-bb53-49b6-accf-0f19073475d2 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:30.725360 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e610396e-bb53-49b6-accf-0f19073475d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:30.854518 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 816/1637] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:30.898744 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084a325-fca1-4323-88d2-58dda2881804 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:30.900707 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d084a325-fca1-4323-88d2-58dda2881804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:31.059841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084a325-fca1-4323-88d2-58dda2881804 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:31.070400 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4af579-7a22-4b7a-b0bd-31e09c3ff566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:31.072901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4af579-7a22-4b7a-b0bd-31e09c3ff566 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:31.072901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4af579-7a22-4b7a-b0bd-31e09c3ff566 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:31.072901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4af579-7a22-4b7a-b0bd-31e09c3ff566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:31.095951 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4af579-7a22-4b7a-b0bd-31e09c3ff566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:31.098500 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4af579-7a22-4b7a-b0bd-31e09c3ff566 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:31.129465 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 822/1638] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:31.398549 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba0ae8-9787-427b-8cd9-f984ea07b283 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:31.398833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba0ae8-9787-427b-8cd9-f984ea07b283 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:31.399111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba0ae8-9787-427b-8cd9-f984ea07b283 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:31.400471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 817/1639] 10.222.0.45 () {54 vars in 960 bytes} [Thu May 26 13:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:53:31.406471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc545aa4-8e44-498b-85e8-9acad0f11c44 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:31.406763 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc545aa4-8e44-498b-85e8-9acad0f11c44 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:31.416559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc545aa4-8e44-498b-85e8-9acad0f11c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:31.449574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-cc545aa4-8e44-498b-85e8-9acad0f11c44 None None] MFA Rules not processed for user `8b0db68b7fda4da29eb13689f3fd7b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:31.450853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-cc545aa4-8e44-498b-85e8-9acad0f11c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:31.656947 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba0ae8-9787-427b-8cd9-f984ea07b283 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:31.674113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 823/1640] 10.222.0.45 () {58 vars in 1057 bytes} [Thu May 26 13:53:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:53:31.684884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba0ae8-9787-427b-8cd9-f984ea07b283 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:31.703413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393265e5-ef64-45a4-ada0-f2d8e733b063 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0db68b7fda4da29eb13689f3fd7b5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:31.704605 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393265e5-ef64-45a4-ada0-f2d8e733b063 service placement] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:31.705049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393265e5-ef64-45a4-ada0-f2d8e733b063 service placement] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:31.710743 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393265e5-ef64-45a4-ada0-f2d8e733b063 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:31.719304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-393265e5-ef64-45a4-ada0-f2d8e733b063 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:31.739121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393265e5-ef64-45a4-ada0-f2d8e733b063 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:31.742726 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393265e5-ef64-45a4-ada0-f2d8e733b063 service placement] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:31.813592 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 818/1641] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:32.788556 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc545aa4-8e44-498b-85e8-9acad0f11c44 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:32.794356 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-cc545aa4-8e44-498b-85e8-9acad0f11c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:32.843901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc545aa4-8e44-498b-85e8-9acad0f11c44 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:32.857518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b11304-51d4-4e54-8ff1-1ad88605906c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:32.858328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b11304-51d4-4e54-8ff1-1ad88605906c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:32.858617 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b11304-51d4-4e54-8ff1-1ad88605906c admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:32.858900 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b11304-51d4-4e54-8ff1-1ad88605906c admin admin] PATH_INFO: `/v3/projects/48a302e0f56c4109b00f4e7e965a3518` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:32.860654 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b11304-51d4-4e54-8ff1-1ad88605906c admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a302e0f56c4109b00f4e7e965a3518)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:32.870018 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b11304-51d4-4e54-8ff1-1ad88605906c admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:32.931168 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:32.969625 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-86b11304-51d4-4e54-8ff1-1ad88605906c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a302e0f56c4109b00f4e7e965a3518', 'request_id': 'req-86b11304-51d4-4e54-8ff1-1ad88605906c'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:32.978631 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-86b11304-51d4-4e54-8ff1-1ad88605906c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a302e0f56c4109b00f4e7e965a3518', 'request_id': 'req-86b11304-51d4-4e54-8ff1-1ad88605906c'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:32.992349 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-86b11304-51d4-4e54-8ff1-1ad88605906c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a302e0f56c4109b00f4e7e965a3518', 'request_id': 'req-86b11304-51d4-4e54-8ff1-1ad88605906c'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:33.027653 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-86b11304-51d4-4e54-8ff1-1ad88605906c admin admin] The token cache is being invalidate because project 48a302e0f56c4109b00f4e7e965a3518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:53:33.031039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-86b11304-51d4-4e54-8ff1-1ad88605906c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:33.033201 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-86b11304-51d4-4e54-8ff1-1ad88605906c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:33.039407 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 824/1642] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:53:32 2022] DELETE /identity/v3/projects/48a302e0f56c4109b00f4e7e965a3518 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:33.044191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c362866-3b6c-4a34-a957-069f75e05123 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:33.044696 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c362866-3b6c-4a34-a957-069f75e05123 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:33.044769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c362866-3b6c-4a34-a957-069f75e05123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:33.075969 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-3c362866-3b6c-4a34-a957-069f75e05123 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:33.077706 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-3c362866-3b6c-4a34-a957-069f75e05123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:33.173384 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 819/1643] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:33.181397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb37443-0c9e-46a4-9c88-e9678693d32b None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:33.181728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb37443-0c9e-46a4-9c88-e9678693d32b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:33.182021 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb37443-0c9e-46a4-9c88-e9678693d32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:33.206512 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-dfb37443-0c9e-46a4-9c88-e9678693d32b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:33.208082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-dfb37443-0c9e-46a4-9c88-e9678693d32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:33.220398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 825/1644] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:33.225414 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c362866-3b6c-4a34-a957-069f75e05123 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:33.242671 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c362866-3b6c-4a34-a957-069f75e05123 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:33.262319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc07df3-5f14-487e-9de5-e5a18e1ae9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:33.265580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc07df3-5f14-487e-9de5-e5a18e1ae9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:33.265948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc07df3-5f14-487e-9de5-e5a18e1ae9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:33.266148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc07df3-5f14-487e-9de5-e5a18e1ae9e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:33.268007 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc07df3-5f14-487e-9de5-e5a18e1ae9e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:53:33.268315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc07df3-5f14-487e-9de5-e5a18e1ae9e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:33.281110 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc07df3-5f14-487e-9de5-e5a18e1ae9e5 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:33.303337 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 820/1645] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:53:33.303538 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb37443-0c9e-46a4-9c88-e9678693d32b None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:33.318851 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb37443-0c9e-46a4-9c88-e9678693d32b None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:33.324817 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa19a3-bdf5-4353-a7e9-662cec5f6e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:33.325545 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa19a3-bdf5-4353-a7e9-662cec5f6e31 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:33.325831 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa19a3-bdf5-4353-a7e9-662cec5f6e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:33.326283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa19a3-bdf5-4353-a7e9-662cec5f6e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:33.326864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa19a3-bdf5-4353-a7e9-662cec5f6e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:33.329508 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa19a3-bdf5-4353-a7e9-662cec5f6e31 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:33.380110 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 826/1646] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:53:33 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:33.384829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc07df3-5f14-487e-9de5-e5a18e1ae9e5 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:33.398800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc07df3-5f14-487e-9de5-e5a18e1ae9e5 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:33.486745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0ae1b-2c0e-4eec-92c3-eceff9b5acdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:33.487487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0ae1b-2c0e-4eec-92c3-eceff9b5acdf admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:33.487820 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0ae1b-2c0e-4eec-92c3-eceff9b5acdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:33.488198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0ae1b-2c0e-4eec-92c3-eceff9b5acdf admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:33.488901 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0ae1b-2c0e-4eec-92c3-eceff9b5acdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:33.491794 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0ae1b-2c0e-4eec-92c3-eceff9b5acdf admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:33.524182 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 821/1647] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:53:33 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:33.524405 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa19a3-bdf5-4353-a7e9-662cec5f6e31 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:33.538280 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa19a3-bdf5-4353-a7e9-662cec5f6e31 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:33.553758 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c2afe-79cd-4683-a83e-b14616c60cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:33.554522 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c2afe-79cd-4683-a83e-b14616c60cff admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:33.554819 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c2afe-79cd-4683-a83e-b14616c60cff admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:33.555230 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c2afe-79cd-4683-a83e-b14616c60cff admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:33.556335 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c2afe-79cd-4683-a83e-b14616c60cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:33.558626 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c2afe-79cd-4683-a83e-b14616c60cff admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:33.595276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 827/1648] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:33.599347 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0ae1b-2c0e-4eec-92c3-eceff9b5acdf admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:33.622186 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:33.636901 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0ae1b-2c0e-4eec-92c3-eceff9b5acdf admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:33.649598 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd999c05-d79f-40af-bc18-e4aec5be9abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:33.650432 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd999c05-d79f-40af-bc18-e4aec5be9abc admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:33.652146 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd999c05-d79f-40af-bc18-e4aec5be9abc admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:33.657656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd999c05-d79f-40af-bc18-e4aec5be9abc admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:33.664214 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd999c05-d79f-40af-bc18-e4aec5be9abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:33.671682 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd999c05-d79f-40af-bc18-e4aec5be9abc admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:33.748462 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c2afe-79cd-4683-a83e-b14616c60cff admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:33.749666 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 822/1649] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:33.761801 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c2afe-79cd-4683-a83e-b14616c60cff admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:33.786381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b51167-9761-4a01-8497-bb9ed443ec22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:33.788155 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b51167-9761-4a01-8497-bb9ed443ec22 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:33.788494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b51167-9761-4a01-8497-bb9ed443ec22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:33.788777 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b51167-9761-4a01-8497-bb9ed443ec22 admin admin] PATH_INFO: `/v3/projects/7e368fb8096f4b679b584932f009fb50/users/969bff2c510a4751a1dd3c8d9fcaec53/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:33.823003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b51167-9761-4a01-8497-bb9ed443ec22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e368fb8096f4b679b584932f009fb50, user_id=969bff2c510a4751a1dd3c8d9fcaec53, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:33.825850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b51167-9761-4a01-8497-bb9ed443ec22 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:33.859021 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 828/1650] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:53:33 2022] PUT /identity/v3/projects/7e368fb8096f4b679b584932f009fb50/users/969bff2c510a4751a1dd3c8d9fcaec53/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:53:33.874478 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb3c50-7f44-4a6d-8136-a61c94db67fb None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:33.877212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb3c50-7f44-4a6d-8136-a61c94db67fb None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:33.878383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb3c50-7f44-4a6d-8136-a61c94db67fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:33.996439 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a9bb3c50-7f44-4a6d-8136-a61c94db67fb None None] MFA Rules not processed for user `969bff2c510a4751a1dd3c8d9fcaec53`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:33.999480 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a9bb3c50-7f44-4a6d-8136-a61c94db67fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:34.181501 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 823/1651] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:34.182497 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b51167-9761-4a01-8497-bb9ed443ec22 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:34.415666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b51167-9761-4a01-8497-bb9ed443ec22 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:34.432574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3d835-c623-4354-b2b8-2e129fa6e644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:34.433926 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3d835-c623-4354-b2b8-2e129fa6e644 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:34.434287 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3d835-c623-4354-b2b8-2e129fa6e644 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:34.435180 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3d835-c623-4354-b2b8-2e129fa6e644 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:34.435960 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3d835-c623-4354-b2b8-2e129fa6e644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:34.437987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3d835-c623-4354-b2b8-2e129fa6e644 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:34.500953 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 829/1652] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:53:34 2022] POST /identity/v3/projects => generated 371 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:53:34.505039 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb3c50-7f44-4a6d-8136-a61c94db67fb None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:34.522719 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb3c50-7f44-4a6d-8136-a61c94db67fb None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:34.665605 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bb43e-9344-4f96-85fe-a137ed07dbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:34.666943 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bb43e-9344-4f96-85fe-a137ed07dbea admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:34.667653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bb43e-9344-4f96-85fe-a137ed07dbea admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:34.667653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bb43e-9344-4f96-85fe-a137ed07dbea admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:34.674720 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bb43e-9344-4f96-85fe-a137ed07dbea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:34.682725 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bb43e-9344-4f96-85fe-a137ed07dbea admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:34.728232 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 824/1653] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:53:34 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:34.731824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3d835-c623-4354-b2b8-2e129fa6e644 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:34.747146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3d835-c623-4354-b2b8-2e129fa6e644 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:34.755210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b02c2-bf59-4dc4-af31-99242934962c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:34.757698 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b02c2-bf59-4dc4-af31-99242934962c admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:34.759223 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b02c2-bf59-4dc4-af31-99242934962c admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:34.759972 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b02c2-bf59-4dc4-af31-99242934962c admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:34.761614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b02c2-bf59-4dc4-af31-99242934962c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:34.765675 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b02c2-bf59-4dc4-af31-99242934962c admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:34.847415 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bb43e-9344-4f96-85fe-a137ed07dbea admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:34.875769 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 830/1654] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:34.882650 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bb43e-9344-4f96-85fe-a137ed07dbea admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:34.894837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c1806-fa96-4f8e-a3e7-01672898a5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:34.899903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c1806-fa96-4f8e-a3e7-01672898a5f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:34.900375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c1806-fa96-4f8e-a3e7-01672898a5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:34.900665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c1806-fa96-4f8e-a3e7-01672898a5f8 admin admin] PATH_INFO: `/v3/projects/f5ec6518b83e4544900c25659ab8ac95/users/5de57d99dac949fcbddb72a7a50c379c/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:34.966118 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c1806-fa96-4f8e-a3e7-01672898a5f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ec6518b83e4544900c25659ab8ac95, user_id=5de57d99dac949fcbddb72a7a50c379c, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:34.969206 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c1806-fa96-4f8e-a3e7-01672898a5f8 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:35.013237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 825/1655] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:53:34 2022] PUT /identity/v3/projects/f5ec6518b83e4544900c25659ab8ac95/users/5de57d99dac949fcbddb72a7a50c379c/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:35.017744 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b02c2-bf59-4dc4-af31-99242934962c admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:35.046066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b02c2-bf59-4dc4-af31-99242934962c admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:35.092316 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c1806-fa96-4f8e-a3e7-01672898a5f8 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:35.094267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-652c1806-fa96-4f8e-a3e7-01672898a5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:35.168953 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:35.244204 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:35.274235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c1806-fa96-4f8e-a3e7-01672898a5f8 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:35.285230 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2aa77-001c-46c7-b0cd-1389df65a30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:35.285970 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2aa77-001c-46c7-b0cd-1389df65a30f admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:35.286255 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2aa77-001c-46c7-b0cd-1389df65a30f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:35.286531 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2aa77-001c-46c7-b0cd-1389df65a30f admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:35.287289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2aa77-001c-46c7-b0cd-1389df65a30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:35.288921 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2aa77-001c-46c7-b0cd-1389df65a30f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:35.295348 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6f60b-1f73-49d6-a547-d814719d4326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:35.296253 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6f60b-1f73-49d6-a547-d814719d4326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:35.296535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6f60b-1f73-49d6-a547-d814719d4326 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:35.296812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6f60b-1f73-49d6-a547-d814719d4326 admin admin] PATH_INFO: `/v3/users/a77b045cc6db4aab87bd85100474caf9` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:35.298967 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6f60b-1f73-49d6-a547-d814719d4326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a77b045cc6db4aab87bd85100474caf9)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:35.301073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6f60b-1f73-49d6-a547-d814719d4326 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:35.331647 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 831/1656] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:35.332681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2aa77-001c-46c7-b0cd-1389df65a30f admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:35.359005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2aa77-001c-46c7-b0cd-1389df65a30f admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:35.376399 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda61a6d-38ce-4193-bef0-f32997359dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:35.377196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda61a6d-38ce-4193-bef0-f32997359dca admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:35.377631 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda61a6d-38ce-4193-bef0-f32997359dca admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:35.377913 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda61a6d-38ce-4193-bef0-f32997359dca admin admin] PATH_INFO: `/v3/projects/f5ec6518b83e4544900c25659ab8ac95/users/5de57d99dac949fcbddb72a7a50c379c/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:35.384824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda61a6d-38ce-4193-bef0-f32997359dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ec6518b83e4544900c25659ab8ac95, user_id=5de57d99dac949fcbddb72a7a50c379c, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:35.393160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda61a6d-38ce-4193-bef0-f32997359dca admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:35.483207 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 832/1657] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:53:35 2022] PUT /identity/v3/projects/f5ec6518b83e4544900c25659ab8ac95/users/5de57d99dac949fcbddb72a7a50c379c/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:35.483207 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a2d2a-fda4-488e-b0ce-8182ee5c2008 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:35.483207 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a2d2a-fda4-488e-b0ce-8182ee5c2008 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:35.483207 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a2d2a-fda4-488e-b0ce-8182ee5c2008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:35.495695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-45f6f60b-1f73-49d6-a547-d814719d4326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a77b045cc6db4aab87bd85100474caf9'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:35.546670 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-f95a2d2a-fda4-488e-b0ce-8182ee5c2008 None None] MFA Rules not processed for user `135410329e56486c8ccb65b1f2d87aca`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:35.552901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-f95a2d2a-fda4-488e-b0ce-8182ee5c2008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:35.570009 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-45f6f60b-1f73-49d6-a547-d814719d4326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a77b045cc6db4aab87bd85100474caf9'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:35.570782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-45f6f60b-1f73-49d6-a547-d814719d4326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a77b045cc6db4aab87bd85100474caf9'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:35.571974 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-45f6f60b-1f73-49d6-a547-d814719d4326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a77b045cc6db4aab87bd85100474caf9'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:35.605619 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-45f6f60b-1f73-49d6-a547-d814719d4326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a77b045cc6db4aab87bd85100474caf9'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:35.650327 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 826/1658] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:53:35 2022] DELETE /identity/v3/users/a77b045cc6db4aab87bd85100474caf9 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:35.652948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1d4be-a68d-454c-975e-4733eda9a6fa None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:35.653252 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1d4be-a68d-454c-975e-4733eda9a6fa None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:35.653560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1d4be-a68d-454c-975e-4733eda9a6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:35.730655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-92f1d4be-a68d-454c-975e-4733eda9a6fa None None] MFA Rules not processed for user `5de57d99dac949fcbddb72a7a50c379c`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:35.734240 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-92f1d4be-a68d-454c-975e-4733eda9a6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:35.817126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 833/1659] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 13:53:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:35.822349 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206ea79-4984-49f7-99be-0717b393045b None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:35.822643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206ea79-4984-49f7-99be-0717b393045b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:35.823633 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206ea79-4984-49f7-99be-0717b393045b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:35.883438 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-4206ea79-4984-49f7-99be-0717b393045b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:35.886690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-4206ea79-4984-49f7-99be-0717b393045b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:35.985476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 827/1660] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:35 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:36.012632 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1d4be-a68d-454c-975e-4733eda9a6fa None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:36.016026 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-92f1d4be-a68d-454c-975e-4733eda9a6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:36.077912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 834/1661] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:36.105234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206ea79-4984-49f7-99be-0717b393045b None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:36.106817 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-4206ea79-4984-49f7-99be-0717b393045b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:36.184392 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:36.188593 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1d4be-a68d-454c-975e-4733eda9a6fa None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:36.213727 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455074d-6f64-4fa8-8eb2-492988a10c41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:36.214420 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455074d-6f64-4fa8-8eb2-492988a10c41 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:36.214712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455074d-6f64-4fa8-8eb2-492988a10c41 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:36.214986 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455074d-6f64-4fa8-8eb2-492988a10c41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:36.233245 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:36.235824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206ea79-4984-49f7-99be-0717b393045b None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:36.239094 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455074d-6f64-4fa8-8eb2-492988a10c41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:36.242959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455074d-6f64-4fa8-8eb2-492988a10c41 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:36.250515 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580da84-97c0-47db-95d0-ea6e07887237 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e517dc43cc6d401e820c65ad4c941386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:36.251582 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580da84-97c0-47db-95d0-ea6e07887237 service swift] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:36.251685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580da84-97c0-47db-95d0-ea6e07887237 service swift] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:36.251948 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580da84-97c0-47db-95d0-ea6e07887237 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:36.275075 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 828/1662] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:36 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:36.276198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455074d-6f64-4fa8-8eb2-492988a10c41 service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:36.283648 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-5455074d-6f64-4fa8-8eb2-492988a10c41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:36.347418 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580da84-97c0-47db-95d0-ea6e07887237 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:36.349206 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580da84-97c0-47db-95d0-ea6e07887237 service swift] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:36.366035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 835/1663] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 13:53:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 13:53:36.510342 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455074d-6f64-4fa8-8eb2-492988a10c41 service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:36.524004 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815afd63-778a-4870-a337-e7a2ad17b4f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:36.524004 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815afd63-778a-4870-a337-e7a2ad17b4f0 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:36.524004 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815afd63-778a-4870-a337-e7a2ad17b4f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:36.524004 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815afd63-778a-4870-a337-e7a2ad17b4f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:36.532154 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580da84-97c0-47db-95d0-ea6e07887237 service swift] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:36.533709 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-5580da84-97c0-47db-95d0-ea6e07887237 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:36.558426 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580da84-97c0-47db-95d0-ea6e07887237 service swift] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:36.566709 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815afd63-778a-4870-a337-e7a2ad17b4f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:36.568766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815afd63-778a-4870-a337-e7a2ad17b4f0 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:36.575644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0af171-1cf8-469c-abc0-12a52e405429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:36.576537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0af171-1cf8-469c-abc0-12a52e405429 service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:36.578497 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0af171-1cf8-469c-abc0-12a52e405429 service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:36.578799 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0af171-1cf8-469c-abc0-12a52e405429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:36.585560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7a0af171-1cf8-469c-abc0-12a52e405429 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:36.611534 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 829/1664] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:36.756643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0af171-1cf8-469c-abc0-12a52e405429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:36.758610 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0af171-1cf8-469c-abc0-12a52e405429 service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:36.775976 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 836/1665] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:39.796113 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815afd63-778a-4870-a337-e7a2ad17b4f0 service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:39.797703 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-815afd63-778a-4870-a337-e7a2ad17b4f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:39.830126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815afd63-778a-4870-a337-e7a2ad17b4f0 service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:39.842945 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc197c0-c4c0-4dca-bdb5-25202bcebb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:39.843835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc197c0-c4c0-4dca-bdb5-25202bcebb4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:39.844103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc197c0-c4c0-4dca-bdb5-25202bcebb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:39.844482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc197c0-c4c0-4dca-bdb5-25202bcebb4e admin admin] PATH_INFO: `/v3/projects/babfeb9d78e84702bb198e870bf921ba` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:39.845985 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc197c0-c4c0-4dca-bdb5-25202bcebb4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=babfeb9d78e84702bb198e870bf921ba)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:39.849223 dv-cinder-842130-1-smb devstack@keystone.service[91766]: WARNING py.warnings [None req-6dc197c0-c4c0-4dca-bdb5-25202bcebb4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 13:53:39.849223 dv-cinder-842130-1-smb devstack@keystone.service[91766]: warnings.warn(msg) May 26 13:53:39.849223 dv-cinder-842130-1-smb devstack@keystone.service[91766]: May 26 13:53:39.852184 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc197c0-c4c0-4dca-bdb5-25202bcebb4e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:40.011912 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6dc197c0-c4c0-4dca-bdb5-25202bcebb4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'babfeb9d78e84702bb198e870bf921ba', 'request_id': 'req-6dc197c0-c4c0-4dca-bdb5-25202bcebb4e'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:40.045981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6dc197c0-c4c0-4dca-bdb5-25202bcebb4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'babfeb9d78e84702bb198e870bf921ba', 'request_id': 'req-6dc197c0-c4c0-4dca-bdb5-25202bcebb4e'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:40.065701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6dc197c0-c4c0-4dca-bdb5-25202bcebb4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'babfeb9d78e84702bb198e870bf921ba', 'request_id': 'req-6dc197c0-c4c0-4dca-bdb5-25202bcebb4e'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:40.090583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6dc197c0-c4c0-4dca-bdb5-25202bcebb4e admin admin] The token cache is being invalidate because project babfeb9d78e84702bb198e870bf921ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:53:40.090934 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6dc197c0-c4c0-4dca-bdb5-25202bcebb4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:40.091538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6dc197c0-c4c0-4dca-bdb5-25202bcebb4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:40.093397 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 830/1666] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:53:39 2022] DELETE /identity/v3/projects/babfeb9d78e84702bb198e870bf921ba => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:40.098371 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249582cc-607d-476c-a978-0d5679608deb None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:40.098965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249582cc-607d-476c-a978-0d5679608deb None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:40.098965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249582cc-607d-476c-a978-0d5679608deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:40.133021 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-249582cc-607d-476c-a978-0d5679608deb None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:40.134444 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-249582cc-607d-476c-a978-0d5679608deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:40.153251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0901ed-0059-4c97-9bdd-99c5f7b8b5d0 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:40.153987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0901ed-0059-4c97-9bdd-99c5f7b8b5d0 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:40.153987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0901ed-0059-4c97-9bdd-99c5f7b8b5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:40.236540 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-ab0901ed-0059-4c97-9bdd-99c5f7b8b5d0 None None] MFA Rules not processed for user `45105360300a4cae802fdbda91b9d5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:40.243466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ab0901ed-0059-4c97-9bdd-99c5f7b8b5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:40.419646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 831/1667] 10.222.0.55 () {58 vars in 1015 bytes} [Thu May 26 13:53:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:40.437291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0901ed-0059-4c97-9bdd-99c5f7b8b5d0 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:40.443451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ab0901ed-0059-4c97-9bdd-99c5f7b8b5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:40.498787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 837/1668] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:40.500218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0901ed-0059-4c97-9bdd-99c5f7b8b5d0 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:40.508199 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5816226-90da-45de-898b-976e00ac9cc0 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:40.508800 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5816226-90da-45de-898b-976e00ac9cc0 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:40.509612 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5816226-90da-45de-898b-976e00ac9cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:40.524754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60671f8-7811-44e9-882d-6761d0951a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:40.525855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60671f8-7811-44e9-882d-6761d0951a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:40.528923 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60671f8-7811-44e9-882d-6761d0951a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:40.529401 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60671f8-7811-44e9-882d-6761d0951a24 admin admin] PATH_INFO: `/v3/users/6a2e4a01c3034c0cbe72a8083fd4ff93` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:40.537812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60671f8-7811-44e9-882d-6761d0951a24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a2e4a01c3034c0cbe72a8083fd4ff93)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:40.539965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60671f8-7811-44e9-882d-6761d0951a24 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:40.620179 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-e5816226-90da-45de-898b-976e00ac9cc0 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:40.621827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e5816226-90da-45de-898b-976e00ac9cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:40.656192 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:40.663984 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 838/1669] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:40.671708 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5816226-90da-45de-898b-976e00ac9cc0 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:40.697901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5816226-90da-45de-898b-976e00ac9cc0 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:40.718303 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-c60671f8-7811-44e9-882d-6761d0951a24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a2e4a01c3034c0cbe72a8083fd4ff93'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:40.743769 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9990a3f-f2fd-4a7d-a52b-1d6140d62ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:40.750788 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9990a3f-f2fd-4a7d-a52b-1d6140d62ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:40.751253 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9990a3f-f2fd-4a7d-a52b-1d6140d62ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:40.751744 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9990a3f-f2fd-4a7d-a52b-1d6140d62ad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:40.769861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9990a3f-f2fd-4a7d-a52b-1d6140d62ad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:53:40.770197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9990a3f-f2fd-4a7d-a52b-1d6140d62ad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:40.786050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9990a3f-f2fd-4a7d-a52b-1d6140d62ad0 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:40.787171 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-c60671f8-7811-44e9-882d-6761d0951a24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a2e4a01c3034c0cbe72a8083fd4ff93'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:40.788315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-c60671f8-7811-44e9-882d-6761d0951a24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a2e4a01c3034c0cbe72a8083fd4ff93'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:40.789134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-c60671f8-7811-44e9-882d-6761d0951a24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a2e4a01c3034c0cbe72a8083fd4ff93'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:40.807103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-c60671f8-7811-44e9-882d-6761d0951a24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a2e4a01c3034c0cbe72a8083fd4ff93'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:40.843529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 832/1670] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:53:40 2022] DELETE /identity/v3/users/6a2e4a01c3034c0cbe72a8083fd4ff93 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:40.856148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60671f8-7811-44e9-882d-6761d0951a24 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:40.857806 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c60671f8-7811-44e9-882d-6761d0951a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:40.908871 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 839/1671] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:53:40.929788 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d9dc5-0a05-4cfb-9018-b5be21c73e33 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:40.932236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d9dc5-0a05-4cfb-9018-b5be21c73e33 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:40.937851 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d9dc5-0a05-4cfb-9018-b5be21c73e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:41.037309 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-c28d9dc5-0a05-4cfb-9018-b5be21c73e33 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:41.041210 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60671f8-7811-44e9-882d-6761d0951a24 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:41.044947 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-c28d9dc5-0a05-4cfb-9018-b5be21c73e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:41.051051 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f0ea9-988f-4dc2-b554-3475e2be735e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:41.051665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f0ea9-988f-4dc2-b554-3475e2be735e service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:41.052042 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f0ea9-988f-4dc2-b554-3475e2be735e service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:41.052265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f0ea9-988f-4dc2-b554-3475e2be735e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:41.057927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1a7f0ea9-988f-4dc2-b554-3475e2be735e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:41.082288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f0ea9-988f-4dc2-b554-3475e2be735e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:41.084391 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f0ea9-988f-4dc2-b554-3475e2be735e service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:41.108128 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 833/1672] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:41.114871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f0ea9-988f-4dc2-b554-3475e2be735e service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:41.119500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1a7f0ea9-988f-4dc2-b554-3475e2be735e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:41.126521 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:41.307582 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f0ea9-988f-4dc2-b554-3475e2be735e service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:41.322749 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd08b74-fc62-4a5d-a1f2-2512360cabe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:41.323507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd08b74-fc62-4a5d-a1f2-2512360cabe6 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:41.323799 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd08b74-fc62-4a5d-a1f2-2512360cabe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:41.324359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd08b74-fc62-4a5d-a1f2-2512360cabe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:41.325142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd08b74-fc62-4a5d-a1f2-2512360cabe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:41.327275 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd08b74-fc62-4a5d-a1f2-2512360cabe6 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:41.368777 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 840/1673] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:41.408216 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 834/1674] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:53:41 2022] POST /identity/v3/projects => generated 389 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:41.413598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d9dc5-0a05-4cfb-9018-b5be21c73e33 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:41.448720 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d9dc5-0a05-4cfb-9018-b5be21c73e33 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:41.648939 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90026e67-af09-406a-a83a-70117c3c9697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:41.652950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90026e67-af09-406a-a83a-70117c3c9697 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:41.653311 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90026e67-af09-406a-a83a-70117c3c9697 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:41.653821 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90026e67-af09-406a-a83a-70117c3c9697 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:41.663035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90026e67-af09-406a-a83a-70117c3c9697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:41.674278 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90026e67-af09-406a-a83a-70117c3c9697 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:41.777682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 841/1675] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:53:41 2022] POST /identity/v3/users => generated 295 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:53:41.779113 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd08b74-fc62-4a5d-a1f2-2512360cabe6 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:41.780880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90026e67-af09-406a-a83a-70117c3c9697 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:41.782855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-90026e67-af09-406a-a83a-70117c3c9697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:41.800876 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd08b74-fc62-4a5d-a1f2-2512360cabe6 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:41.819191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b8a62-cc19-4896-9fe4-840454f0f5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:41.820825 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b8a62-cc19-4896-9fe4-840454f0f5cf admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:41.821288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b8a62-cc19-4896-9fe4-840454f0f5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:41.821704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b8a62-cc19-4896-9fe4-840454f0f5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:41.822602 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b8a62-cc19-4896-9fe4-840454f0f5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:41.824912 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b8a62-cc19-4896-9fe4-840454f0f5cf admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:41.874114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 835/1676] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:41.875282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b8a62-cc19-4896-9fe4-840454f0f5cf admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:41.915168 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b8a62-cc19-4896-9fe4-840454f0f5cf admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:41.934940 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90026e67-af09-406a-a83a-70117c3c9697 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:41.935202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a4140-b146-4272-9144-b267606187c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:41.936044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a4140-b146-4272-9144-b267606187c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:41.936465 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a4140-b146-4272-9144-b267606187c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:41.936878 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a4140-b146-4272-9144-b267606187c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:41.937995 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a4140-b146-4272-9144-b267606187c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:41.940549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e23a4-d7ed-4970-af85-c63dfa1bd70a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:41.941300 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e23a4-d7ed-4970-af85-c63dfa1bd70a service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:41.941852 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e23a4-d7ed-4970-af85-c63dfa1bd70a service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:41.942376 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e23a4-d7ed-4970-af85-c63dfa1bd70a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:41.943443 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a4140-b146-4272-9144-b267606187c1 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:41.959477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e23a4-d7ed-4970-af85-c63dfa1bd70a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:41.961080 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e23a4-d7ed-4970-af85-c63dfa1bd70a service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:41.976030 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 842/1677] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:53:41.985770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 836/1678] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:41.996204 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e23a4-d7ed-4970-af85-c63dfa1bd70a service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:42.030309 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e23a4-d7ed-4970-af85-c63dfa1bd70a service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:42.046291 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f03c5-62f1-4acd-aec8-e84feec0228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:42.047205 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f03c5-62f1-4acd-aec8-e84feec0228c admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:42.047665 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f03c5-62f1-4acd-aec8-e84feec0228c admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:42.047946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f03c5-62f1-4acd-aec8-e84feec0228c admin admin] PATH_INFO: `/v3/projects/1f1d7ca20cf24752bbf4f2a9b0424c3f/users/a3e199298aaf4eb29644b03e2fc22e0d/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:42.088015 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f03c5-62f1-4acd-aec8-e84feec0228c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f1d7ca20cf24752bbf4f2a9b0424c3f, user_id=a3e199298aaf4eb29644b03e2fc22e0d, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:42.092020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f03c5-62f1-4acd-aec8-e84feec0228c admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:42.125364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 843/1679] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:53:41 2022] PUT /identity/v3/projects/1f1d7ca20cf24752bbf4f2a9b0424c3f/users/a3e199298aaf4eb29644b03e2fc22e0d/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:42.135011 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a53032-c61a-4118-bc7b-c9da5e715102 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:42.135423 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a53032-c61a-4118-bc7b-c9da5e715102 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:42.135806 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a53032-c61a-4118-bc7b-c9da5e715102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:42.203539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:42.227424 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-87a53032-c61a-4118-bc7b-c9da5e715102 None None] MFA Rules not processed for user `a3e199298aaf4eb29644b03e2fc22e0d`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:42.228855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-87a53032-c61a-4118-bc7b-c9da5e715102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:42.443514 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 837/1680] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:42.444482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f03c5-62f1-4acd-aec8-e84feec0228c admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:42.532319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:42.655936 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f03c5-62f1-4acd-aec8-e84feec0228c admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:42.662784 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd683a-8b5f-45ce-95c3-afb6137e00ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:42.663791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd683a-8b5f-45ce-95c3-afb6137e00ee admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:42.664268 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd683a-8b5f-45ce-95c3-afb6137e00ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:42.664778 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd683a-8b5f-45ce-95c3-afb6137e00ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:42.665736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd683a-8b5f-45ce-95c3-afb6137e00ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:42.668381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd683a-8b5f-45ce-95c3-afb6137e00ee admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:42.830350 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 844/1681] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:53:42 2022] POST /identity/v3/projects => generated 387 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:42.832122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a53032-c61a-4118-bc7b-c9da5e715102 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:42.865190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a53032-c61a-4118-bc7b-c9da5e715102 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:43.093478 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634335e6-b627-4b51-a3a7-de28396dd9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:43.094277 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634335e6-b627-4b51-a3a7-de28396dd9bd admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:43.099884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634335e6-b627-4b51-a3a7-de28396dd9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:43.100349 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634335e6-b627-4b51-a3a7-de28396dd9bd admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:43.101378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634335e6-b627-4b51-a3a7-de28396dd9bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:43.103684 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634335e6-b627-4b51-a3a7-de28396dd9bd admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:43.154720 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 838/1682] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:53:42 2022] POST /identity/v3/users => generated 300 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:43.155985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd683a-8b5f-45ce-95c3-afb6137e00ee admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:43.197944 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd683a-8b5f-45ce-95c3-afb6137e00ee admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:43.250224 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd1d89-308c-4f05-98ba-9829ad685610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:43.251246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd1d89-308c-4f05-98ba-9829ad685610 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:43.251592 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd1d89-308c-4f05-98ba-9829ad685610 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:43.251872 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd1d89-308c-4f05-98ba-9829ad685610 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:43.252899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd1d89-308c-4f05-98ba-9829ad685610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:43.272486 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd1d89-308c-4f05-98ba-9829ad685610 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:43.338160 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634335e6-b627-4b51-a3a7-de28396dd9bd admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:43.338767 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 845/1683] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:53:43.364123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634335e6-b627-4b51-a3a7-de28396dd9bd admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:43.375939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d708050-02a7-4eec-98f2-d753ffe4a19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:43.377015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d708050-02a7-4eec-98f2-d753ffe4a19d admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:43.377668 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d708050-02a7-4eec-98f2-d753ffe4a19d admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:43.378034 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d708050-02a7-4eec-98f2-d753ffe4a19d admin admin] PATH_INFO: `/v3/projects/8376b545bfa341b89546887bbc039221/users/755ef6dda03845f9a297f96fe24ad49c/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:43.440868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d708050-02a7-4eec-98f2-d753ffe4a19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8376b545bfa341b89546887bbc039221, user_id=755ef6dda03845f9a297f96fe24ad49c, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:43.455765 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d708050-02a7-4eec-98f2-d753ffe4a19d admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:43.508112 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 839/1684] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:53:43 2022] PUT /identity/v3/projects/8376b545bfa341b89546887bbc039221/users/755ef6dda03845f9a297f96fe24ad49c/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:43.509546 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd1d89-308c-4f05-98ba-9829ad685610 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:43.540433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd1d89-308c-4f05-98ba-9829ad685610 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:43.742183 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d990d-aa7f-4d98-9868-a8ea5a486a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:43.743318 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d990d-aa7f-4d98-9868-a8ea5a486a56 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:43.743700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d990d-aa7f-4d98-9868-a8ea5a486a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:43.744082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d990d-aa7f-4d98-9868-a8ea5a486a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:43.745334 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d990d-aa7f-4d98-9868-a8ea5a486a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:43.747847 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d990d-aa7f-4d98-9868-a8ea5a486a56 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:43.781861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 846/1685] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:43.785849 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d708050-02a7-4eec-98f2-d753ffe4a19d admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:43.803949 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d708050-02a7-4eec-98f2-d753ffe4a19d admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:43.838336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffef320-ade4-4182-a1de-2d4dcaef4065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:43.839357 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffef320-ade4-4182-a1de-2d4dcaef4065 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:43.839671 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffef320-ade4-4182-a1de-2d4dcaef4065 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:43.840310 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffef320-ade4-4182-a1de-2d4dcaef4065 admin admin] PATH_INFO: `/v3/projects/8376b545bfa341b89546887bbc039221/users/755ef6dda03845f9a297f96fe24ad49c/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:43.853405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffef320-ade4-4182-a1de-2d4dcaef4065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8376b545bfa341b89546887bbc039221, user_id=755ef6dda03845f9a297f96fe24ad49c, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:43.873114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffef320-ade4-4182-a1de-2d4dcaef4065 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:43.934683 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 840/1686] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:53:43 2022] PUT /identity/v3/projects/8376b545bfa341b89546887bbc039221/users/755ef6dda03845f9a297f96fe24ad49c/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:43.936586 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e3883-4fe0-4638-aa78-6066d1f572ed None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:43.937081 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e3883-4fe0-4638-aa78-6066d1f572ed None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:43.937583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e3883-4fe0-4638-aa78-6066d1f572ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:44.038560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-e98e3883-4fe0-4638-aa78-6066d1f572ed None None] MFA Rules not processed for user `755ef6dda03845f9a297f96fe24ad49c`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:44.039887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e98e3883-4fe0-4638-aa78-6066d1f572ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:44.280497 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 847/1687] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:53:44.293870 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffef320-ade4-4182-a1de-2d4dcaef4065 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:44.295687 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1ffef320-ade4-4182-a1de-2d4dcaef4065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:44.483162 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffef320-ade4-4182-a1de-2d4dcaef4065 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:44.494052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccbac2-6876-4c3f-ae21-7cd016e7218c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:44.494820 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccbac2-6876-4c3f-ae21-7cd016e7218c service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:44.495147 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccbac2-6876-4c3f-ae21-7cd016e7218c service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:44.495419 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccbac2-6876-4c3f-ae21-7cd016e7218c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:44.515089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:44.523648 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ccbac2-6876-4c3f-ae21-7cd016e7218c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:44.525219 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ccbac2-6876-4c3f-ae21-7cd016e7218c service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:44.560427 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 841/1688] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:44.924235 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e3883-4fe0-4638-aa78-6066d1f572ed None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:44.965666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:45.053971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e3883-4fe0-4638-aa78-6066d1f572ed None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:45.077163 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc559160-b0b2-4fb7-ae07-cbe6dc2e453f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:45.079004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc559160-b0b2-4fb7-ae07-cbe6dc2e453f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:45.079468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc559160-b0b2-4fb7-ae07-cbe6dc2e453f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:45.079851 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc559160-b0b2-4fb7-ae07-cbe6dc2e453f admin admin] PATH_INFO: `/v3/users/a3e199298aaf4eb29644b03e2fc22e0d` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:45.082821 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc559160-b0b2-4fb7-ae07-cbe6dc2e453f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3e199298aaf4eb29644b03e2fc22e0d)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:45.088824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc559160-b0b2-4fb7-ae07-cbe6dc2e453f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:45.277544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-dc559160-b0b2-4fb7-ae07-cbe6dc2e453f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e199298aaf4eb29644b03e2fc22e0d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:45.282772 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-dc559160-b0b2-4fb7-ae07-cbe6dc2e453f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e199298aaf4eb29644b03e2fc22e0d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:45.284283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-dc559160-b0b2-4fb7-ae07-cbe6dc2e453f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e199298aaf4eb29644b03e2fc22e0d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:45.320961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-dc559160-b0b2-4fb7-ae07-cbe6dc2e453f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e199298aaf4eb29644b03e2fc22e0d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:45.348658 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-dc559160-b0b2-4fb7-ae07-cbe6dc2e453f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e199298aaf4eb29644b03e2fc22e0d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:45.438202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 848/1689] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:53:44 2022] DELETE /identity/v3/users/a3e199298aaf4eb29644b03e2fc22e0d => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:45.443716 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33ae4e-a853-4ab8-816f-86320bb390f2 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:45.444723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33ae4e-a853-4ab8-816f-86320bb390f2 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:45.445337 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33ae4e-a853-4ab8-816f-86320bb390f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:45.500261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-9c33ae4e-a853-4ab8-816f-86320bb390f2 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:45.502715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9c33ae4e-a853-4ab8-816f-86320bb390f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:45.794634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 842/1690] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:45.956163 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc559160-b0b2-4fb7-ae07-cbe6dc2e453f admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:45.958390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-dc559160-b0b2-4fb7-ae07-cbe6dc2e453f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:46.005706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc559160-b0b2-4fb7-ae07-cbe6dc2e453f admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:46.018449 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33ae4e-a853-4ab8-816f-86320bb390f2 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:46.021580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9c33ae4e-a853-4ab8-816f-86320bb390f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:46.036001 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b1bca-20d1-49f4-9a09-619b0631901e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:46.038061 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b1bca-20d1-49f4-9a09-619b0631901e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:46.060102 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b1bca-20d1-49f4-9a09-619b0631901e admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:46.060629 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b1bca-20d1-49f4-9a09-619b0631901e admin admin] PATH_INFO: `/v3/projects/a6c7f2a7475446bc8b7108f2ac1f5ed3` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:46.068417 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b1bca-20d1-49f4-9a09-619b0631901e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c7f2a7475446bc8b7108f2ac1f5ed3)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:46.089704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b1bca-20d1-49f4-9a09-619b0631901e admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:46.376958 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33ae4e-a853-4ab8-816f-86320bb390f2 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:46.379668 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-bd0b1bca-20d1-49f4-9a09-619b0631901e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c7f2a7475446bc8b7108f2ac1f5ed3', 'request_id': 'req-bd0b1bca-20d1-49f4-9a09-619b0631901e'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:46.410892 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-bd0b1bca-20d1-49f4-9a09-619b0631901e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c7f2a7475446bc8b7108f2ac1f5ed3', 'request_id': 'req-bd0b1bca-20d1-49f4-9a09-619b0631901e'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:46.436321 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-bd0b1bca-20d1-49f4-9a09-619b0631901e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c7f2a7475446bc8b7108f2ac1f5ed3', 'request_id': 'req-bd0b1bca-20d1-49f4-9a09-619b0631901e'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:46.505327 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-bd0b1bca-20d1-49f4-9a09-619b0631901e admin admin] The token cache is being invalidate because project a6c7f2a7475446bc8b7108f2ac1f5ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:53:46.505806 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-bd0b1bca-20d1-49f4-9a09-619b0631901e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:46.507802 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-bd0b1bca-20d1-49f4-9a09-619b0631901e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:46.515942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 849/1691] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:53:45 2022] DELETE /identity/v3/projects/a6c7f2a7475446bc8b7108f2ac1f5ed3 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:46.522697 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37480961-a097-4dbc-912f-3d706f267652 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:46.523199 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37480961-a097-4dbc-912f-3d706f267652 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:46.523699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37480961-a097-4dbc-912f-3d706f267652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:46.575634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfce4b-b492-4f18-91c0-6a715ae8a9a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:46.576496 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfce4b-b492-4f18-91c0-6a715ae8a9a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:46.576898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfce4b-b492-4f18-91c0-6a715ae8a9a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:46.577296 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfce4b-b492-4f18-91c0-6a715ae8a9a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:46.578086 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-37480961-a097-4dbc-912f-3d706f267652 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:46.580135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f3bfce4b-b492-4f18-91c0-6a715ae8a9a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:46.581816 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-37480961-a097-4dbc-912f-3d706f267652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:46.687490 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:46.839243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfce4b-b492-4f18-91c0-6a715ae8a9a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:46.841017 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfce4b-b492-4f18-91c0-6a715ae8a9a9 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:46.847286 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 850/1692] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:53:46.858185 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd56ea-dce4-4d1d-b724-16d1df291930 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:46.858696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd56ea-dce4-4d1d-b724-16d1df291930 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:46.859147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd56ea-dce4-4d1d-b724-16d1df291930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:46.876061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:46.916653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 843/1693] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 900 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:53:46.987555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-28fd56ea-dce4-4d1d-b724-16d1df291930 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:46.989765 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-28fd56ea-dce4-4d1d-b724-16d1df291930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:47.046707 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 851/1694] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:47.048259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfce4b-b492-4f18-91c0-6a715ae8a9a9 service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:47.082057 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfce4b-b492-4f18-91c0-6a715ae8a9a9 service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:47.103633 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8f6ae-fd2a-4f58-968e-970fa6580667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:47.147439 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8f6ae-fd2a-4f58-968e-970fa6580667 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:47.149730 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8f6ae-fd2a-4f58-968e-970fa6580667 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:47.150568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8f6ae-fd2a-4f58-968e-970fa6580667 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:47.153033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8f6ae-fd2a-4f58-968e-970fa6580667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:53:47.153963 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8f6ae-fd2a-4f58-968e-970fa6580667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:47.160914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8f6ae-fd2a-4f58-968e-970fa6580667 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:47.207225 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 844/1695] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:53:47.208674 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd56ea-dce4-4d1d-b724-16d1df291930 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:47.226030 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd56ea-dce4-4d1d-b724-16d1df291930 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:47.251819 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd00524-391d-4302-a017-0832b9672d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:47.254122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd00524-391d-4302-a017-0832b9672d96 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:47.257644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd00524-391d-4302-a017-0832b9672d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:47.257944 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd00524-391d-4302-a017-0832b9672d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:47.260720 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd00524-391d-4302-a017-0832b9672d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:47.269582 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd00524-391d-4302-a017-0832b9672d96 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:47.353414 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 852/1696] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:53:47 2022] POST /identity/v3/projects => generated 355 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:47.354641 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8f6ae-fd2a-4f58-968e-970fa6580667 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:47.377996 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8f6ae-fd2a-4f58-968e-970fa6580667 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:47.615146 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f2071-2d51-42b4-8873-1ee6c60d2c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:47.616746 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f2071-2d51-42b4-8873-1ee6c60d2c4d admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:47.618357 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f2071-2d51-42b4-8873-1ee6c60d2c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:47.620454 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f2071-2d51-42b4-8873-1ee6c60d2c4d admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:47.623771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f2071-2d51-42b4-8873-1ee6c60d2c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:47.627779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f2071-2d51-42b4-8873-1ee6c60d2c4d admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:47.704236 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 845/1697] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:53:47 2022] POST /identity/v3/users => generated 278 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:53:47.705596 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd00524-391d-4302-a017-0832b9672d96 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:47.728747 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd00524-391d-4302-a017-0832b9672d96 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:47.739998 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad2128-cf6e-440b-9c40-5cb4a086579b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:47.741043 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad2128-cf6e-440b-9c40-5cb4a086579b admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:47.741505 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad2128-cf6e-440b-9c40-5cb4a086579b admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:47.741921 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad2128-cf6e-440b-9c40-5cb4a086579b admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:47.749446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad2128-cf6e-440b-9c40-5cb4a086579b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:47.755764 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad2128-cf6e-440b-9c40-5cb4a086579b admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:47.779683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 853/1698] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:47.784623 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f2071-2d51-42b4-8873-1ee6c60d2c4d admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:47.806829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f2071-2d51-42b4-8873-1ee6c60d2c4d admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:47.820394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bff7ba-9758-48ef-946d-ce52a365361c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:47.823089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bff7ba-9758-48ef-946d-ce52a365361c admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:47.823443 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bff7ba-9758-48ef-946d-ce52a365361c admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:47.823726 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bff7ba-9758-48ef-946d-ce52a365361c admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:47.830280 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bff7ba-9758-48ef-946d-ce52a365361c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:47.831632 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bff7ba-9758-48ef-946d-ce52a365361c admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:47.845891 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 846/1699] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:47.851403 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad2128-cf6e-440b-9c40-5cb4a086579b admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:47.869699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad2128-cf6e-440b-9c40-5cb4a086579b admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:47.884246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d069b91-f087-4995-bca2-cac936d9aaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:47.885154 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d069b91-f087-4995-bca2-cac936d9aaf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:47.886053 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d069b91-f087-4995-bca2-cac936d9aaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:47.886341 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d069b91-f087-4995-bca2-cac936d9aaf4 admin admin] PATH_INFO: `/v3/projects/a5a825235abf40cf8ba4fe211d9634f2/users/1ad96753880549c6af40aed87cd19ed1/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:47.932433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d069b91-f087-4995-bca2-cac936d9aaf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a825235abf40cf8ba4fe211d9634f2, user_id=1ad96753880549c6af40aed87cd19ed1, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:47.943201 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d069b91-f087-4995-bca2-cac936d9aaf4 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:47.999547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 854/1700] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:53:47 2022] PUT /identity/v3/projects/a5a825235abf40cf8ba4fe211d9634f2/users/1ad96753880549c6af40aed87cd19ed1/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:48.002475 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8f368-3bfa-4b68-88f9-c4f87575d747 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:48.003081 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8f368-3bfa-4b68-88f9-c4f87575d747 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:48.003708 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8f368-3bfa-4b68-88f9-c4f87575d747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:48.074136 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-01e8f368-3bfa-4b68-88f9-c4f87575d747 None None] MFA Rules not processed for user `1ad96753880549c6af40aed87cd19ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:48.079412 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-01e8f368-3bfa-4b68-88f9-c4f87575d747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:48.300515 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 847/1701] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:48 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:48.310871 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d069b91-f087-4995-bca2-cac936d9aaf4 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:48.510877 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d069b91-f087-4995-bca2-cac936d9aaf4 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:48.516736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a50f21-698a-4366-8ba2-7eef64711b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:48.518223 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a50f21-698a-4366-8ba2-7eef64711b5b admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:48.518520 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a50f21-698a-4366-8ba2-7eef64711b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:48.519235 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a50f21-698a-4366-8ba2-7eef64711b5b admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:48.520071 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a50f21-698a-4366-8ba2-7eef64711b5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:48.522765 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a50f21-698a-4366-8ba2-7eef64711b5b admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:48.626588 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 855/1702] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:53:48 2022] POST /identity/v3/projects => generated 357 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:48.630592 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8f368-3bfa-4b68-88f9-c4f87575d747 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:48.679938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8f368-3bfa-4b68-88f9-c4f87575d747 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:48.858988 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:48.885532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4cf49-4a8e-42f3-9e97-7d3e1bc94704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:48.886619 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4cf49-4a8e-42f3-9e97-7d3e1bc94704 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:48.887158 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4cf49-4a8e-42f3-9e97-7d3e1bc94704 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:48.888108 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4cf49-4a8e-42f3-9e97-7d3e1bc94704 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:48.889033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4cf49-4a8e-42f3-9e97-7d3e1bc94704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:48.891232 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4cf49-4a8e-42f3-9e97-7d3e1bc94704 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:48.936124 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 848/1703] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:53:48 2022] POST /identity/v3/users => generated 285 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:48.939954 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a50f21-698a-4366-8ba2-7eef64711b5b admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:48.967887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a50f21-698a-4366-8ba2-7eef64711b5b admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:48.983364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdeb55-1cd1-4bdc-ba42-3d83063b2f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:48.984937 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdeb55-1cd1-4bdc-ba42-3d83063b2f37 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:48.986068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdeb55-1cd1-4bdc-ba42-3d83063b2f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:48.986536 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdeb55-1cd1-4bdc-ba42-3d83063b2f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:48.987498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdeb55-1cd1-4bdc-ba42-3d83063b2f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:48.989365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdeb55-1cd1-4bdc-ba42-3d83063b2f37 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:49.019577 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 856/1704] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:49.021840 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4cf49-4a8e-42f3-9e97-7d3e1bc94704 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:49.041897 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4cf49-4a8e-42f3-9e97-7d3e1bc94704 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:49.062066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be77544-c877-4552-aa03-849ff51b5a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:49.063498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be77544-c877-4552-aa03-849ff51b5a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:49.064030 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be77544-c877-4552-aa03-849ff51b5a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:49.065323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be77544-c877-4552-aa03-849ff51b5a80 admin admin] PATH_INFO: `/v3/projects/0691cce95ce44836900b9cf64af6788c/users/e82f73015cde45b5b678abdee32e490a/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:49.141971 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be77544-c877-4552-aa03-849ff51b5a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0691cce95ce44836900b9cf64af6788c, user_id=e82f73015cde45b5b678abdee32e490a, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:49.146378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be77544-c877-4552-aa03-849ff51b5a80 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:49.206909 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 849/1705] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:53:49 2022] PUT /identity/v3/projects/0691cce95ce44836900b9cf64af6788c/users/e82f73015cde45b5b678abdee32e490a/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:49.210214 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdeb55-1cd1-4bdc-ba42-3d83063b2f37 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:49.232285 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdeb55-1cd1-4bdc-ba42-3d83063b2f37 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:49.327556 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:49.387308 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6193108-dcf9-427a-b087-1fcf9a3b4d2f None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:49.387607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6193108-dcf9-427a-b087-1fcf9a3b4d2f None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:49.387872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6193108-dcf9-427a-b087-1fcf9a3b4d2f None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:49.389763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 850/1706] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 13:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:53:49.390166 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a91df-2aee-4930-ad30-925363cfcc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:49.390590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a91df-2aee-4930-ad30-925363cfcc64 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:49.390874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a91df-2aee-4930-ad30-925363cfcc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:49.391193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a91df-2aee-4930-ad30-925363cfcc64 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:49.392082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a91df-2aee-4930-ad30-925363cfcc64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:49.393647 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a91df-2aee-4930-ad30-925363cfcc64 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:49.408484 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 857/1707] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:49.414281 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6193108-dcf9-427a-b087-1fcf9a3b4d2f None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:49.441341 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6193108-dcf9-427a-b087-1fcf9a3b4d2f None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:49.456005 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af6786-0cff-4ae1-ba6b-6d444eb2d25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:49.457252 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af6786-0cff-4ae1-ba6b-6d444eb2d25d admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:49.457612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af6786-0cff-4ae1-ba6b-6d444eb2d25d admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:49.458024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af6786-0cff-4ae1-ba6b-6d444eb2d25d admin admin] PATH_INFO: `/v3/projects/0691cce95ce44836900b9cf64af6788c/users/e82f73015cde45b5b678abdee32e490a/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:49.462976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af6786-0cff-4ae1-ba6b-6d444eb2d25d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0691cce95ce44836900b9cf64af6788c, user_id=e82f73015cde45b5b678abdee32e490a, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:49.466653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af6786-0cff-4ae1-ba6b-6d444eb2d25d admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:49.513601 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 851/1708] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:53:49 2022] PUT /identity/v3/projects/0691cce95ce44836900b9cf64af6788c/users/e82f73015cde45b5b678abdee32e490a/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:49.522019 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febc18d-aa90-4382-9916-d86ac98503c6 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:49.522235 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febc18d-aa90-4382-9916-d86ac98503c6 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:49.522365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febc18d-aa90-4382-9916-d86ac98503c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:49.544205 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a8313-6bb3-4691-8d5f-3d2865854be9 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:49.544567 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a8313-6bb3-4691-8d5f-3d2865854be9 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:49.544980 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a8313-6bb3-4691-8d5f-3d2865854be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:49.642590 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-b66a8313-6bb3-4691-8d5f-3d2865854be9 None None] MFA Rules not processed for user `1994043a81bb454297c208839794a479`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:49.644073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-b66a8313-6bb3-4691-8d5f-3d2865854be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:49.655540 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-3febc18d-aa90-4382-9916-d86ac98503c6 None None] MFA Rules not processed for user `e82f73015cde45b5b678abdee32e490a`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:49.661760 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-3febc18d-aa90-4382-9916-d86ac98503c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:49.848384 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 852/1709] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 13:53:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:53:49.850053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a8313-6bb3-4691-8d5f-3d2865854be9 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:49.851732 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-b66a8313-6bb3-4691-8d5f-3d2865854be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:49.910225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 858/1710] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:49 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:53:49.914027 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febc18d-aa90-4382-9916-d86ac98503c6 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:49.918525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-3febc18d-aa90-4382-9916-d86ac98503c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:49.946106 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a8313-6bb3-4691-8d5f-3d2865854be9 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:49.951741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ff159-dd92-4b35-88d7-c52c4ec65d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:49.952876 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ff159-dd92-4b35-88d7-c52c4ec65d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:49.952876 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ff159-dd92-4b35-88d7-c52c4ec65d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:49.953307 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ff159-dd92-4b35-88d7-c52c4ec65d02 admin admin] PATH_INFO: `/v3/projects/1f1d7ca20cf24752bbf4f2a9b0424c3f` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:49.955147 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ff159-dd92-4b35-88d7-c52c4ec65d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f1d7ca20cf24752bbf4f2a9b0424c3f)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:49.956927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ff159-dd92-4b35-88d7-c52c4ec65d02 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:49.980123 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febc18d-aa90-4382-9916-d86ac98503c6 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:49.995258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4625c21-645e-482b-8110-52a8502f7376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:49.996254 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4625c21-645e-482b-8110-52a8502f7376 service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:49.996611 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4625c21-645e-482b-8110-52a8502f7376 service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:49.997063 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4625c21-645e-482b-8110-52a8502f7376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:50.010976 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4625c21-645e-482b-8110-52a8502f7376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:50.012653 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4625c21-645e-482b-8110-52a8502f7376 service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:50.025718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b42ff159-dd92-4b35-88d7-c52c4ec65d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f1d7ca20cf24752bbf4f2a9b0424c3f', 'request_id': 'req-b42ff159-dd92-4b35-88d7-c52c4ec65d02'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:50.030308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 859/1711] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:50.032021 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4625c21-645e-482b-8110-52a8502f7376 service nova] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:50.033923 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b42ff159-dd92-4b35-88d7-c52c4ec65d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f1d7ca20cf24752bbf4f2a9b0424c3f', 'request_id': 'req-b42ff159-dd92-4b35-88d7-c52c4ec65d02'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:50.034884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-b4625c21-645e-482b-8110-52a8502f7376 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:50.035575 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:50.042216 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b42ff159-dd92-4b35-88d7-c52c4ec65d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f1d7ca20cf24752bbf4f2a9b0424c3f', 'request_id': 'req-b42ff159-dd92-4b35-88d7-c52c4ec65d02'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:50.064255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b42ff159-dd92-4b35-88d7-c52c4ec65d02 admin admin] The token cache is being invalidate because project 1f1d7ca20cf24752bbf4f2a9b0424c3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:53:50.064830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b42ff159-dd92-4b35-88d7-c52c4ec65d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:50.065716 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b42ff159-dd92-4b35-88d7-c52c4ec65d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:50.071259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 853/1712] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:53:49 2022] DELETE /identity/v3/projects/1f1d7ca20cf24752bbf4f2a9b0424c3f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:50.080612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ff159-dd92-4b35-88d7-c52c4ec65d02 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:50.082748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-b42ff159-dd92-4b35-88d7-c52c4ec65d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:50.154205 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4625c21-645e-482b-8110-52a8502f7376 service nova] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:50.247047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee796f3-3a5e-4778-8067-bf29dd78a132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:50.247728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee796f3-3a5e-4778-8067-bf29dd78a132 service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:50.248067 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee796f3-3a5e-4778-8067-bf29dd78a132 service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:50.248352 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee796f3-3a5e-4778-8067-bf29dd78a132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:50.250500 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7ee796f3-3a5e-4778-8067-bf29dd78a132 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:50.262241 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ff159-dd92-4b35-88d7-c52c4ec65d02 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:50.267887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:50.284024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5b331-23d6-49b5-a89c-7347a3f9edcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:50.286656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5b331-23d6-49b5-a89c-7347a3f9edcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:50.291025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5b331-23d6-49b5-a89c-7347a3f9edcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:50.291273 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5b331-23d6-49b5-a89c-7347a3f9edcc admin admin] PATH_INFO: `/v3/users/755ef6dda03845f9a297f96fe24ad49c` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:50.293409 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5b331-23d6-49b5-a89c-7347a3f9edcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=755ef6dda03845f9a297f96fe24ad49c)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:50.296404 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5b331-23d6-49b5-a89c-7347a3f9edcc admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:50.374902 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee796f3-3a5e-4778-8067-bf29dd78a132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:50.377598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee796f3-3a5e-4778-8067-bf29dd78a132 service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:50.393185 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 860/1713] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:50 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:50.446884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7ea5b331-23d6-49b5-a89c-7347a3f9edcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '755ef6dda03845f9a297f96fe24ad49c'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:50.502015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7ea5b331-23d6-49b5-a89c-7347a3f9edcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '755ef6dda03845f9a297f96fe24ad49c'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:50.505242 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7ea5b331-23d6-49b5-a89c-7347a3f9edcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '755ef6dda03845f9a297f96fe24ad49c'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:50.506639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7ea5b331-23d6-49b5-a89c-7347a3f9edcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '755ef6dda03845f9a297f96fe24ad49c'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:50.533552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7ea5b331-23d6-49b5-a89c-7347a3f9edcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '755ef6dda03845f9a297f96fe24ad49c'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:50.586634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 854/1714] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:53:50 2022] DELETE /identity/v3/users/755ef6dda03845f9a297f96fe24ad49c => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:50.612690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee796f3-3a5e-4778-8067-bf29dd78a132 service cinder] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:50.614777 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7ee796f3-3a5e-4778-8067-bf29dd78a132 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:50.683898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee796f3-3a5e-4778-8067-bf29dd78a132 service cinder] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:50.868703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4672b-aad9-4fa2-b712-f2f7c4d4e176 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:50.869825 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4672b-aad9-4fa2-b712-f2f7c4d4e176 service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:50.870015 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4672b-aad9-4fa2-b712-f2f7c4d4e176 service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:50.874510 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4672b-aad9-4fa2-b712-f2f7c4d4e176 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:50.883143 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-a9d4672b-aad9-4fa2-b712-f2f7c4d4e176 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:51.074539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6630b-cd51-4fe3-8ca0-69fe5f3d365c None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:51.075074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6630b-cd51-4fe3-8ca0-69fe5f3d365c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:51.075074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6630b-cd51-4fe3-8ca0-69fe5f3d365c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:51.082471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4672b-aad9-4fa2-b712-f2f7c4d4e176 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:51.090113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4672b-aad9-4fa2-b712-f2f7c4d4e176 service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:51.146395 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 861/1715] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:50 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:51.199692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-07e6630b-cd51-4fe3-8ca0-69fe5f3d365c None None] MFA Rules not processed for user `81f42e71a4d24250874f31f4e8269e04`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:51.202257 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-07e6630b-cd51-4fe3-8ca0-69fe5f3d365c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:51.321449 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:51.425531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 855/1716] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:53:51.436689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b24e-5e7f-4088-93f4-52cafb0582e9 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:51.436980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b24e-5e7f-4088-93f4-52cafb0582e9 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:51.437247 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b24e-5e7f-4088-93f4-52cafb0582e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:51.482687 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-7b61b24e-5e7f-4088-93f4-52cafb0582e9 None None] MFA Rules not processed for user `81f42e71a4d24250874f31f4e8269e04`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:51.487458 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7b61b24e-5e7f-4088-93f4-52cafb0582e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:51.518775 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 862/1717] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:51.536469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6630b-cd51-4fe3-8ca0-69fe5f3d365c None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:51.538121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-07e6630b-cd51-4fe3-8ca0-69fe5f3d365c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:51.711989 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6630b-cd51-4fe3-8ca0-69fe5f3d365c None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:51.729681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30172c0f-e25a-4f1e-816b-deff9a8d7d8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:51.730498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30172c0f-e25a-4f1e-816b-deff9a8d7d8d service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:51.730787 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30172c0f-e25a-4f1e-816b-deff9a8d7d8d service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:51.731067 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30172c0f-e25a-4f1e-816b-deff9a8d7d8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:51.748430 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30172c0f-e25a-4f1e-816b-deff9a8d7d8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:51.750738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30172c0f-e25a-4f1e-816b-deff9a8d7d8d service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:51.766861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 856/1718] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:52.133241 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751a655-f8d2-4e30-bce4-3d246eb3c7ab None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:52.133717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751a655-f8d2-4e30-bce4-3d246eb3c7ab None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:52.134145 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751a655-f8d2-4e30-bce4-3d246eb3c7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:52.337376 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6a5a9-623d-4bf3-a654-691a9d285056 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:52.337847 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6a5a9-623d-4bf3-a654-691a9d285056 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:52.338133 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6a5a9-623d-4bf3-a654-691a9d285056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:52.409788 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a4b6a5a9-623d-4bf3-a654-691a9d285056 None None] MFA Rules not processed for user `ff4a8240c1f4495eb3f518a7f1b741bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:52.411649 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a4b6a5a9-623d-4bf3-a654-691a9d285056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:52.537169 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 857/1719] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:52.554456 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6a5a9-623d-4bf3-a654-691a9d285056 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:52.558757 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a4b6a5a9-623d-4bf3-a654-691a9d285056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:52.630700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-0751a655-f8d2-4e30-bce4-3d246eb3c7ab None None] MFA Rules not processed for user `000330dc3f1a4b38b58686ee37b3b78c`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:52.634114 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0751a655-f8d2-4e30-bce4-3d246eb3c7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:52.637659 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6a5a9-623d-4bf3-a654-691a9d285056 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:52.660400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d388ef-ccf2-4427-a7ee-e2eb3cfc555d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:52.661226 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d388ef-ccf2-4427-a7ee-e2eb3cfc555d service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:52.661537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d388ef-ccf2-4427-a7ee-e2eb3cfc555d service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:52.667311 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d388ef-ccf2-4427-a7ee-e2eb3cfc555d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:52.698392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d388ef-ccf2-4427-a7ee-e2eb3cfc555d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:52.700034 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d388ef-ccf2-4427-a7ee-e2eb3cfc555d service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:52.742141 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 858/1720] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:52.743527 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658bf53-a3db-463e-9d15-787755e5c32b None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:52.743806 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658bf53-a3db-463e-9d15-787755e5c32b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:52.744077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658bf53-a3db-463e-9d15-787755e5c32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:52.804193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:52.845983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-c658bf53-a3db-463e-9d15-787755e5c32b None None] MFA Rules not processed for user `63cf85b13c87481095acb4d3a84156cc`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:52.847192 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c658bf53-a3db-463e-9d15-787755e5c32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:52.885899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 863/1721] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 747 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:52.885899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751a655-f8d2-4e30-bce4-3d246eb3c7ab None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:52.885899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0751a655-f8d2-4e30-bce4-3d246eb3c7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:52.962428 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:53.031607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 859/1722] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:53.051085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751a655-f8d2-4e30-bce4-3d246eb3c7ab None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:53.060247 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07de75c-9058-48ab-8bd5-f94114a1da4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:53.062199 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07de75c-9058-48ab-8bd5-f94114a1da4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:53.062493 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07de75c-9058-48ab-8bd5-f94114a1da4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:53.062781 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07de75c-9058-48ab-8bd5-f94114a1da4f admin admin] PATH_INFO: `/v3/projects/8376b545bfa341b89546887bbc039221` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:53.065139 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07de75c-9058-48ab-8bd5-f94114a1da4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8376b545bfa341b89546887bbc039221)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:53.068771 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07de75c-9058-48ab-8bd5-f94114a1da4f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:53.161757 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c07de75c-9058-48ab-8bd5-f94114a1da4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8376b545bfa341b89546887bbc039221', 'request_id': 'req-c07de75c-9058-48ab-8bd5-f94114a1da4f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:53.171894 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c07de75c-9058-48ab-8bd5-f94114a1da4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8376b545bfa341b89546887bbc039221', 'request_id': 'req-c07de75c-9058-48ab-8bd5-f94114a1da4f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:53.186192 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c07de75c-9058-48ab-8bd5-f94114a1da4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8376b545bfa341b89546887bbc039221', 'request_id': 'req-c07de75c-9058-48ab-8bd5-f94114a1da4f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:53.203762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c07de75c-9058-48ab-8bd5-f94114a1da4f admin admin] The token cache is being invalidate because project 8376b545bfa341b89546887bbc039221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:53:53.204204 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c07de75c-9058-48ab-8bd5-f94114a1da4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:53.205257 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c07de75c-9058-48ab-8bd5-f94114a1da4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:53:53.210658 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 864/1723] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:53:52 2022] DELETE /identity/v3/projects/8376b545bfa341b89546887bbc039221 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:53:53.218704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5767d1b-0b61-444f-9e86-d130c678f11e None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:53.218999 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5767d1b-0b61-444f-9e86-d130c678f11e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:53.219512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5767d1b-0b61-444f-9e86-d130c678f11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:53.439117 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07de75c-9058-48ab-8bd5-f94114a1da4f admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:53.440963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-c07de75c-9058-48ab-8bd5-f94114a1da4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:53.596187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-e5767d1b-0b61-444f-9e86-d130c678f11e None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:53.597482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e5767d1b-0b61-444f-9e86-d130c678f11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:53.618955 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07de75c-9058-48ab-8bd5-f94114a1da4f admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:53.640591 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b70ca-a6c6-45c3-9045-c297ebb90e8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:53.644169 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b70ca-a6c6-45c3-9045-c297ebb90e8b service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:53.645825 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b70ca-a6c6-45c3-9045-c297ebb90e8b service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:53.646234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b70ca-a6c6-45c3-9045-c297ebb90e8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:53.651402 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-2d7b70ca-a6c6-45c3-9045-c297ebb90e8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:53.678573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:53.800945 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 860/1724] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 583 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:53.802140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5767d1b-0b61-444f-9e86-d130c678f11e None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:53.803620 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e5767d1b-0b61-444f-9e86-d130c678f11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:53.819586 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b70ca-a6c6-45c3-9045-c297ebb90e8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:53.823988 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b70ca-a6c6-45c3-9045-c297ebb90e8b service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:53.853851 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5767d1b-0b61-444f-9e86-d130c678f11e None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:53.857074 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 865/1725] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:53.861639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786c906-2b34-42a6-9fd9-a8590b178662 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:53.861939 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786c906-2b34-42a6-9fd9-a8590b178662 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:53.863806 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786c906-2b34-42a6-9fd9-a8590b178662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:53.868188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b55d12-8b58-424b-a1b4-b9736ddae41e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:53.868857 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b55d12-8b58-424b-a1b4-b9736ddae41e service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:53.869138 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b55d12-8b58-424b-a1b4-b9736ddae41e service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:53.869435 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b55d12-8b58-424b-a1b4-b9736ddae41e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:53.873016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-90b55d12-8b58-424b-a1b4-b9736ddae41e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:53.902097 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-4786c906-2b34-42a6-9fd9-a8590b178662 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:53.903788 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-4786c906-2b34-42a6-9fd9-a8590b178662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:53.933057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 866/1726] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:53.936603 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786c906-2b34-42a6-9fd9-a8590b178662 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:53.966048 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786c906-2b34-42a6-9fd9-a8590b178662 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:53.979150 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f6250-275c-40de-ba10-d7eb0a81edb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:53.980100 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f6250-275c-40de-ba10-d7eb0a81edb6 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:53.980586 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f6250-275c-40de-ba10-d7eb0a81edb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:53.983475 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f6250-275c-40de-ba10-d7eb0a81edb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:53.984234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f6250-275c-40de-ba10-d7eb0a81edb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:53:53.984547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f6250-275c-40de-ba10-d7eb0a81edb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:53.990922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f6250-275c-40de-ba10-d7eb0a81edb6 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:54.023927 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 867/1727] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:53:54.027670 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f6250-275c-40de-ba10-d7eb0a81edb6 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:54.029678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b55d12-8b58-424b-a1b4-b9736ddae41e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:54.031312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b55d12-8b58-424b-a1b4-b9736ddae41e service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:54.048445 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f6250-275c-40de-ba10-d7eb0a81edb6 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:54.059223 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 861/1728] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:54.065955 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cd019-a00e-47b3-bbc6-19f3165c1048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:54.066760 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd019-a00e-47b3-bbc6-19f3165c1048 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:54.067735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd019-a00e-47b3-bbc6-19f3165c1048 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:54.070763 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd019-a00e-47b3-bbc6-19f3165c1048 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:54.071450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cd019-a00e-47b3-bbc6-19f3165c1048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:54.079764 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cd019-a00e-47b3-bbc6-19f3165c1048 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:54.177762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 868/1729] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:53:54 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:53:54.192884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b55d12-8b58-424b-a1b4-b9736ddae41e service nova] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:54.211774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b55d12-8b58-424b-a1b4-b9736ddae41e service nova] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:54.406799 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d71e7d-42c3-4aa8-9dc6-68f93ad805a5 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:54.407282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d71e7d-42c3-4aa8-9dc6-68f93ad805a5 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:54.407568 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d71e7d-42c3-4aa8-9dc6-68f93ad805a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:54.462472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-c4d71e7d-42c3-4aa8-9dc6-68f93ad805a5 None None] MFA Rules not processed for user `81f42e71a4d24250874f31f4e8269e04`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:54.466731 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-c4d71e7d-42c3-4aa8-9dc6-68f93ad805a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:54.489390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1c61b-ae06-4c62-80aa-46428fac16bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:54.490079 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1c61b-ae06-4c62-80aa-46428fac16bc admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:54.495193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1c61b-ae06-4c62-80aa-46428fac16bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:54.496492 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1c61b-ae06-4c62-80aa-46428fac16bc admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:54.499218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1c61b-ae06-4c62-80aa-46428fac16bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:54.508624 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1c61b-ae06-4c62-80aa-46428fac16bc admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:54.566625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:54.588365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 862/1730] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:53:54 2022] POST /identity/v3/users => generated 287 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:53:54.589394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1c61b-ae06-4c62-80aa-46428fac16bc admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:54.621239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1c61b-ae06-4c62-80aa-46428fac16bc admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:54.641302 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f0b01-5fc7-4950-be10-916b0d148aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:54.649371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f0b01-5fc7-4950-be10-916b0d148aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:54.653915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f0b01-5fc7-4950-be10-916b0d148aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:54.654413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f0b01-5fc7-4950-be10-916b0d148aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:54.655349 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f0b01-5fc7-4950-be10-916b0d148aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:54.662889 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f0b01-5fc7-4950-be10-916b0d148aa4 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:54.677062 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 869/1731] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:53:54.720269 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d71e7d-42c3-4aa8-9dc6-68f93ad805a5 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:54.720880 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 863/1732] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:53:54.738519 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d71e7d-42c3-4aa8-9dc6-68f93ad805a5 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:54.759498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdcd4f-f6ba-40be-bb3a-be9647414efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:54.760188 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdcd4f-f6ba-40be-bb3a-be9647414efe admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:54.760531 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdcd4f-f6ba-40be-bb3a-be9647414efe admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:54.760730 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdcd4f-f6ba-40be-bb3a-be9647414efe admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:54.768636 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdcd4f-f6ba-40be-bb3a-be9647414efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:54.784520 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdcd4f-f6ba-40be-bb3a-be9647414efe admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:54.823816 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f0b01-5fc7-4950-be10-916b0d148aa4 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:54.825877 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 870/1733] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:53:54.839926 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f0b01-5fc7-4950-be10-916b0d148aa4 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:54.863045 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552067cc-17ef-4cda-af15-afbfd6dffc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:54.866479 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552067cc-17ef-4cda-af15-afbfd6dffc74 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:54.871326 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552067cc-17ef-4cda-af15-afbfd6dffc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:54.873280 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552067cc-17ef-4cda-af15-afbfd6dffc74 admin admin] PATH_INFO: `/v3/projects/ccb7305abb3d4383a117d36babaa4194/users/30176875bbd349a6b3f8dc69c278a774/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:54.924750 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552067cc-17ef-4cda-af15-afbfd6dffc74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb7305abb3d4383a117d36babaa4194, user_id=30176875bbd349a6b3f8dc69c278a774, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:54.934204 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552067cc-17ef-4cda-af15-afbfd6dffc74 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:54.972973 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 864/1734] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:53:54 2022] PUT /identity/v3/projects/ccb7305abb3d4383a117d36babaa4194/users/30176875bbd349a6b3f8dc69c278a774/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:53:54.975132 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272a326-dc5f-48e8-adda-141e93985ac0 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:54.975633 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272a326-dc5f-48e8-adda-141e93985ac0 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:54.976156 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272a326-dc5f-48e8-adda-141e93985ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:55.026025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-7272a326-dc5f-48e8-adda-141e93985ac0 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:55.029681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7272a326-dc5f-48e8-adda-141e93985ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:55.232833 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 871/1735] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:53:55.324137 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552067cc-17ef-4cda-af15-afbfd6dffc74 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:53:55.326670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-552067cc-17ef-4cda-af15-afbfd6dffc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:55.575266 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552067cc-17ef-4cda-af15-afbfd6dffc74 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:53:55.581644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac97ff-aad2-4cb0-8ddc-7d66d6c628a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:53:55.582648 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac97ff-aad2-4cb0-8ddc-7d66d6c628a4 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:55.587412 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac97ff-aad2-4cb0-8ddc-7d66d6c628a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:55.588095 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac97ff-aad2-4cb0-8ddc-7d66d6c628a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:55.609684 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac97ff-aad2-4cb0-8ddc-7d66d6c628a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:53:55.612193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac97ff-aad2-4cb0-8ddc-7d66d6c628a4 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:53:55.642701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 865/1736] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:53:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:53:59.059872 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddf269-9eaa-49d0-a45e-214e8e5977f6 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:53:59.060808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddf269-9eaa-49d0-a45e-214e8e5977f6 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:53:59.061326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddf269-9eaa-49d0-a45e-214e8e5977f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:53:59.082099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:59.103954 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-a5ddf269-9eaa-49d0-a45e-214e8e5977f6 None None] MFA Rules not processed for user `ff4a8240c1f4495eb3f518a7f1b741bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:53:59.105670 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-a5ddf269-9eaa-49d0-a45e-214e8e5977f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:53:59.264296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 872/1737] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:53:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:00.291090 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c93305-55f7-4368-a8e4-cf7f2278a733 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:00.291967 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c93305-55f7-4368-a8e4-cf7f2278a733 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:00.292393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c93305-55f7-4368-a8e4-cf7f2278a733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:00.373733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a2c93305-55f7-4368-a8e4-cf7f2278a733 None None] MFA Rules not processed for user `30176875bbd349a6b3f8dc69c278a774`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:00.376090 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a2c93305-55f7-4368-a8e4-cf7f2278a733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:00.520865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 866/1738] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:00.545615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddf269-9eaa-49d0-a45e-214e8e5977f6 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:00.547166 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-a5ddf269-9eaa-49d0-a45e-214e8e5977f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:00.694967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddf269-9eaa-49d0-a45e-214e8e5977f6 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:00.699391 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04b8a9-de6b-442b-9e6e-adf56beec05c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:00.700240 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04b8a9-de6b-442b-9e6e-adf56beec05c service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:00.700654 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04b8a9-de6b-442b-9e6e-adf56beec05c service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:00.701212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04b8a9-de6b-442b-9e6e-adf56beec05c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:00.717227 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04b8a9-de6b-442b-9e6e-adf56beec05c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:00.719527 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04b8a9-de6b-442b-9e6e-adf56beec05c service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:00.732587 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 873/1739] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:01.797387 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963a9ee-42a8-46e5-922e-1e48dd71fa59 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:01.799686 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963a9ee-42a8-46e5-922e-1e48dd71fa59 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:01.800399 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963a9ee-42a8-46e5-922e-1e48dd71fa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:01.880171 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-e963a9ee-42a8-46e5-922e-1e48dd71fa59 None None] MFA Rules not processed for user `63cf85b13c87481095acb4d3a84156cc`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:01.895776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e963a9ee-42a8-46e5-922e-1e48dd71fa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:02.098687 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:02.116739 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 867/1740] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:02.639516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b32c4a-a78a-4416-84de-32ff8b223993 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:02.640079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b32c4a-a78a-4416-84de-32ff8b223993 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:02.640222 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b32c4a-a78a-4416-84de-32ff8b223993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:02.696850 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7d3c9-0c2b-4985-b61d-214feb348c88 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:02.697134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7d3c9-0c2b-4985-b61d-214feb348c88 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:02.697812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7d3c9-0c2b-4985-b61d-214feb348c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:02.726212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-c1b32c4a-a78a-4416-84de-32ff8b223993 None None] MFA Rules not processed for user `000330dc3f1a4b38b58686ee37b3b78c`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:02.731092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-c1b32c4a-a78a-4416-84de-32ff8b223993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:02.747469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-42c7d3c9-0c2b-4985-b61d-214feb348c88 None None] MFA Rules not processed for user `30176875bbd349a6b3f8dc69c278a774`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:02.752713 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-42c7d3c9-0c2b-4985-b61d-214feb348c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:02.782715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 868/1741] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:54:02.909647 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 874/1742] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:03.898716 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1504-e6f5-4511-b63f-bd9d0f21c9d4 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:03.899682 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1504-e6f5-4511-b63f-bd9d0f21c9d4 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:03.901166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1504-e6f5-4511-b63f-bd9d0f21c9d4 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:03.903331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 869/1743] 10.222.0.45 () {54 vars in 912 bytes} [Thu May 26 13:54:03 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:54:03.915399 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6b1de-99b7-4cfb-9eed-2453b91bb98b None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:03.916419 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6b1de-99b7-4cfb-9eed-2453b91bb98b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:03.916897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6b1de-99b7-4cfb-9eed-2453b91bb98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:03.962419 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-3ee6b1de-99b7-4cfb-9eed-2453b91bb98b None None] MFA Rules not processed for user `45105360300a4cae802fdbda91b9d5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:03.963831 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-3ee6b1de-99b7-4cfb-9eed-2453b91bb98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:03.985379 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 875/1744] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 13:54:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:04.120053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e1504-e6f5-4511-b63f-bd9d0f21c9d4 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:04.140509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e1504-e6f5-4511-b63f-bd9d0f21c9d4 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:04.149263 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67472ced-e1ac-4755-8dc0-04da3d46e82a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:04.150169 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67472ced-e1ac-4755-8dc0-04da3d46e82a service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:04.150556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67472ced-e1ac-4755-8dc0-04da3d46e82a service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:04.150989 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67472ced-e1ac-4755-8dc0-04da3d46e82a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:04.174663 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67472ced-e1ac-4755-8dc0-04da3d46e82a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:04.177397 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67472ced-e1ac-4755-8dc0-04da3d46e82a service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:04.195752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 870/1745] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:04.283864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9353a3-22ff-4b3a-941f-0f6824f8cd72 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:04.284581 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9353a3-22ff-4b3a-941f-0f6824f8cd72 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:04.284999 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9353a3-22ff-4b3a-941f-0f6824f8cd72 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:04.286973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 876/1746] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 13:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:54:04.372209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064af34-9401-4940-a520-609e45f1d0fa None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:04.372945 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064af34-9401-4940-a520-609e45f1d0fa None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:04.373573 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064af34-9401-4940-a520-609e45f1d0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:04.458611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-3064af34-9401-4940-a520-609e45f1d0fa None None] MFA Rules not processed for user `1994043a81bb454297c208839794a479`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:04.467587 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-3064af34-9401-4940-a520-609e45f1d0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:04.670931 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 871/1747] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 13:54:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:06.665433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddaa08-da47-4ea2-a35c-bd8b91b95b62 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:06.666445 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddaa08-da47-4ea2-a35c-bd8b91b95b62 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:06.666445 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddaa08-da47-4ea2-a35c-bd8b91b95b62 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:06.667481 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 877/1748] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 13:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:54:06.687446 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fd8e5-1a00-4cfe-b0f6-78cb9df3b5ed None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:06.687849 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fd8e5-1a00-4cfe-b0f6-78cb9df3b5ed None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:06.688040 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fd8e5-1a00-4cfe-b0f6-78cb9df3b5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:06.721903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-cb7fd8e5-1a00-4cfe-b0f6-78cb9df3b5ed None None] MFA Rules not processed for user `1994043a81bb454297c208839794a479`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:06.727568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-cb7fd8e5-1a00-4cfe-b0f6-78cb9df3b5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:06.749895 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 872/1749] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 13:54:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:06.950933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddaa08-da47-4ea2-a35c-bd8b91b95b62 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:06.974039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddaa08-da47-4ea2-a35c-bd8b91b95b62 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:06.991130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b72c13-2732-4ceb-ad73-0c749f3e4820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:06.992431 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b72c13-2732-4ceb-ad73-0c749f3e4820 service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:06.992867 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b72c13-2732-4ceb-ad73-0c749f3e4820 service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:06.993312 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b72c13-2732-4ceb-ad73-0c749f3e4820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:07.011506 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b72c13-2732-4ceb-ad73-0c749f3e4820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:07.013569 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b72c13-2732-4ceb-ad73-0c749f3e4820 service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:07.045032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 878/1750] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:07.860482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fd8e5-1a00-4cfe-b0f6-78cb9df3b5ed None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:07.876678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fd8e5-1a00-4cfe-b0f6-78cb9df3b5ed None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:07.894835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f8ef7-7be9-45bf-b157-65c4607a7fe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:07.896330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f8ef7-7be9-45bf-b157-65c4607a7fe8 service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:07.896827 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f8ef7-7be9-45bf-b157-65c4607a7fe8 service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:07.897334 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f8ef7-7be9-45bf-b157-65c4607a7fe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:07.924731 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f8ef7-7be9-45bf-b157-65c4607a7fe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:07.926421 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f8ef7-7be9-45bf-b157-65c4607a7fe8 service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:07.951978 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 873/1751] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:12.055903 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b72c13-2732-4ceb-ad73-0c749f3e4820 service nova] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:12.057616 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-a6b72c13-2732-4ceb-ad73-0c749f3e4820 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:12.076631 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b72c13-2732-4ceb-ad73-0c749f3e4820 service nova] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:12.086589 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9acd4-1147-4354-91ac-9bd34c97a515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:12.089674 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9acd4-1147-4354-91ac-9bd34c97a515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:12.089794 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9acd4-1147-4354-91ac-9bd34c97a515 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:12.092283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9acd4-1147-4354-91ac-9bd34c97a515 admin admin] PATH_INFO: `/v3/users/1ad96753880549c6af40aed87cd19ed1` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:12.094386 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9acd4-1147-4354-91ac-9bd34c97a515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad96753880549c6af40aed87cd19ed1)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:12.096279 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9acd4-1147-4354-91ac-9bd34c97a515 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:12.165695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:12.182946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-38f9acd4-1147-4354-91ac-9bd34c97a515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad96753880549c6af40aed87cd19ed1'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:12.183983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-38f9acd4-1147-4354-91ac-9bd34c97a515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad96753880549c6af40aed87cd19ed1'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:12.184968 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-38f9acd4-1147-4354-91ac-9bd34c97a515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad96753880549c6af40aed87cd19ed1'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:12.199391 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-38f9acd4-1147-4354-91ac-9bd34c97a515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad96753880549c6af40aed87cd19ed1'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:12.211098 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-38f9acd4-1147-4354-91ac-9bd34c97a515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad96753880549c6af40aed87cd19ed1'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:12.249432 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 879/1752] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:12 2022] DELETE /identity/v3/users/1ad96753880549c6af40aed87cd19ed1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:12.255619 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78739970-6978-4898-bbd3-7ef43378d358 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:12.256465 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78739970-6978-4898-bbd3-7ef43378d358 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:12.257024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78739970-6978-4898-bbd3-7ef43378d358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:12.330712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-78739970-6978-4898-bbd3-7ef43378d358 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:12.332983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-78739970-6978-4898-bbd3-7ef43378d358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:12.460158 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 874/1753] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:12.489188 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9acd4-1147-4354-91ac-9bd34c97a515 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:12.490946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-38f9acd4-1147-4354-91ac-9bd34c97a515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:12.599263 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9acd4-1147-4354-91ac-9bd34c97a515 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:12.603582 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fdca7-b34c-41f2-ae2f-e4b33943c36c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:12.605109 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fdca7-b34c-41f2-ae2f-e4b33943c36c service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:12.605590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fdca7-b34c-41f2-ae2f-e4b33943c36c service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:12.606016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fdca7-b34c-41f2-ae2f-e4b33943c36c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:12.619591 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fdca7-b34c-41f2-ae2f-e4b33943c36c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:12.622557 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fdca7-b34c-41f2-ae2f-e4b33943c36c service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:12.644580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 880/1754] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:13.384467 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78739970-6978-4898-bbd3-7ef43378d358 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:13.388705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-78739970-6978-4898-bbd3-7ef43378d358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:13.419215 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78739970-6978-4898-bbd3-7ef43378d358 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:13.435056 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87794f47-2c68-4423-9a2d-722eb0f09170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:13.436172 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87794f47-2c68-4423-9a2d-722eb0f09170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:13.436960 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87794f47-2c68-4423-9a2d-722eb0f09170 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:13.437427 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87794f47-2c68-4423-9a2d-722eb0f09170 admin admin] PATH_INFO: `/v3/projects/a5a825235abf40cf8ba4fe211d9634f2` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:13.439361 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87794f47-2c68-4423-9a2d-722eb0f09170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5a825235abf40cf8ba4fe211d9634f2)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:13.454072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87794f47-2c68-4423-9a2d-722eb0f09170 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:13.528683 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:13.531733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-87794f47-2c68-4423-9a2d-722eb0f09170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5a825235abf40cf8ba4fe211d9634f2', 'request_id': 'req-87794f47-2c68-4423-9a2d-722eb0f09170'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:13.544544 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-87794f47-2c68-4423-9a2d-722eb0f09170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5a825235abf40cf8ba4fe211d9634f2', 'request_id': 'req-87794f47-2c68-4423-9a2d-722eb0f09170'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:13.552534 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-87794f47-2c68-4423-9a2d-722eb0f09170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5a825235abf40cf8ba4fe211d9634f2', 'request_id': 'req-87794f47-2c68-4423-9a2d-722eb0f09170'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:13.597629 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-87794f47-2c68-4423-9a2d-722eb0f09170 admin admin] The token cache is being invalidate because project a5a825235abf40cf8ba4fe211d9634f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:13.600389 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-87794f47-2c68-4423-9a2d-722eb0f09170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:13.601420 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-87794f47-2c68-4423-9a2d-722eb0f09170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:13.604072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 875/1755] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:13 2022] DELETE /identity/v3/projects/a5a825235abf40cf8ba4fe211d9634f2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:13.607632 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fdca7-b34c-41f2-ae2f-e4b33943c36c service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:13.621542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fdca7-b34c-41f2-ae2f-e4b33943c36c service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:13.729555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff15ae3-54d6-405b-bbb2-31a7470538d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:13.731626 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff15ae3-54d6-405b-bbb2-31a7470538d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:13.732095 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff15ae3-54d6-405b-bbb2-31a7470538d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:13.732657 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff15ae3-54d6-405b-bbb2-31a7470538d0 admin admin] PATH_INFO: `/v3/users/e82f73015cde45b5b678abdee32e490a` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:13.734572 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff15ae3-54d6-405b-bbb2-31a7470538d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e82f73015cde45b5b678abdee32e490a)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:13.737180 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff15ae3-54d6-405b-bbb2-31a7470538d0 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:13.816032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-dff15ae3-54d6-405b-bbb2-31a7470538d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e82f73015cde45b5b678abdee32e490a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:13.817158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-dff15ae3-54d6-405b-bbb2-31a7470538d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e82f73015cde45b5b678abdee32e490a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:13.818045 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-dff15ae3-54d6-405b-bbb2-31a7470538d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e82f73015cde45b5b678abdee32e490a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:13.826655 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-dff15ae3-54d6-405b-bbb2-31a7470538d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e82f73015cde45b5b678abdee32e490a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:13.829539 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:13.843493 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-dff15ae3-54d6-405b-bbb2-31a7470538d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e82f73015cde45b5b678abdee32e490a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:13.875336 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 881/1756] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:13 2022] DELETE /identity/v3/users/e82f73015cde45b5b678abdee32e490a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:14.877301 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87794f47-2c68-4423-9a2d-722eb0f09170 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:14.880407 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-87794f47-2c68-4423-9a2d-722eb0f09170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:14.904050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87794f47-2c68-4423-9a2d-722eb0f09170 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:14.977212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196719b6-6afe-49a9-bb96-9906b10ee4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:14.978117 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196719b6-6afe-49a9-bb96-9906b10ee4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:14.978401 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196719b6-6afe-49a9-bb96-9906b10ee4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:14.978818 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196719b6-6afe-49a9-bb96-9906b10ee4f9 admin admin] PATH_INFO: `/v3/projects/0691cce95ce44836900b9cf64af6788c` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:14.980200 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196719b6-6afe-49a9-bb96-9906b10ee4f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0691cce95ce44836900b9cf64af6788c)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:14.982158 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196719b6-6afe-49a9-bb96-9906b10ee4f9 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:15.037166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-196719b6-6afe-49a9-bb96-9906b10ee4f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0691cce95ce44836900b9cf64af6788c', 'request_id': 'req-196719b6-6afe-49a9-bb96-9906b10ee4f9'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:15.044375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-196719b6-6afe-49a9-bb96-9906b10ee4f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0691cce95ce44836900b9cf64af6788c', 'request_id': 'req-196719b6-6afe-49a9-bb96-9906b10ee4f9'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:15.051028 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-196719b6-6afe-49a9-bb96-9906b10ee4f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0691cce95ce44836900b9cf64af6788c', 'request_id': 'req-196719b6-6afe-49a9-bb96-9906b10ee4f9'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:15.064396 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-196719b6-6afe-49a9-bb96-9906b10ee4f9 admin admin] The token cache is being invalidate because project 0691cce95ce44836900b9cf64af6788c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:15.064622 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-196719b6-6afe-49a9-bb96-9906b10ee4f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:15.065239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-196719b6-6afe-49a9-bb96-9906b10ee4f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:15.067058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 876/1757] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:14 2022] DELETE /identity/v3/projects/0691cce95ce44836900b9cf64af6788c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:15.072037 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d7c06-c36d-4474-ba01-d7cebc2147bd None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:15.072617 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d7c06-c36d-4474-ba01-d7cebc2147bd None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:15.072617 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d7c06-c36d-4474-ba01-d7cebc2147bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:15.091214 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-d70d7c06-c36d-4474-ba01-d7cebc2147bd None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:15.092400 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d70d7c06-c36d-4474-ba01-d7cebc2147bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:15.167636 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 882/1758] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:15.177383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72671be-6269-41d4-b0bd-a3864d00bd10 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:15.177383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72671be-6269-41d4-b0bd-a3864d00bd10 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:15.179813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72671be-6269-41d4-b0bd-a3864d00bd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:15.199919 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a72671be-6269-41d4-b0bd-a3864d00bd10 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:15.201158 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a72671be-6269-41d4-b0bd-a3864d00bd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:15.213558 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 877/1759] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:15.215069 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d7c06-c36d-4474-ba01-d7cebc2147bd None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:15.227562 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d7c06-c36d-4474-ba01-d7cebc2147bd None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:15.235945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13861b-74ed-4717-b5d6-ba81fa3d2e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:15.236719 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13861b-74ed-4717-b5d6-ba81fa3d2e22 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:15.237106 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13861b-74ed-4717-b5d6-ba81fa3d2e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:15.237482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13861b-74ed-4717-b5d6-ba81fa3d2e22 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:15.238926 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13861b-74ed-4717-b5d6-ba81fa3d2e22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:54:15.239388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13861b-74ed-4717-b5d6-ba81fa3d2e22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:15.241194 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13861b-74ed-4717-b5d6-ba81fa3d2e22 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:15.257315 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 883/1760] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:54:15.261781 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72671be-6269-41d4-b0bd-a3864d00bd10 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:15.275941 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72671be-6269-41d4-b0bd-a3864d00bd10 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:15.282059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff69dc-d7f3-4dd5-85b9-1d107ca8821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:15.282755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff69dc-d7f3-4dd5-85b9-1d107ca8821d admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:15.283142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff69dc-d7f3-4dd5-85b9-1d107ca8821d admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:15.283512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff69dc-d7f3-4dd5-85b9-1d107ca8821d admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:15.284363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff69dc-d7f3-4dd5-85b9-1d107ca8821d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:15.287333 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff69dc-d7f3-4dd5-85b9-1d107ca8821d admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:15.336174 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13861b-74ed-4717-b5d6-ba81fa3d2e22 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:15.344855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 878/1761] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:15 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:15.350233 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13861b-74ed-4717-b5d6-ba81fa3d2e22 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:15.418381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a4fe3-bcee-4d28-90fd-bd2ffeb412ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:15.419063 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a4fe3-bcee-4d28-90fd-bd2ffeb412ff admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:15.419348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a4fe3-bcee-4d28-90fd-bd2ffeb412ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:15.419626 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a4fe3-bcee-4d28-90fd-bd2ffeb412ff admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:15.420393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a4fe3-bcee-4d28-90fd-bd2ffeb412ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:15.422706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a4fe3-bcee-4d28-90fd-bd2ffeb412ff admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:15.445872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff69dc-d7f3-4dd5-85b9-1d107ca8821d admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:15.447665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-24ff69dc-d7f3-4dd5-85b9-1d107ca8821d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:15.448387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 884/1762] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:15 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:15.452108 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a4fe3-bcee-4d28-90fd-bd2ffeb412ff admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:15.463931 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff69dc-d7f3-4dd5-85b9-1d107ca8821d admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:15.468204 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a4fe3-bcee-4d28-90fd-bd2ffeb412ff admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:15.468768 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af865e1-2687-48f9-b045-1c4ba3181aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:15.469679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af865e1-2687-48f9-b045-1c4ba3181aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:15.469975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af865e1-2687-48f9-b045-1c4ba3181aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:15.470257 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af865e1-2687-48f9-b045-1c4ba3181aa5 admin admin] PATH_INFO: `/v3/users/969bff2c510a4751a1dd3c8d9fcaec53` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:15.471445 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af865e1-2687-48f9-b045-1c4ba3181aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=969bff2c510a4751a1dd3c8d9fcaec53)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:15.473761 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ed256-11d4-4b1c-82ea-f0ce4c299419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:15.473968 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af865e1-2687-48f9-b045-1c4ba3181aa5 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:15.474489 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ed256-11d4-4b1c-82ea-f0ce4c299419 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:15.474771 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ed256-11d4-4b1c-82ea-f0ce4c299419 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:15.475048 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ed256-11d4-4b1c-82ea-f0ce4c299419 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:15.475766 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ed256-11d4-4b1c-82ea-f0ce4c299419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:15.477418 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ed256-11d4-4b1c-82ea-f0ce4c299419 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:15.488465 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 885/1763] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:15.492397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ed256-11d4-4b1c-82ea-f0ce4c299419 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:15.504579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ed256-11d4-4b1c-82ea-f0ce4c299419 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:15.509838 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585caee-bb78-487b-9a31-031f95cd6f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:15.510512 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585caee-bb78-487b-9a31-031f95cd6f45 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:15.510830 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585caee-bb78-487b-9a31-031f95cd6f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:15.511174 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585caee-bb78-487b-9a31-031f95cd6f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:15.511963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585caee-bb78-487b-9a31-031f95cd6f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:15.513691 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585caee-bb78-487b-9a31-031f95cd6f45 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:15.516674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:15.528908 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 886/1764] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:15.532884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585caee-bb78-487b-9a31-031f95cd6f45 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:15.538512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5af865e1-2687-48f9-b045-1c4ba3181aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '969bff2c510a4751a1dd3c8d9fcaec53'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:15.544286 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585caee-bb78-487b-9a31-031f95cd6f45 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:15.549281 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741da9dd-79db-4a1f-906a-72fee006f889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:15.550379 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741da9dd-79db-4a1f-906a-72fee006f889 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:15.550666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741da9dd-79db-4a1f-906a-72fee006f889 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:15.550947 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741da9dd-79db-4a1f-906a-72fee006f889 admin admin] PATH_INFO: `/v3/projects/74b0f2b7bd614a25b24faae8e2aa9a47/users/118139ff59a849ebb35b4d9009e0aac9/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:15.551779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5af865e1-2687-48f9-b045-1c4ba3181aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '969bff2c510a4751a1dd3c8d9fcaec53'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:15.552642 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5af865e1-2687-48f9-b045-1c4ba3181aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '969bff2c510a4751a1dd3c8d9fcaec53'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:15.553650 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5af865e1-2687-48f9-b045-1c4ba3181aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '969bff2c510a4751a1dd3c8d9fcaec53'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:15.564699 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5af865e1-2687-48f9-b045-1c4ba3181aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '969bff2c510a4751a1dd3c8d9fcaec53'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:15.566978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741da9dd-79db-4a1f-906a-72fee006f889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b0f2b7bd614a25b24faae8e2aa9a47, user_id=118139ff59a849ebb35b4d9009e0aac9, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:15.569589 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741da9dd-79db-4a1f-906a-72fee006f889 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:15.586128 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 879/1765] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:15 2022] DELETE /identity/v3/users/969bff2c510a4751a1dd3c8d9fcaec53 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:15.589453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 887/1766] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:15 2022] PUT /identity/v3/projects/74b0f2b7bd614a25b24faae8e2aa9a47/users/118139ff59a849ebb35b4d9009e0aac9/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:15.591304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a0564-ef21-48e9-9f09-22d42bf0ba9b None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:15.591694 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a0564-ef21-48e9-9f09-22d42bf0ba9b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:15.592054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a0564-ef21-48e9-9f09-22d42bf0ba9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:15.596451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ba15b-e7a6-44e2-a37e-e9658b733140 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:15.596787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ba15b-e7a6-44e2-a37e-e9658b733140 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:15.597724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ba15b-e7a6-44e2-a37e-e9658b733140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:15.605104 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:15.612719 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-c72a0564-ef21-48e9-9f09-22d42bf0ba9b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:15.614248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c72a0564-ef21-48e9-9f09-22d42bf0ba9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:15.630254 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-977ba15b-e7a6-44e2-a37e-e9658b733140 None None] MFA Rules not processed for user `118139ff59a849ebb35b4d9009e0aac9`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:15.637092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-977ba15b-e7a6-44e2-a37e-e9658b733140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:15.699876 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 880/1767] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:54:15.716896 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a0564-ef21-48e9-9f09-22d42bf0ba9b None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:15.718413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c72a0564-ef21-48e9-9f09-22d42bf0ba9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:15.726739 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 888/1768] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:54:15.731258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ba15b-e7a6-44e2-a37e-e9658b733140 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:15.732592 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-977ba15b-e7a6-44e2-a37e-e9658b733140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:15.747886 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ba15b-e7a6-44e2-a37e-e9658b733140 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:15.754706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa09d02-131c-4fe8-8c0e-f69350b05f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:15.755518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa09d02-131c-4fe8-8c0e-f69350b05f14 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:15.755805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa09d02-131c-4fe8-8c0e-f69350b05f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:15.756081 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa09d02-131c-4fe8-8c0e-f69350b05f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:15.756769 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa09d02-131c-4fe8-8c0e-f69350b05f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:15.758726 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa09d02-131c-4fe8-8c0e-f69350b05f14 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:15.782932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a0564-ef21-48e9-9f09-22d42bf0ba9b None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:15.788507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d66d7e-6035-466a-a25b-99e7a1169199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:15.789761 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d66d7e-6035-466a-a25b-99e7a1169199 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:15.790050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d66d7e-6035-466a-a25b-99e7a1169199 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:15.790331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d66d7e-6035-466a-a25b-99e7a1169199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:15.793551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 889/1769] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:15 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:15.797433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa09d02-131c-4fe8-8c0e-f69350b05f14 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:15.801155 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d66d7e-6035-466a-a25b-99e7a1169199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:15.802723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d66d7e-6035-466a-a25b-99e7a1169199 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:15.813524 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 881/1770] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:54:15.871838 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa09d02-131c-4fe8-8c0e-f69350b05f14 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:15.878661 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225d1a7-d5b1-4d2b-915a-07d616c6e860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:15.879353 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225d1a7-d5b1-4d2b-915a-07d616c6e860 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:15.879639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225d1a7-d5b1-4d2b-915a-07d616c6e860 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:15.879920 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225d1a7-d5b1-4d2b-915a-07d616c6e860 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:15.880688 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225d1a7-d5b1-4d2b-915a-07d616c6e860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:15.883287 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225d1a7-d5b1-4d2b-915a-07d616c6e860 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:15.906856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 890/1771] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:15 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:15.911657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d66d7e-6035-466a-a25b-99e7a1169199 service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:15.921345 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d66d7e-6035-466a-a25b-99e7a1169199 service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:15.928376 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f819873-d51c-48a0-a7cc-3e2ecfd283af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:15.929054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f819873-d51c-48a0-a7cc-3e2ecfd283af admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:15.929469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f819873-d51c-48a0-a7cc-3e2ecfd283af admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:15.929670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f819873-d51c-48a0-a7cc-3e2ecfd283af admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:15.930699 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f819873-d51c-48a0-a7cc-3e2ecfd283af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:15.932330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f819873-d51c-48a0-a7cc-3e2ecfd283af admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:15.942800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 882/1772] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:15.946850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225d1a7-d5b1-4d2b-915a-07d616c6e860 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:15.957295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225d1a7-d5b1-4d2b-915a-07d616c6e860 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:15.961972 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac59b8e-e37d-477c-9f69-dbf15cbc4979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:15.962763 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac59b8e-e37d-477c-9f69-dbf15cbc4979 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:15.963115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac59b8e-e37d-477c-9f69-dbf15cbc4979 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:15.963402 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac59b8e-e37d-477c-9f69-dbf15cbc4979 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:15.964300 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac59b8e-e37d-477c-9f69-dbf15cbc4979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:15.966339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac59b8e-e37d-477c-9f69-dbf15cbc4979 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:15.980454 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 891/1773] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:15.981899 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f819873-d51c-48a0-a7cc-3e2ecfd283af admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:15.994029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f819873-d51c-48a0-a7cc-3e2ecfd283af admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:15.998979 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e66bb4-ab4e-498c-aa8e-575e79709509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:15.999932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e66bb4-ab4e-498c-aa8e-575e79709509 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:16.000202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e66bb4-ab4e-498c-aa8e-575e79709509 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:16.000448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e66bb4-ab4e-498c-aa8e-575e79709509 admin admin] PATH_INFO: `/v3/projects/fedf6f31296346a88e07c59c4b78b2b5/users/a1c9edcb574440519accba808e387410/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:16.016731 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e66bb4-ab4e-498c-aa8e-575e79709509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fedf6f31296346a88e07c59c4b78b2b5, user_id=a1c9edcb574440519accba808e387410, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:16.020031 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e66bb4-ab4e-498c-aa8e-575e79709509 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:16.044054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 883/1774] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:15 2022] PUT /identity/v3/projects/fedf6f31296346a88e07c59c4b78b2b5/users/a1c9edcb574440519accba808e387410/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:16.045890 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1e23f-58b3-48c3-b59b-ee1c76a9d6d5 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:16.046189 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1e23f-58b3-48c3-b59b-ee1c76a9d6d5 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:16.046471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1e23f-58b3-48c3-b59b-ee1c76a9d6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:16.086219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-64e1e23f-58b3-48c3-b59b-ee1c76a9d6d5 None None] MFA Rules not processed for user `a1c9edcb574440519accba808e387410`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:16.087426 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-64e1e23f-58b3-48c3-b59b-ee1c76a9d6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:16.147989 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:16.191776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e66bb4-ab4e-498c-aa8e-575e79709509 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:16.192184 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 892/1775] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:16.197077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1e23f-58b3-48c3-b59b-ee1c76a9d6d5 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:16.198829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-64e1e23f-58b3-48c3-b59b-ee1c76a9d6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:16.223366 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:16.287542 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e66bb4-ab4e-498c-aa8e-575e79709509 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:16.288190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1e23f-58b3-48c3-b59b-ee1c76a9d6d5 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:16.292830 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975163d9-2068-49ec-8251-6c7524a64aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:16.293908 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975163d9-2068-49ec-8251-6c7524a64aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:16.294042 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72a832-7c7e-42fc-ac86-f79c2d6b2ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:16.294138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975163d9-2068-49ec-8251-6c7524a64aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:16.294326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975163d9-2068-49ec-8251-6c7524a64aa4 admin admin] PATH_INFO: `/v3/projects/7e368fb8096f4b679b584932f009fb50` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:16.294580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72a832-7c7e-42fc-ac86-f79c2d6b2ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:16.294866 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72a832-7c7e-42fc-ac86-f79c2d6b2ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:16.295450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975163d9-2068-49ec-8251-6c7524a64aa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e368fb8096f4b679b584932f009fb50)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:16.295702 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72a832-7c7e-42fc-ac86-f79c2d6b2ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:16.296406 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72a832-7c7e-42fc-ac86-f79c2d6b2ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:16.297383 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975163d9-2068-49ec-8251-6c7524a64aa4 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:16.300039 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72a832-7c7e-42fc-ac86-f79c2d6b2ea5 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:16.332318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 884/1776] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:16 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:16.333791 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72a832-7c7e-42fc-ac86-f79c2d6b2ea5 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:16.350688 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-975163d9-2068-49ec-8251-6c7524a64aa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e368fb8096f4b679b584932f009fb50', 'request_id': 'req-975163d9-2068-49ec-8251-6c7524a64aa4'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:16.357471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-975163d9-2068-49ec-8251-6c7524a64aa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e368fb8096f4b679b584932f009fb50', 'request_id': 'req-975163d9-2068-49ec-8251-6c7524a64aa4'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:16.365763 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-975163d9-2068-49ec-8251-6c7524a64aa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e368fb8096f4b679b584932f009fb50', 'request_id': 'req-975163d9-2068-49ec-8251-6c7524a64aa4'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:16.377375 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-975163d9-2068-49ec-8251-6c7524a64aa4 admin admin] The token cache is being invalidate because project 7e368fb8096f4b679b584932f009fb50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:16.377935 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-975163d9-2068-49ec-8251-6c7524a64aa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:16.379152 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-975163d9-2068-49ec-8251-6c7524a64aa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:16.380979 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 893/1777] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:16 2022] DELETE /identity/v3/projects/7e368fb8096f4b679b584932f009fb50 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:16.385448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975163d9-2068-49ec-8251-6c7524a64aa4 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:16.387012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-975163d9-2068-49ec-8251-6c7524a64aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:16.401919 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72a832-7c7e-42fc-ac86-f79c2d6b2ea5 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:16.452736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975163d9-2068-49ec-8251-6c7524a64aa4 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:16.458187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa20153-1672-4a3a-88ea-abbd27e0da3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:16.459070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa20153-1672-4a3a-88ea-abbd27e0da3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:16.459355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa20153-1672-4a3a-88ea-abbd27e0da3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:16.459645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa20153-1672-4a3a-88ea-abbd27e0da3b admin admin] PATH_INFO: `/v3/users/5de57d99dac949fcbddb72a7a50c379c` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:16.460916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa20153-1672-4a3a-88ea-abbd27e0da3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de57d99dac949fcbddb72a7a50c379c)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:16.462882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa20153-1672-4a3a-88ea-abbd27e0da3b admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:16.462995 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c706f5-31ff-4c74-8d72-3263b72e84e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:16.463574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c706f5-31ff-4c74-8d72-3263b72e84e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:16.463987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c706f5-31ff-4c74-8d72-3263b72e84e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:16.464134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c706f5-31ff-4c74-8d72-3263b72e84e2 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:16.464839 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c706f5-31ff-4c74-8d72-3263b72e84e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:16.466844 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c706f5-31ff-4c74-8d72-3263b72e84e2 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:16.482260 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:16.495174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 885/1778] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:16 2022] POST /identity/v3/users => generated 300 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:16.497602 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c706f5-31ff-4c74-8d72-3263b72e84e2 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:16.499466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-b7c706f5-31ff-4c74-8d72-3263b72e84e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:16.512676 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c706f5-31ff-4c74-8d72-3263b72e84e2 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:16.518556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707c0ba-6670-4c50-a914-e13fa1061bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:16.520171 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707c0ba-6670-4c50-a914-e13fa1061bcd admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:16.520527 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707c0ba-6670-4c50-a914-e13fa1061bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:16.520916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707c0ba-6670-4c50-a914-e13fa1061bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:16.521741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707c0ba-6670-4c50-a914-e13fa1061bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:16.523479 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707c0ba-6670-4c50-a914-e13fa1061bcd admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:16.532213 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-faa20153-1672-4a3a-88ea-abbd27e0da3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de57d99dac949fcbddb72a7a50c379c'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:16.533243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-faa20153-1672-4a3a-88ea-abbd27e0da3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de57d99dac949fcbddb72a7a50c379c'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:16.534117 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-faa20153-1672-4a3a-88ea-abbd27e0da3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de57d99dac949fcbddb72a7a50c379c'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:16.537180 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 886/1779] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:16.540927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707c0ba-6670-4c50-a914-e13fa1061bcd admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:16.542799 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e707c0ba-6670-4c50-a914-e13fa1061bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:16.545623 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-faa20153-1672-4a3a-88ea-abbd27e0da3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de57d99dac949fcbddb72a7a50c379c'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:16.556781 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-faa20153-1672-4a3a-88ea-abbd27e0da3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de57d99dac949fcbddb72a7a50c379c'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:16.558487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707c0ba-6670-4c50-a914-e13fa1061bcd admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:16.563933 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cd3dc-5460-4dbd-b581-713ab8c398a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:16.564910 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cd3dc-5460-4dbd-b581-713ab8c398a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:16.565362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cd3dc-5460-4dbd-b581-713ab8c398a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:16.566205 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cd3dc-5460-4dbd-b581-713ab8c398a6 admin admin] PATH_INFO: `/v3/projects/fbf9acc6fba4446d8d26b8702361d2d9/users/aacf64d5f19f4f32aacdacd097d7b7c6/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:16.581588 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 894/1780] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:16 2022] DELETE /identity/v3/users/5de57d99dac949fcbddb72a7a50c379c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:16.598764 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cd3dc-5460-4dbd-b581-713ab8c398a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf9acc6fba4446d8d26b8702361d2d9, user_id=aacf64d5f19f4f32aacdacd097d7b7c6, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:16.601677 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cd3dc-5460-4dbd-b581-713ab8c398a6 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:16.619197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 887/1781] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:16 2022] PUT /identity/v3/projects/fbf9acc6fba4446d8d26b8702361d2d9/users/aacf64d5f19f4f32aacdacd097d7b7c6/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:16.623099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa20153-1672-4a3a-88ea-abbd27e0da3b admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:16.707843 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa20153-1672-4a3a-88ea-abbd27e0da3b admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:16.789165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27f849-6e64-45e6-b817-95b79b0fcdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:16.790066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27f849-6e64-45e6-b817-95b79b0fcdca admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:16.790727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27f849-6e64-45e6-b817-95b79b0fcdca admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:16.790898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27f849-6e64-45e6-b817-95b79b0fcdca admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:16.792586 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27f849-6e64-45e6-b817-95b79b0fcdca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:16.793488 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27f849-6e64-45e6-b817-95b79b0fcdca admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:16.807441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 895/1782] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:16.813297 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cd3dc-5460-4dbd-b581-713ab8c398a6 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:16.824947 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:16.832428 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cd3dc-5460-4dbd-b581-713ab8c398a6 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:16.847695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75684961-0c9f-4713-9e2f-ddb70a6b0356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:16.849174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75684961-0c9f-4713-9e2f-ddb70a6b0356 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:16.849685 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75684961-0c9f-4713-9e2f-ddb70a6b0356 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:16.850332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75684961-0c9f-4713-9e2f-ddb70a6b0356 admin admin] PATH_INFO: `/v3/projects/fbf9acc6fba4446d8d26b8702361d2d9/users/aacf64d5f19f4f32aacdacd097d7b7c6/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:16.855463 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75684961-0c9f-4713-9e2f-ddb70a6b0356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf9acc6fba4446d8d26b8702361d2d9, user_id=aacf64d5f19f4f32aacdacd097d7b7c6, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:16.859634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75684961-0c9f-4713-9e2f-ddb70a6b0356 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:16.882685 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 888/1783] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:16 2022] PUT /identity/v3/projects/fbf9acc6fba4446d8d26b8702361d2d9/users/aacf64d5f19f4f32aacdacd097d7b7c6/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:16.893161 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e2edb-2984-4237-b4c8-e7609a7e13d8 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:16.893471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e2edb-2984-4237-b4c8-e7609a7e13d8 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:16.893789 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e2edb-2984-4237-b4c8-e7609a7e13d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:16.939054 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-449e2edb-2984-4237-b4c8-e7609a7e13d8 None None] MFA Rules not processed for user `aacf64d5f19f4f32aacdacd097d7b7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:16.939054 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-449e2edb-2984-4237-b4c8-e7609a7e13d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:16.977999 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:16.993467 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75684961-0c9f-4713-9e2f-ddb70a6b0356 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:16.995738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-75684961-0c9f-4713-9e2f-ddb70a6b0356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:17.045342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 896/1784] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:17.064943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e2edb-2984-4237-b4c8-e7609a7e13d8 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:17.066455 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-449e2edb-2984-4237-b4c8-e7609a7e13d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:17.101861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75684961-0c9f-4713-9e2f-ddb70a6b0356 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:17.110598 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942452f-43ee-44ce-adbb-2f1849c0b273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:17.111687 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942452f-43ee-44ce-adbb-2f1849c0b273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:17.112187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942452f-43ee-44ce-adbb-2f1849c0b273 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:17.112871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942452f-43ee-44ce-adbb-2f1849c0b273 admin admin] PATH_INFO: `/v3/projects/f5ec6518b83e4544900c25659ab8ac95` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:17.114591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942452f-43ee-44ce-adbb-2f1849c0b273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5ec6518b83e4544900c25659ab8ac95)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:17.116951 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942452f-43ee-44ce-adbb-2f1849c0b273 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:17.135298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e2edb-2984-4237-b4c8-e7609a7e13d8 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:17.140474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad83b1-ad9e-4007-9296-315da69a73db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:17.141457 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad83b1-ad9e-4007-9296-315da69a73db service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:17.141741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad83b1-ad9e-4007-9296-315da69a73db service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:17.142018 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad83b1-ad9e-4007-9296-315da69a73db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:17.163249 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad83b1-ad9e-4007-9296-315da69a73db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:17.166146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad83b1-ad9e-4007-9296-315da69a73db service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:17.179382 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7942452f-43ee-44ce-adbb-2f1849c0b273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ec6518b83e4544900c25659ab8ac95', 'request_id': 'req-7942452f-43ee-44ce-adbb-2f1849c0b273'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:17.185654 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 897/1785] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:54:17.187934 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7942452f-43ee-44ce-adbb-2f1849c0b273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ec6518b83e4544900c25659ab8ac95', 'request_id': 'req-7942452f-43ee-44ce-adbb-2f1849c0b273'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:17.198563 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7942452f-43ee-44ce-adbb-2f1849c0b273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ec6518b83e4544900c25659ab8ac95', 'request_id': 'req-7942452f-43ee-44ce-adbb-2f1849c0b273'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:17.218343 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7942452f-43ee-44ce-adbb-2f1849c0b273 admin admin] The token cache is being invalidate because project f5ec6518b83e4544900c25659ab8ac95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:17.218642 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7942452f-43ee-44ce-adbb-2f1849c0b273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:17.219337 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7942452f-43ee-44ce-adbb-2f1849c0b273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:17.222428 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 889/1786] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:16 2022] DELETE /identity/v3/projects/f5ec6518b83e4544900c25659ab8ac95 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:17.227652 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f11497-6870-41c3-99ab-e646ba1f2e9a None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:17.228669 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f11497-6870-41c3-99ab-e646ba1f2e9a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:17.229071 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f11497-6870-41c3-99ab-e646ba1f2e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:17.258483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-64f11497-6870-41c3-99ab-e646ba1f2e9a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:17.260699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-64f11497-6870-41c3-99ab-e646ba1f2e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:17.361953 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 898/1787] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:54:17.369910 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354be44b-0e45-4e16-8860-2e4516275fc2 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:17.370206 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354be44b-0e45-4e16-8860-2e4516275fc2 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:17.370521 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354be44b-0e45-4e16-8860-2e4516275fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:17.393015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-354be44b-0e45-4e16-8860-2e4516275fc2 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:17.394971 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-354be44b-0e45-4e16-8860-2e4516275fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:17.403612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 890/1788] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:17.407826 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f11497-6870-41c3-99ab-e646ba1f2e9a None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:17.419635 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f11497-6870-41c3-99ab-e646ba1f2e9a None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:17.424981 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc874a-75a4-4cce-a81c-7d20de126f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:17.425678 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc874a-75a4-4cce-a81c-7d20de126f3d admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:17.425959 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc874a-75a4-4cce-a81c-7d20de126f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:17.426241 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc874a-75a4-4cce-a81c-7d20de126f3d admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:17.426946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc874a-75a4-4cce-a81c-7d20de126f3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:54:17.427247 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc874a-75a4-4cce-a81c-7d20de126f3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:17.428826 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc874a-75a4-4cce-a81c-7d20de126f3d admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:17.446135 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 899/1789] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:54:17.450793 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354be44b-0e45-4e16-8860-2e4516275fc2 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:17.467282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354be44b-0e45-4e16-8860-2e4516275fc2 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:17.472135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3908e-1f0c-4c3f-b8a4-6db65ceee4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:17.472797 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3908e-1f0c-4c3f-b8a4-6db65ceee4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:17.473082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3908e-1f0c-4c3f-b8a4-6db65ceee4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:17.473387 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3908e-1f0c-4c3f-b8a4-6db65ceee4e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:17.474102 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3908e-1f0c-4c3f-b8a4-6db65ceee4e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:17.476228 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3908e-1f0c-4c3f-b8a4-6db65ceee4e2 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:17.515074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 891/1790] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:17 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:17.516533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc874a-75a4-4cce-a81c-7d20de126f3d admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:17.535998 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc874a-75a4-4cce-a81c-7d20de126f3d admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:17.631668 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:17.647169 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d7d81-95ec-4615-9f81-912d19839deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:17.647924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d7d81-95ec-4615-9f81-912d19839deb admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:17.648314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d7d81-95ec-4615-9f81-912d19839deb admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:17.648671 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d7d81-95ec-4615-9f81-912d19839deb admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:17.649519 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d7d81-95ec-4615-9f81-912d19839deb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:17.651967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d7d81-95ec-4615-9f81-912d19839deb admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:17.682074 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 900/1791] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:17 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:17.682482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3908e-1f0c-4c3f-b8a4-6db65ceee4e2 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:17.695844 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3908e-1f0c-4c3f-b8a4-6db65ceee4e2 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:17.705927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52b43a-b774-41e1-9c1b-6c36e945a82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:17.707394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52b43a-b774-41e1-9c1b-6c36e945a82a admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:17.707770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52b43a-b774-41e1-9c1b-6c36e945a82a admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:17.707994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52b43a-b774-41e1-9c1b-6c36e945a82a admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:17.709025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52b43a-b774-41e1-9c1b-6c36e945a82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:17.712566 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52b43a-b774-41e1-9c1b-6c36e945a82a admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:17.734342 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 892/1792] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:17.738496 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d7d81-95ec-4615-9f81-912d19839deb admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:17.750634 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d7d81-95ec-4615-9f81-912d19839deb admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:17.775999 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8dc095-606b-403e-aeda-015dff1908c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:17.776947 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dc095-606b-403e-aeda-015dff1908c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:17.777405 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dc095-606b-403e-aeda-015dff1908c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:17.777838 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dc095-606b-403e-aeda-015dff1908c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:17.778727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8dc095-606b-403e-aeda-015dff1908c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:17.780445 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8dc095-606b-403e-aeda-015dff1908c4 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:17.791931 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 901/1793] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:17.796098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52b43a-b774-41e1-9c1b-6c36e945a82a admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:17.807333 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52b43a-b774-41e1-9c1b-6c36e945a82a admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:17.814109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cba747-913b-4cc5-8c14-466297b10113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:17.815012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cba747-913b-4cc5-8c14-466297b10113 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:17.815296 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cba747-913b-4cc5-8c14-466297b10113 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:17.815606 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cba747-913b-4cc5-8c14-466297b10113 admin admin] PATH_INFO: `/v3/projects/23b71f6cac1641deb740cc59f16fbed7/users/c5b378427f93481a9cc3fe28fa424465/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:17.835390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cba747-913b-4cc5-8c14-466297b10113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b71f6cac1641deb740cc59f16fbed7, user_id=c5b378427f93481a9cc3fe28fa424465, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:17.838328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cba747-913b-4cc5-8c14-466297b10113 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:17.856280 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 893/1794] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:17 2022] PUT /identity/v3/projects/23b71f6cac1641deb740cc59f16fbed7/users/c5b378427f93481a9cc3fe28fa424465/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:17.875122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182346cb-c18b-41dc-8a56-36df04a3f99d None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:17.875122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182346cb-c18b-41dc-8a56-36df04a3f99d None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:17.875122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182346cb-c18b-41dc-8a56-36df04a3f99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:17.899096 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-182346cb-c18b-41dc-8a56-36df04a3f99d None None] MFA Rules not processed for user `c5b378427f93481a9cc3fe28fa424465`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:17.900449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-182346cb-c18b-41dc-8a56-36df04a3f99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:17.933030 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cba747-913b-4cc5-8c14-466297b10113 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:17.934805 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-23cba747-913b-4cc5-8c14-466297b10113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:17.955879 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:17.978379 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 902/1795] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:17.982810 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182346cb-c18b-41dc-8a56-36df04a3f99d None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:18.002360 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cba747-913b-4cc5-8c14-466297b10113 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:18.007559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde1853-61cf-44d4-9a61-3ee1731c221e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:18.008224 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde1853-61cf-44d4-9a61-3ee1731c221e service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:18.008509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde1853-61cf-44d4-9a61-3ee1731c221e service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:18.008816 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde1853-61cf-44d4-9a61-3ee1731c221e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:18.011268 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-cbde1853-61cf-44d4-9a61-3ee1731c221e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:18.068683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182346cb-c18b-41dc-8a56-36df04a3f99d None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:18.078401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31d365-8e4a-4adf-bc72-994b57131b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:18.079079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31d365-8e4a-4adf-bc72-994b57131b71 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:18.079363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31d365-8e4a-4adf-bc72-994b57131b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:18.079680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31d365-8e4a-4adf-bc72-994b57131b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:18.080409 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31d365-8e4a-4adf-bc72-994b57131b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:18.083110 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31d365-8e4a-4adf-bc72-994b57131b71 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:18.093030 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde1853-61cf-44d4-9a61-3ee1731c221e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:18.094950 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde1853-61cf-44d4-9a61-3ee1731c221e service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:18.105487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 894/1796] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:54:18.113915 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 903/1797] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:17 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:18.118012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde1853-61cf-44d4-9a61-3ee1731c221e service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:18.130087 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde1853-61cf-44d4-9a61-3ee1731c221e service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:18.204379 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d87ab-30e1-4049-9410-3a4af392103b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:18.205064 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d87ab-30e1-4049-9410-3a4af392103b admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:18.205375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d87ab-30e1-4049-9410-3a4af392103b admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:18.205654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d87ab-30e1-4049-9410-3a4af392103b admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:18.206923 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d87ab-30e1-4049-9410-3a4af392103b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:18.208871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d87ab-30e1-4049-9410-3a4af392103b admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:18.241121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 895/1798] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:18 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:18.242616 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31d365-8e4a-4adf-bc72-994b57131b71 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:18.254488 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31d365-8e4a-4adf-bc72-994b57131b71 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:18.259852 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba107ff-8c96-44cb-972f-96aac1787733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:18.260521 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba107ff-8c96-44cb-972f-96aac1787733 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:18.260804 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba107ff-8c96-44cb-972f-96aac1787733 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:18.261075 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba107ff-8c96-44cb-972f-96aac1787733 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:18.261835 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba107ff-8c96-44cb-972f-96aac1787733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:18.263456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba107ff-8c96-44cb-972f-96aac1787733 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:18.277676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 904/1799] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:18.282016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d87ab-30e1-4049-9410-3a4af392103b admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:18.294805 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d87ab-30e1-4049-9410-3a4af392103b admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:18.300409 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630f53d-705d-4215-bc46-f3a469b1e74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:18.302312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630f53d-705d-4215-bc46-f3a469b1e74e admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:18.302312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630f53d-705d-4215-bc46-f3a469b1e74e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:18.302312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630f53d-705d-4215-bc46-f3a469b1e74e admin admin] PATH_INFO: `/v3/projects/162e4ccf63274e0ca7c5c93111c5a93c/users/14320ee3dfaf4261a0d56da2c86fed10/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:18.330167 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630f53d-705d-4215-bc46-f3a469b1e74e admin admin] RBAC: Authorizing `identity:create_grant(project_id=162e4ccf63274e0ca7c5c93111c5a93c, user_id=14320ee3dfaf4261a0d56da2c86fed10, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:18.332876 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630f53d-705d-4215-bc46-f3a469b1e74e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:18.349023 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 896/1800] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:18 2022] PUT /identity/v3/projects/162e4ccf63274e0ca7c5c93111c5a93c/users/14320ee3dfaf4261a0d56da2c86fed10/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:18.353205 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba107ff-8c96-44cb-972f-96aac1787733 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:18.365640 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba107ff-8c96-44cb-972f-96aac1787733 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:18.400246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:18.457850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f55ad-827f-48ca-a381-88a76eca6737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:18.458907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f55ad-827f-48ca-a381-88a76eca6737 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:18.459267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f55ad-827f-48ca-a381-88a76eca6737 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:18.460003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f55ad-827f-48ca-a381-88a76eca6737 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:18.460605 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f55ad-827f-48ca-a381-88a76eca6737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:18.462520 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f55ad-827f-48ca-a381-88a76eca6737 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:18.476131 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 905/1801] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:18.482041 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630f53d-705d-4215-bc46-f3a469b1e74e admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:18.497716 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630f53d-705d-4215-bc46-f3a469b1e74e admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:18.504375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c6cba-092e-4d1a-914d-f8bea810356f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:18.505477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6cba-092e-4d1a-914d-f8bea810356f admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:18.505726 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6cba-092e-4d1a-914d-f8bea810356f admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:18.507342 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6cba-092e-4d1a-914d-f8bea810356f admin admin] PATH_INFO: `/v3/projects/162e4ccf63274e0ca7c5c93111c5a93c/users/14320ee3dfaf4261a0d56da2c86fed10/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:18.510696 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c6cba-092e-4d1a-914d-f8bea810356f admin admin] RBAC: Authorizing `identity:create_grant(project_id=162e4ccf63274e0ca7c5c93111c5a93c, user_id=14320ee3dfaf4261a0d56da2c86fed10, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:18.513687 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c6cba-092e-4d1a-914d-f8bea810356f admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:18.527265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 897/1802] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:18 2022] PUT /identity/v3/projects/162e4ccf63274e0ca7c5c93111c5a93c/users/14320ee3dfaf4261a0d56da2c86fed10/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:18.538530 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281738ae-0979-4d78-858d-b0014a999b5a None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:18.538814 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281738ae-0979-4d78-858d-b0014a999b5a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:18.539097 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281738ae-0979-4d78-858d-b0014a999b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:18.568231 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-281738ae-0979-4d78-858d-b0014a999b5a None None] MFA Rules not processed for user `14320ee3dfaf4261a0d56da2c86fed10`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:18.569516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-281738ae-0979-4d78-858d-b0014a999b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:18.651438 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 906/1803] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:18.663605 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c6cba-092e-4d1a-914d-f8bea810356f admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:18.692420 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:18.725872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c6cba-092e-4d1a-914d-f8bea810356f admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:18.729487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217c935-d45f-4a90-89d5-0a0556a8bf61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:18.730136 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217c935-d45f-4a90-89d5-0a0556a8bf61 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:18.730418 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217c935-d45f-4a90-89d5-0a0556a8bf61 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:18.730698 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217c935-d45f-4a90-89d5-0a0556a8bf61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:18.791984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217c935-d45f-4a90-89d5-0a0556a8bf61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:18.793454 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217c935-d45f-4a90-89d5-0a0556a8bf61 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:18.804716 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 898/1804] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:20.249404 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281738ae-0979-4d78-858d-b0014a999b5a None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:20.250834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-281738ae-0979-4d78-858d-b0014a999b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:20.272060 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281738ae-0979-4d78-858d-b0014a999b5a None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:20.282962 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f67a6-e840-4a61-ba56-f53f6af7620c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:20.284164 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f67a6-e840-4a61-ba56-f53f6af7620c service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:20.284676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f67a6-e840-4a61-ba56-f53f6af7620c service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:20.285162 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f67a6-e840-4a61-ba56-f53f6af7620c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:20.304358 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f67a6-e840-4a61-ba56-f53f6af7620c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:20.305866 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f67a6-e840-4a61-ba56-f53f6af7620c service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:20.318320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 907/1805] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:22.410734 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217c935-d45f-4a90-89d5-0a0556a8bf61 service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:22.420055 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217c935-d45f-4a90-89d5-0a0556a8bf61 service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:22.424049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbf226-82c7-469b-a740-bb8cc8a5ad97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:22.425257 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbf226-82c7-469b-a740-bb8cc8a5ad97 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:22.425570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbf226-82c7-469b-a740-bb8cc8a5ad97 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:22.425846 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbf226-82c7-469b-a740-bb8cc8a5ad97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:22.428176 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1edbf226-82c7-469b-a740-bb8cc8a5ad97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:22.491145 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbf226-82c7-469b-a740-bb8cc8a5ad97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:22.492632 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbf226-82c7-469b-a740-bb8cc8a5ad97 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:22.501650 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 899/1806] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:24.232793 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f67a6-e840-4a61-ba56-f53f6af7620c service cinder] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:24.301233 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f67a6-e840-4a61-ba56-f53f6af7620c service cinder] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:24.306720 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c02106-4194-4abc-be1f-51cc749b4e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:24.307089 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c02106-4194-4abc-be1f-51cc749b4e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:24.307377 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c02106-4194-4abc-be1f-51cc749b4e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:24.307651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c02106-4194-4abc-be1f-51cc749b4e12 admin admin] PATH_INFO: `/v3/users/c5b378427f93481a9cc3fe28fa424465` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:24.308966 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c02106-4194-4abc-be1f-51cc749b4e12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b378427f93481a9cc3fe28fa424465)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:24.311187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c02106-4194-4abc-be1f-51cc749b4e12 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:24.369780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:24.380826 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-88c02106-4194-4abc-be1f-51cc749b4e12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b378427f93481a9cc3fe28fa424465'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:24.380826 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-88c02106-4194-4abc-be1f-51cc749b4e12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b378427f93481a9cc3fe28fa424465'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:24.380826 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-88c02106-4194-4abc-be1f-51cc749b4e12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b378427f93481a9cc3fe28fa424465'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:24.396580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-88c02106-4194-4abc-be1f-51cc749b4e12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b378427f93481a9cc3fe28fa424465'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:24.405949 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-88c02106-4194-4abc-be1f-51cc749b4e12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b378427f93481a9cc3fe28fa424465'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:24.431267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 908/1807] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:24 2022] DELETE /identity/v3/users/c5b378427f93481a9cc3fe28fa424465 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:24.435867 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638afb75-d602-407a-bec5-24b88b45c8df None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:24.436360 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638afb75-d602-407a-bec5-24b88b45c8df None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:24.436585 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638afb75-d602-407a-bec5-24b88b45c8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:24.477103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-638afb75-d602-407a-bec5-24b88b45c8df None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:24.478640 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-638afb75-d602-407a-bec5-24b88b45c8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:24.553247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 900/1808] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:24.579009 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c02106-4194-4abc-be1f-51cc749b4e12 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:24.580536 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-88c02106-4194-4abc-be1f-51cc749b4e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:24.707583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c02106-4194-4abc-be1f-51cc749b4e12 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:24.711693 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd99e6-f130-44cc-8bc5-c89c73b092d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:24.712387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd99e6-f130-44cc-8bc5-c89c73b092d9 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:24.712780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd99e6-f130-44cc-8bc5-c89c73b092d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:24.713812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd99e6-f130-44cc-8bc5-c89c73b092d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:24.725682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd99e6-f130-44cc-8bc5-c89c73b092d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:24.727050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd99e6-f130-44cc-8bc5-c89c73b092d9 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:24.744627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 909/1809] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:25.099012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638afb75-d602-407a-bec5-24b88b45c8df None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:25.100804 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-638afb75-d602-407a-bec5-24b88b45c8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:25.115605 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638afb75-d602-407a-bec5-24b88b45c8df None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:25.122603 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1b8b6-7b97-4ae1-8b0e-04e0e63b500b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:25.123614 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1b8b6-7b97-4ae1-8b0e-04e0e63b500b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:25.123900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1b8b6-7b97-4ae1-8b0e-04e0e63b500b admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:25.124234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1b8b6-7b97-4ae1-8b0e-04e0e63b500b admin admin] PATH_INFO: `/v3/users/118139ff59a849ebb35b4d9009e0aac9` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:25.126419 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1b8b6-7b97-4ae1-8b0e-04e0e63b500b admin admin] RBAC: Authorizing `identity:delete_user(user_id=118139ff59a849ebb35b4d9009e0aac9)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:25.129423 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1b8b6-7b97-4ae1-8b0e-04e0e63b500b admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:25.145548 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:25.212121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-97f1b8b6-7b97-4ae1-8b0e-04e0e63b500b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '118139ff59a849ebb35b4d9009e0aac9'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:25.234988 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-97f1b8b6-7b97-4ae1-8b0e-04e0e63b500b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '118139ff59a849ebb35b4d9009e0aac9'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:25.236255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-97f1b8b6-7b97-4ae1-8b0e-04e0e63b500b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '118139ff59a849ebb35b4d9009e0aac9'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:25.237008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-97f1b8b6-7b97-4ae1-8b0e-04e0e63b500b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '118139ff59a849ebb35b4d9009e0aac9'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:25.253546 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-97f1b8b6-7b97-4ae1-8b0e-04e0e63b500b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '118139ff59a849ebb35b4d9009e0aac9'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:25.272076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 901/1810] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:25 2022] DELETE /identity/v3/users/118139ff59a849ebb35b4d9009e0aac9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:25.276915 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471c03e-e1e7-496e-8fed-131ebd0a25ad None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:25.277498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471c03e-e1e7-496e-8fed-131ebd0a25ad None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:25.277498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471c03e-e1e7-496e-8fed-131ebd0a25ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:25.296248 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-7471c03e-e1e7-496e-8fed-131ebd0a25ad None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:25.297555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7471c03e-e1e7-496e-8fed-131ebd0a25ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:25.370206 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 910/1811] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:54:25.381552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1b8b6-7b97-4ae1-8b0e-04e0e63b500b admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:25.382997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-97f1b8b6-7b97-4ae1-8b0e-04e0e63b500b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:25.446440 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1b8b6-7b97-4ae1-8b0e-04e0e63b500b admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:25.450118 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb6d00-8385-426a-8be7-02f76479facc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:25.450778 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb6d00-8385-426a-8be7-02f76479facc service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:25.451048 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb6d00-8385-426a-8be7-02f76479facc service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:25.451328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb6d00-8385-426a-8be7-02f76479facc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:25.461102 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb6d00-8385-426a-8be7-02f76479facc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:25.462531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb6d00-8385-426a-8be7-02f76479facc service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:25.472133 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 902/1812] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:26.012638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471c03e-e1e7-496e-8fed-131ebd0a25ad None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:26.015101 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7471c03e-e1e7-496e-8fed-131ebd0a25ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:26.037584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471c03e-e1e7-496e-8fed-131ebd0a25ad None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:26.047807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ac9bd-7758-4b0f-b80c-c0c991ef1a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:26.049672 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ac9bd-7758-4b0f-b80c-c0c991ef1a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:26.050184 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ac9bd-7758-4b0f-b80c-c0c991ef1a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:26.050659 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ac9bd-7758-4b0f-b80c-c0c991ef1a65 admin admin] PATH_INFO: `/v3/projects/23b71f6cac1641deb740cc59f16fbed7` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:26.052344 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ac9bd-7758-4b0f-b80c-c0c991ef1a65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b71f6cac1641deb740cc59f16fbed7)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:26.068177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ac9bd-7758-4b0f-b80c-c0c991ef1a65 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:26.168891 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e03ac9bd-7758-4b0f-b80c-c0c991ef1a65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b71f6cac1641deb740cc59f16fbed7', 'request_id': 'req-e03ac9bd-7758-4b0f-b80c-c0c991ef1a65'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.178480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e03ac9bd-7758-4b0f-b80c-c0c991ef1a65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b71f6cac1641deb740cc59f16fbed7', 'request_id': 'req-e03ac9bd-7758-4b0f-b80c-c0c991ef1a65'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.182031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:26.192427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e03ac9bd-7758-4b0f-b80c-c0c991ef1a65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b71f6cac1641deb740cc59f16fbed7', 'request_id': 'req-e03ac9bd-7758-4b0f-b80c-c0c991ef1a65'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.206778 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb6d00-8385-426a-8be7-02f76479facc service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:26.208302 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1acb6d00-8385-426a-8be7-02f76479facc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:26.235335 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e03ac9bd-7758-4b0f-b80c-c0c991ef1a65 admin admin] The token cache is being invalidate because project 23b71f6cac1641deb740cc59f16fbed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:26.235636 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e03ac9bd-7758-4b0f-b80c-c0c991ef1a65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.236481 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb6d00-8385-426a-8be7-02f76479facc service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:26.236783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e03ac9bd-7758-4b0f-b80c-c0c991ef1a65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.238593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 911/1813] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:26 2022] DELETE /identity/v3/projects/23b71f6cac1641deb740cc59f16fbed7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:26.242817 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ac9bd-7758-4b0f-b80c-c0c991ef1a65 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:26.246531 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e03ac9bd-7758-4b0f-b80c-c0c991ef1a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:26.323869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42dc86b-63cf-4970-9c30-fd268e7098c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:26.325106 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42dc86b-63cf-4970-9c30-fd268e7098c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:26.325602 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42dc86b-63cf-4970-9c30-fd268e7098c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:26.325955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42dc86b-63cf-4970-9c30-fd268e7098c7 admin admin] PATH_INFO: `/v3/projects/74b0f2b7bd614a25b24faae8e2aa9a47` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:26.328670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42dc86b-63cf-4970-9c30-fd268e7098c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b0f2b7bd614a25b24faae8e2aa9a47)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:26.332106 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42dc86b-63cf-4970-9c30-fd268e7098c7 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:26.342792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ac9bd-7758-4b0f-b80c-c0c991ef1a65 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:26.350016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b9d98-ed77-4310-859e-758f1e30ffdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:26.350927 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b9d98-ed77-4310-859e-758f1e30ffdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:26.351449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b9d98-ed77-4310-859e-758f1e30ffdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:26.351965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b9d98-ed77-4310-859e-758f1e30ffdf admin admin] PATH_INFO: `/v3/users/14320ee3dfaf4261a0d56da2c86fed10` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:26.353563 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b9d98-ed77-4310-859e-758f1e30ffdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=14320ee3dfaf4261a0d56da2c86fed10)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:26.355919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b9d98-ed77-4310-859e-758f1e30ffdf admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:26.422480 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:26.439692 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-bd1b9d98-ed77-4310-859e-758f1e30ffdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14320ee3dfaf4261a0d56da2c86fed10'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.440890 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-bd1b9d98-ed77-4310-859e-758f1e30ffdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14320ee3dfaf4261a0d56da2c86fed10'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.441996 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-bd1b9d98-ed77-4310-859e-758f1e30ffdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14320ee3dfaf4261a0d56da2c86fed10'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.444597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-c42dc86b-63cf-4970-9c30-fd268e7098c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b0f2b7bd614a25b24faae8e2aa9a47', 'request_id': 'req-c42dc86b-63cf-4970-9c30-fd268e7098c7'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.452013 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-bd1b9d98-ed77-4310-859e-758f1e30ffdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14320ee3dfaf4261a0d56da2c86fed10'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.455114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-c42dc86b-63cf-4970-9c30-fd268e7098c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b0f2b7bd614a25b24faae8e2aa9a47', 'request_id': 'req-c42dc86b-63cf-4970-9c30-fd268e7098c7'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.469198 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-bd1b9d98-ed77-4310-859e-758f1e30ffdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14320ee3dfaf4261a0d56da2c86fed10'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.469327 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-c42dc86b-63cf-4970-9c30-fd268e7098c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b0f2b7bd614a25b24faae8e2aa9a47', 'request_id': 'req-c42dc86b-63cf-4970-9c30-fd268e7098c7'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.484190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-c42dc86b-63cf-4970-9c30-fd268e7098c7 admin admin] The token cache is being invalidate because project 74b0f2b7bd614a25b24faae8e2aa9a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:26.485149 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-c42dc86b-63cf-4970-9c30-fd268e7098c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.486086 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-c42dc86b-63cf-4970-9c30-fd268e7098c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.488189 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 903/1814] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:26 2022] DELETE /identity/v3/projects/74b0f2b7bd614a25b24faae8e2aa9a47 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:26.491873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42dc86b-63cf-4970-9c30-fd268e7098c7 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:26.494921 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 912/1815] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:26 2022] DELETE /identity/v3/users/14320ee3dfaf4261a0d56da2c86fed10 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:26.498917 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c42dc86b-63cf-4970-9c30-fd268e7098c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:26.600841 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42dc86b-63cf-4970-9c30-fd268e7098c7 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:26.701918 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fe024-237a-4a6f-8de8-36e558b57902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:26.702843 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fe024-237a-4a6f-8de8-36e558b57902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:26.703122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fe024-237a-4a6f-8de8-36e558b57902 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:26.703395 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fe024-237a-4a6f-8de8-36e558b57902 admin admin] PATH_INFO: `/v3/users/a1c9edcb574440519accba808e387410` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:26.704778 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fe024-237a-4a6f-8de8-36e558b57902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c9edcb574440519accba808e387410)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:26.706757 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fe024-237a-4a6f-8de8-36e558b57902 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:26.763498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-cc7fe024-237a-4a6f-8de8-36e558b57902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c9edcb574440519accba808e387410'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.776747 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-cc7fe024-237a-4a6f-8de8-36e558b57902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c9edcb574440519accba808e387410'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.777701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-cc7fe024-237a-4a6f-8de8-36e558b57902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c9edcb574440519accba808e387410'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.779435 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-cc7fe024-237a-4a6f-8de8-36e558b57902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c9edcb574440519accba808e387410'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.785915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-cc7fe024-237a-4a6f-8de8-36e558b57902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c9edcb574440519accba808e387410'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:26.787391 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:26.798822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b9d98-ed77-4310-859e-758f1e30ffdf admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:26.800816 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-bd1b9d98-ed77-4310-859e-758f1e30ffdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:26.807137 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 904/1816] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:26 2022] DELETE /identity/v3/users/a1c9edcb574440519accba808e387410 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:26.851812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b9d98-ed77-4310-859e-758f1e30ffdf admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:26.925955 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78415a4-61e7-4d3b-a2dd-c104a5f01ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:26.926947 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78415a4-61e7-4d3b-a2dd-c104a5f01ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:26.927234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78415a4-61e7-4d3b-a2dd-c104a5f01ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:26.927513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78415a4-61e7-4d3b-a2dd-c104a5f01ec4 admin admin] PATH_INFO: `/v3/projects/162e4ccf63274e0ca7c5c93111c5a93c` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:26.928704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78415a4-61e7-4d3b-a2dd-c104a5f01ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=162e4ccf63274e0ca7c5c93111c5a93c)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:26.930642 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78415a4-61e7-4d3b-a2dd-c104a5f01ec4 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:26.937040 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:26.996567 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d78415a4-61e7-4d3b-a2dd-c104a5f01ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '162e4ccf63274e0ca7c5c93111c5a93c', 'request_id': 'req-d78415a4-61e7-4d3b-a2dd-c104a5f01ec4'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:27.005531 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d78415a4-61e7-4d3b-a2dd-c104a5f01ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '162e4ccf63274e0ca7c5c93111c5a93c', 'request_id': 'req-d78415a4-61e7-4d3b-a2dd-c104a5f01ec4'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:27.016905 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d78415a4-61e7-4d3b-a2dd-c104a5f01ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '162e4ccf63274e0ca7c5c93111c5a93c', 'request_id': 'req-d78415a4-61e7-4d3b-a2dd-c104a5f01ec4'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:27.031011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d78415a4-61e7-4d3b-a2dd-c104a5f01ec4 admin admin] The token cache is being invalidate because project 162e4ccf63274e0ca7c5c93111c5a93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:27.031602 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d78415a4-61e7-4d3b-a2dd-c104a5f01ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:27.032557 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d78415a4-61e7-4d3b-a2dd-c104a5f01ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:27.034925 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 913/1817] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:26 2022] DELETE /identity/v3/projects/162e4ccf63274e0ca7c5c93111c5a93c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:27.040434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63894e5d-8bfd-4157-937f-a38a9ec72e80 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:27.040806 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63894e5d-8bfd-4157-937f-a38a9ec72e80 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:27.041153 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63894e5d-8bfd-4157-937f-a38a9ec72e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:27.080690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-63894e5d-8bfd-4157-937f-a38a9ec72e80 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:27.082623 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-63894e5d-8bfd-4157-937f-a38a9ec72e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:27.143447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78415a4-61e7-4d3b-a2dd-c104a5f01ec4 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:27.144860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d78415a4-61e7-4d3b-a2dd-c104a5f01ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:27.188593 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 905/1818] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:27.196320 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2578a3-033e-4ea5-8ca7-5f86b48adc6b None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:27.196671 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2578a3-033e-4ea5-8ca7-5f86b48adc6b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:27.196952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2578a3-033e-4ea5-8ca7-5f86b48adc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:27.233517 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-9e2578a3-033e-4ea5-8ca7-5f86b48adc6b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:27.234797 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9e2578a3-033e-4ea5-8ca7-5f86b48adc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:27.244723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 906/1819] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:54:27.249244 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2578a3-033e-4ea5-8ca7-5f86b48adc6b None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:27.260446 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2578a3-033e-4ea5-8ca7-5f86b48adc6b None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:27.265952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e0ea0-f774-4802-8ac1-e23ab069ae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:27.266592 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e0ea0-f774-4802-8ac1-e23ab069ae84 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:27.267552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e0ea0-f774-4802-8ac1-e23ab069ae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:27.267854 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e0ea0-f774-4802-8ac1-e23ab069ae84 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:27.269517 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e0ea0-f774-4802-8ac1-e23ab069ae84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:54:27.269886 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e0ea0-f774-4802-8ac1-e23ab069ae84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:27.271584 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e0ea0-f774-4802-8ac1-e23ab069ae84 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:27.291289 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 907/1820] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:54:27.292225 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e0ea0-f774-4802-8ac1-e23ab069ae84 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:27.309742 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e0ea0-f774-4802-8ac1-e23ab069ae84 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:27.315481 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78415a4-61e7-4d3b-a2dd-c104a5f01ec4 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:27.315801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ef4f0-8486-451f-92ad-732dfbf21d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:27.316494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ef4f0-8486-451f-92ad-732dfbf21d2f admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:27.316788 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ef4f0-8486-451f-92ad-732dfbf21d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:27.317203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ef4f0-8486-451f-92ad-732dfbf21d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:27.318074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ef4f0-8486-451f-92ad-732dfbf21d2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:27.320368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ef4f0-8486-451f-92ad-732dfbf21d2f admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:27.331563 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b929e48-b54b-4acd-b1ec-ff1e34e51ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:27.332479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b929e48-b54b-4acd-b1ec-ff1e34e51ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:27.332802 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b929e48-b54b-4acd-b1ec-ff1e34e51ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:27.333081 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b929e48-b54b-4acd-b1ec-ff1e34e51ac4 admin admin] PATH_INFO: `/v3/projects/fedf6f31296346a88e07c59c4b78b2b5` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:27.334960 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b929e48-b54b-4acd-b1ec-ff1e34e51ac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fedf6f31296346a88e07c59c4b78b2b5)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:27.336889 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b929e48-b54b-4acd-b1ec-ff1e34e51ac4 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:27.364988 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 908/1821] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:27 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:27.366224 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ef4f0-8486-451f-92ad-732dfbf21d2f admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:27.418703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0b929e48-b54b-4acd-b1ec-ff1e34e51ac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fedf6f31296346a88e07c59c4b78b2b5', 'request_id': 'req-0b929e48-b54b-4acd-b1ec-ff1e34e51ac4'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:27.428248 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0b929e48-b54b-4acd-b1ec-ff1e34e51ac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fedf6f31296346a88e07c59c4b78b2b5', 'request_id': 'req-0b929e48-b54b-4acd-b1ec-ff1e34e51ac4'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:27.439358 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0b929e48-b54b-4acd-b1ec-ff1e34e51ac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fedf6f31296346a88e07c59c4b78b2b5', 'request_id': 'req-0b929e48-b54b-4acd-b1ec-ff1e34e51ac4'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:27.456760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ef4f0-8486-451f-92ad-732dfbf21d2f admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:27.457219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0b929e48-b54b-4acd-b1ec-ff1e34e51ac4 admin admin] The token cache is being invalidate because project fedf6f31296346a88e07c59c4b78b2b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:27.457219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0b929e48-b54b-4acd-b1ec-ff1e34e51ac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:27.457836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0b929e48-b54b-4acd-b1ec-ff1e34e51ac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:27.460310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 914/1822] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:27 2022] DELETE /identity/v3/projects/fedf6f31296346a88e07c59c4b78b2b5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:27.463858 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b929e48-b54b-4acd-b1ec-ff1e34e51ac4 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:27.465176 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0b929e48-b54b-4acd-b1ec-ff1e34e51ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:27.494050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:27.525067 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:27.534945 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fdadd-7c19-4d27-a5ab-e3dd17bf3dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:27.536224 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fdadd-7c19-4d27-a5ab-e3dd17bf3dcf admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:27.537193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fdadd-7c19-4d27-a5ab-e3dd17bf3dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:27.537836 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fdadd-7c19-4d27-a5ab-e3dd17bf3dcf admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:27.538646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fdadd-7c19-4d27-a5ab-e3dd17bf3dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:27.540996 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fdadd-7c19-4d27-a5ab-e3dd17bf3dcf admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:27.552987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b929e48-b54b-4acd-b1ec-ff1e34e51ac4 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:27.558839 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9b80c-c9f8-4e5f-bcba-df33825ac5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:27.559730 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9b80c-c9f8-4e5f-bcba-df33825ac5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:27.560017 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9b80c-c9f8-4e5f-bcba-df33825ac5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:27.560299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9b80c-c9f8-4e5f-bcba-df33825ac5bd admin admin] PATH_INFO: `/v3/users/aacf64d5f19f4f32aacdacd097d7b7c6` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:27.563656 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9b80c-c9f8-4e5f-bcba-df33825ac5bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=aacf64d5f19f4f32aacdacd097d7b7c6)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:27.564787 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 909/1823] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:27 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:27.566237 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9b80c-c9f8-4e5f-bcba-df33825ac5bd admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:27.569703 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fdadd-7c19-4d27-a5ab-e3dd17bf3dcf admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:27.573251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-df4fdadd-7c19-4d27-a5ab-e3dd17bf3dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:27.588176 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fdadd-7c19-4d27-a5ab-e3dd17bf3dcf admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:27.595715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffb496-8632-4c24-a51f-433658525ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:27.596822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffb496-8632-4c24-a51f-433658525ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:27.597061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffb496-8632-4c24-a51f-433658525ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:27.597375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffb496-8632-4c24-a51f-433658525ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:27.598348 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffb496-8632-4c24-a51f-433658525ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:27.599970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffb496-8632-4c24-a51f-433658525ac2 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:27.615938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 910/1824] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:27.617355 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffb496-8632-4c24-a51f-433658525ac2 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:27.629260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffb496-8632-4c24-a51f-433658525ac2 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:27.632660 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-04e9b80c-c9f8-4e5f-bcba-df33825ac5bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aacf64d5f19f4f32aacdacd097d7b7c6'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:27.633420 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-04e9b80c-c9f8-4e5f-bcba-df33825ac5bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aacf64d5f19f4f32aacdacd097d7b7c6'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:27.634030 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-04e9b80c-c9f8-4e5f-bcba-df33825ac5bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aacf64d5f19f4f32aacdacd097d7b7c6'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:27.636117 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2bb04-6133-44a9-98f6-26f82c5e92e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:27.636785 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2bb04-6133-44a9-98f6-26f82c5e92e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:27.637230 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2bb04-6133-44a9-98f6-26f82c5e92e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:27.637500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2bb04-6133-44a9-98f6-26f82c5e92e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:27.639091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2bb04-6133-44a9-98f6-26f82c5e92e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:27.640876 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2bb04-6133-44a9-98f6-26f82c5e92e0 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:27.641690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-04e9b80c-c9f8-4e5f-bcba-df33825ac5bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aacf64d5f19f4f32aacdacd097d7b7c6'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:27.650124 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-04e9b80c-c9f8-4e5f-bcba-df33825ac5bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aacf64d5f19f4f32aacdacd097d7b7c6'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:27.657136 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 911/1825] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:27.658481 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2bb04-6133-44a9-98f6-26f82c5e92e0 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:27.662066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-32f2bb04-6133-44a9-98f6-26f82c5e92e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:27.675321 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 915/1826] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:27 2022] DELETE /identity/v3/users/aacf64d5f19f4f32aacdacd097d7b7c6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:27.690981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2bb04-6133-44a9-98f6-26f82c5e92e0 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:27.773522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c825b-c3fd-4770-8c21-9d782f16f5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:27.774545 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c825b-c3fd-4770-8c21-9d782f16f5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:27.774892 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c825b-c3fd-4770-8c21-9d782f16f5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:27.776479 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c825b-c3fd-4770-8c21-9d782f16f5a2 admin admin] PATH_INFO: `/v3/projects/b4303b3167b14562818b57cc3a6d88c2/users/4da8f6cc3a3245feaa6b0ac35c5b47d2/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:27.803688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c825b-c3fd-4770-8c21-9d782f16f5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4303b3167b14562818b57cc3a6d88c2, user_id=4da8f6cc3a3245feaa6b0ac35c5b47d2, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:27.807476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c825b-c3fd-4770-8c21-9d782f16f5a2 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:27.825330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 912/1827] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:27 2022] PUT /identity/v3/projects/b4303b3167b14562818b57cc3a6d88c2/users/4da8f6cc3a3245feaa6b0ac35c5b47d2/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:27.834011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4d82e-8c3b-4ef0-99ff-a0d81e07082e None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:27.834333 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4d82e-8c3b-4ef0-99ff-a0d81e07082e None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:27.834622 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4d82e-8c3b-4ef0-99ff-a0d81e07082e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:27.865005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-9ca4d82e-8c3b-4ef0-99ff-a0d81e07082e None None] MFA Rules not processed for user `4da8f6cc3a3245feaa6b0ac35c5b47d2`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:27.866274 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-9ca4d82e-8c3b-4ef0-99ff-a0d81e07082e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:27.942948 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 916/1828] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:27.947324 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c825b-c3fd-4770-8c21-9d782f16f5a2 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:28.016289 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c825b-c3fd-4770-8c21-9d782f16f5a2 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:28.026042 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916ecb7-df30-49d4-9fbe-a3de3cc2c8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:28.026841 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916ecb7-df30-49d4-9fbe-a3de3cc2c8af admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:28.027063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916ecb7-df30-49d4-9fbe-a3de3cc2c8af admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:28.027349 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916ecb7-df30-49d4-9fbe-a3de3cc2c8af admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:28.028059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916ecb7-df30-49d4-9fbe-a3de3cc2c8af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:28.030075 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916ecb7-df30-49d4-9fbe-a3de3cc2c8af admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:28.031627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4d82e-8c3b-4ef0-99ff-a0d81e07082e None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:28.036966 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-9ca4d82e-8c3b-4ef0-99ff-a0d81e07082e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:28.051273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4d82e-8c3b-4ef0-99ff-a0d81e07082e None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:28.058952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3eae1-e982-424d-b401-1d7d3220ff70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:28.059897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3eae1-e982-424d-b401-1d7d3220ff70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:28.060262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3eae1-e982-424d-b401-1d7d3220ff70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:28.060587 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3eae1-e982-424d-b401-1d7d3220ff70 admin admin] PATH_INFO: `/v3/projects/fbf9acc6fba4446d8d26b8702361d2d9` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:28.062385 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3eae1-e982-424d-b401-1d7d3220ff70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf9acc6fba4446d8d26b8702361d2d9)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:28.064456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3eae1-e982-424d-b401-1d7d3220ff70 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:28.069633 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 913/1829] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:27 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:28.073577 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916ecb7-df30-49d4-9fbe-a3de3cc2c8af admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:28.102295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:28.117051 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:28.127244 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6bc3eae1-e982-424d-b401-1d7d3220ff70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf9acc6fba4446d8d26b8702361d2d9', 'request_id': 'req-6bc3eae1-e982-424d-b401-1d7d3220ff70'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:28.136523 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6bc3eae1-e982-424d-b401-1d7d3220ff70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf9acc6fba4446d8d26b8702361d2d9', 'request_id': 'req-6bc3eae1-e982-424d-b401-1d7d3220ff70'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:28.145741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6bc3eae1-e982-424d-b401-1d7d3220ff70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf9acc6fba4446d8d26b8702361d2d9', 'request_id': 'req-6bc3eae1-e982-424d-b401-1d7d3220ff70'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:28.157181 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6bc3eae1-e982-424d-b401-1d7d3220ff70 admin admin] The token cache is being invalidate because project fbf9acc6fba4446d8d26b8702361d2d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:28.157559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6bc3eae1-e982-424d-b401-1d7d3220ff70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:28.158164 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6bc3eae1-e982-424d-b401-1d7d3220ff70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:28.158340 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916ecb7-df30-49d4-9fbe-a3de3cc2c8af admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:28.160339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 917/1830] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:28 2022] DELETE /identity/v3/projects/fbf9acc6fba4446d8d26b8702361d2d9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:28.166303 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a9932-21a3-4a6f-b3bd-e5003a6753db None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:28.166595 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a9932-21a3-4a6f-b3bd-e5003a6753db None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:28.166880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a9932-21a3-4a6f-b3bd-e5003a6753db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:28.184631 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-449a9932-21a3-4a6f-b3bd-e5003a6753db None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:28.185903 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-449a9932-21a3-4a6f-b3bd-e5003a6753db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:28.215686 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb0277-cb56-417d-a230-37d8dbeb3a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:28.216355 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb0277-cb56-417d-a230-37d8dbeb3a17 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:28.216637 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb0277-cb56-417d-a230-37d8dbeb3a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:28.216917 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb0277-cb56-417d-a230-37d8dbeb3a17 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:28.217631 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb0277-cb56-417d-a230-37d8dbeb3a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:28.219611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb0277-cb56-417d-a230-37d8dbeb3a17 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:28.240199 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 914/1831] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:28 2022] POST /identity/v3/users => generated 300 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:28.244713 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb0277-cb56-417d-a230-37d8dbeb3a17 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:28.246584 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-aebb0277-cb56-417d-a230-37d8dbeb3a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:28.252625 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 918/1832] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:54:28.259946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb0277-cb56-417d-a230-37d8dbeb3a17 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:28.261389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a117735-b552-4ef7-bc45-f6c655167997 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:28.261688 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a117735-b552-4ef7-bc45-f6c655167997 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:28.261974 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a117735-b552-4ef7-bc45-f6c655167997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:28.263061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56926ae-ca78-4d69-a52a-2180850ab661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:28.263709 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56926ae-ca78-4d69-a52a-2180850ab661 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:28.263986 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56926ae-ca78-4d69-a52a-2180850ab661 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:28.264254 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56926ae-ca78-4d69-a52a-2180850ab661 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:28.264966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56926ae-ca78-4d69-a52a-2180850ab661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:28.266596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56926ae-ca78-4d69-a52a-2180850ab661 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:28.280473 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 915/1833] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:28.281339 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56926ae-ca78-4d69-a52a-2180850ab661 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:28.282947 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-5a117735-b552-4ef7-bc45-f6c655167997 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:28.284793 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-5a117735-b552-4ef7-bc45-f6c655167997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:28.291965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56926ae-ca78-4d69-a52a-2180850ab661 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:28.296492 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 919/1834] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:54:28.296654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715bc04-83d9-4d3f-94ee-62a3d1bfd329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:28.297561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715bc04-83d9-4d3f-94ee-62a3d1bfd329 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:28.297842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715bc04-83d9-4d3f-94ee-62a3d1bfd329 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:28.298119 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715bc04-83d9-4d3f-94ee-62a3d1bfd329 admin admin] PATH_INFO: `/v3/projects/b0b25316618a407aba39d500ac75bc51/users/ca0ba7c325d3401c91f7aac85d32110d/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:28.300798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a117735-b552-4ef7-bc45-f6c655167997 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:28.310867 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a117735-b552-4ef7-bc45-f6c655167997 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:28.315071 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715bc04-83d9-4d3f-94ee-62a3d1bfd329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b25316618a407aba39d500ac75bc51, user_id=ca0ba7c325d3401c91f7aac85d32110d, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:28.316097 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd91546-c4b0-42c3-a36a-2d3e3bea591a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:28.316758 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd91546-c4b0-42c3-a36a-2d3e3bea591a admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:28.317045 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd91546-c4b0-42c3-a36a-2d3e3bea591a admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:28.317359 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd91546-c4b0-42c3-a36a-2d3e3bea591a admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:28.318062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715bc04-83d9-4d3f-94ee-62a3d1bfd329 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:28.318176 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd91546-c4b0-42c3-a36a-2d3e3bea591a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:54:28.318385 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd91546-c4b0-42c3-a36a-2d3e3bea591a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:28.319993 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd91546-c4b0-42c3-a36a-2d3e3bea591a admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:28.336832 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 920/1835] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:54:28.339050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd91546-c4b0-42c3-a36a-2d3e3bea591a admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:28.343281 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 916/1836] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:28 2022] PUT /identity/v3/projects/b0b25316618a407aba39d500ac75bc51/users/ca0ba7c325d3401c91f7aac85d32110d/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:28.347790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715bc04-83d9-4d3f-94ee-62a3d1bfd329 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:28.349933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd91546-c4b0-42c3-a36a-2d3e3bea591a admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:28.420429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd8537-5eb8-4003-b78e-677c01b8f483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:28.421391 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715bc04-83d9-4d3f-94ee-62a3d1bfd329 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:28.421555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd8537-5eb8-4003-b78e-677c01b8f483 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:28.422017 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd8537-5eb8-4003-b78e-677c01b8f483 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:28.422370 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd8537-5eb8-4003-b78e-677c01b8f483 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:28.423139 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd8537-5eb8-4003-b78e-677c01b8f483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:28.425145 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd8537-5eb8-4003-b78e-677c01b8f483 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:28.426239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316acbf-d5a4-47f6-a122-c6bf8240473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:28.426906 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316acbf-d5a4-47f6-a122-c6bf8240473c admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:28.427185 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316acbf-d5a4-47f6-a122-c6bf8240473c admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:28.427459 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316acbf-d5a4-47f6-a122-c6bf8240473c admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:28.428612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316acbf-d5a4-47f6-a122-c6bf8240473c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:28.429800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316acbf-d5a4-47f6-a122-c6bf8240473c admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:28.450259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 917/1837] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:28.451829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316acbf-d5a4-47f6-a122-c6bf8240473c admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:28.468889 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316acbf-d5a4-47f6-a122-c6bf8240473c admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:28.469733 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 921/1838] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:28 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:28.477645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd8537-5eb8-4003-b78e-677c01b8f483 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:28.504107 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:28.511510 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:28.552521 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd8537-5eb8-4003-b78e-677c01b8f483 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:28.557481 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ded2c-1d12-49d9-ac7c-40f4fdab6e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:28.558219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ded2c-1d12-49d9-ac7c-40f4fdab6e56 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:28.558620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ded2c-1d12-49d9-ac7c-40f4fdab6e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:28.558937 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ded2c-1d12-49d9-ac7c-40f4fdab6e56 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:28.559693 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ded2c-1d12-49d9-ac7c-40f4fdab6e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:28.561500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9662ae-88e3-4075-bff8-b98e6e47e5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:28.561798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ded2c-1d12-49d9-ac7c-40f4fdab6e56 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:28.562565 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9662ae-88e3-4075-bff8-b98e6e47e5a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:28.562860 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9662ae-88e3-4075-bff8-b98e6e47e5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:28.563239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9662ae-88e3-4075-bff8-b98e6e47e5a7 admin admin] PATH_INFO: `/v3/projects/b0b25316618a407aba39d500ac75bc51/users/ca0ba7c325d3401c91f7aac85d32110d/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:28.566278 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9662ae-88e3-4075-bff8-b98e6e47e5a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b25316618a407aba39d500ac75bc51, user_id=ca0ba7c325d3401c91f7aac85d32110d, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:28.569020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9662ae-88e3-4075-bff8-b98e6e47e5a7 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:28.584632 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 918/1839] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:28 2022] PUT /identity/v3/projects/b0b25316618a407aba39d500ac75bc51/users/ca0ba7c325d3401c91f7aac85d32110d/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:28.586216 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 922/1840] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:28 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:28.590510 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9662ae-88e3-4075-bff8-b98e6e47e5a7 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:28.596249 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088ce43-7ed4-47a5-b1ff-1b5072d30d43 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:28.596778 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088ce43-7ed4-47a5-b1ff-1b5072d30d43 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:28.597057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088ce43-7ed4-47a5-b1ff-1b5072d30d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:28.629243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-6088ce43-7ed4-47a5-b1ff-1b5072d30d43 None None] MFA Rules not processed for user `ca0ba7c325d3401c91f7aac85d32110d`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:28.630834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-6088ce43-7ed4-47a5-b1ff-1b5072d30d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:28.673817 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9662ae-88e3-4075-bff8-b98e6e47e5a7 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:28.679939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d52540-2502-4109-8a00-88f0a3594188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:28.679939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d52540-2502-4109-8a00-88f0a3594188 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:28.679939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d52540-2502-4109-8a00-88f0a3594188 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:28.679939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d52540-2502-4109-8a00-88f0a3594188 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:28.680368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d52540-2502-4109-8a00-88f0a3594188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:28.681287 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d52540-2502-4109-8a00-88f0a3594188 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:28.695924 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 919/1841] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:28.701562 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d52540-2502-4109-8a00-88f0a3594188 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:28.715649 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d52540-2502-4109-8a00-88f0a3594188 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:28.721438 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3c11a-faac-4938-b2ba-8e332707eea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:28.722106 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3c11a-faac-4938-b2ba-8e332707eea2 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:28.722384 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3c11a-faac-4938-b2ba-8e332707eea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:28.722658 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3c11a-faac-4938-b2ba-8e332707eea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:28.723377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3c11a-faac-4938-b2ba-8e332707eea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:28.724991 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3c11a-faac-4938-b2ba-8e332707eea2 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:28.731504 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 923/1842] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:28.735924 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 920/1843] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:28.742317 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088ce43-7ed4-47a5-b1ff-1b5072d30d43 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:28.747327 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3c11a-faac-4938-b2ba-8e332707eea2 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:28.749527 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-5fb3c11a-faac-4938-b2ba-8e332707eea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:28.754206 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088ce43-7ed4-47a5-b1ff-1b5072d30d43 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:28.759330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68620e36-4333-455b-b5e6-7b9c40fd4f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:28.760220 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68620e36-4333-455b-b5e6-7b9c40fd4f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:28.760506 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68620e36-4333-455b-b5e6-7b9c40fd4f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:28.761171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68620e36-4333-455b-b5e6-7b9c40fd4f59 admin admin] PATH_INFO: `/v3/projects/5d90bf2a2507429f83a6549147f36e10/users/131c3dca393f4ad98380dbbd8f566265/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:28.779282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68620e36-4333-455b-b5e6-7b9c40fd4f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d90bf2a2507429f83a6549147f36e10, user_id=131c3dca393f4ad98380dbbd8f566265, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:28.782187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68620e36-4333-455b-b5e6-7b9c40fd4f59 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:28.807165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 924/1844] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:28 2022] PUT /identity/v3/projects/5d90bf2a2507429f83a6549147f36e10/users/131c3dca393f4ad98380dbbd8f566265/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:28.822237 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0843e-86f0-4d05-88c3-9c0037c77168 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:28.822532 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0843e-86f0-4d05-88c3-9c0037c77168 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:28.822953 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0843e-86f0-4d05-88c3-9c0037c77168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:28.825430 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3c11a-faac-4938-b2ba-8e332707eea2 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:28.850283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-5fe0843e-86f0-4d05-88c3-9c0037c77168 None None] MFA Rules not processed for user `131c3dca393f4ad98380dbbd8f566265`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:28.851490 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-5fe0843e-86f0-4d05-88c3-9c0037c77168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:28.894071 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9539b-7892-403f-8963-dc34e4de8e1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:28.894725 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9539b-7892-403f-8963-dc34e4de8e1a service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:28.895007 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9539b-7892-403f-8963-dc34e4de8e1a service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:28.895281 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9539b-7892-403f-8963-dc34e4de8e1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:28.913819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:28.937643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 925/1845] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:54:28.943090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0843e-86f0-4d05-88c3-9c0037c77168 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:28.948614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:28.965888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9539b-7892-403f-8963-dc34e4de8e1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:28.969412 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9539b-7892-403f-8963-dc34e4de8e1a service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:28.985337 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 921/1846] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:54:29.035124 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0843e-86f0-4d05-88c3-9c0037c77168 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:29.043749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b6447-cb87-4df0-80a3-4f61c8c21608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:29.044782 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b6447-cb87-4df0-80a3-4f61c8c21608 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:29.045458 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b6447-cb87-4df0-80a3-4f61c8c21608 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:29.046075 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b6447-cb87-4df0-80a3-4f61c8c21608 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:29.047117 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b6447-cb87-4df0-80a3-4f61c8c21608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:29.052011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b6447-cb87-4df0-80a3-4f61c8c21608 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:29.121781 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 926/1847] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:28 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:29.123722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9539b-7892-403f-8963-dc34e4de8e1a service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:29.151060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9539b-7892-403f-8963-dc34e4de8e1a service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:29.227307 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727f9d0-8969-4772-af3a-7add0a4af695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:29.228152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727f9d0-8969-4772-af3a-7add0a4af695 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:29.228438 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727f9d0-8969-4772-af3a-7add0a4af695 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:29.228816 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727f9d0-8969-4772-af3a-7add0a4af695 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:29.229561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727f9d0-8969-4772-af3a-7add0a4af695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:29.231548 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727f9d0-8969-4772-af3a-7add0a4af695 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:29.253337 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 922/1848] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:29 2022] POST /identity/v3/users => generated 298 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:29.257805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b6447-cb87-4df0-80a3-4f61c8c21608 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:29.271594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b6447-cb87-4df0-80a3-4f61c8c21608 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:29.277457 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f1f50-3072-403f-9121-7d4f78f4f0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:29.278134 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f1f50-3072-403f-9121-7d4f78f4f0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:29.278414 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f1f50-3072-403f-9121-7d4f78f4f0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:29.278779 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f1f50-3072-403f-9121-7d4f78f4f0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:29.279392 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f1f50-3072-403f-9121-7d4f78f4f0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:29.280955 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f1f50-3072-403f-9121-7d4f78f4f0b4 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:29.302684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 927/1849] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:29.302792 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727f9d0-8969-4772-af3a-7add0a4af695 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:29.308897 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727f9d0-8969-4772-af3a-7add0a4af695 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:29.313660 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711fb6b-34ad-4c2d-88a7-3344256b24a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:29.314597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711fb6b-34ad-4c2d-88a7-3344256b24a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:29.314906 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711fb6b-34ad-4c2d-88a7-3344256b24a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:29.315186 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711fb6b-34ad-4c2d-88a7-3344256b24a1 admin admin] PATH_INFO: `/v3/projects/2a8406c839c84e648324a8b61fc02c0c/users/0c3da193555040b2994b6f9dd7e68739/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:29.330751 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711fb6b-34ad-4c2d-88a7-3344256b24a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a8406c839c84e648324a8b61fc02c0c, user_id=0c3da193555040b2994b6f9dd7e68739, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:29.333396 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711fb6b-34ad-4c2d-88a7-3344256b24a1 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:29.347703 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 923/1850] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:29 2022] PUT /identity/v3/projects/2a8406c839c84e648324a8b61fc02c0c/users/0c3da193555040b2994b6f9dd7e68739/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:29.351768 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f1f50-3072-403f-9121-7d4f78f4f0b4 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:29.362795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f1f50-3072-403f-9121-7d4f78f4f0b4 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:29.420395 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd357a68-c5f5-48d7-a640-155ff4acc91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:29.421089 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd357a68-c5f5-48d7-a640-155ff4acc91a admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:29.421700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd357a68-c5f5-48d7-a640-155ff4acc91a admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:29.421700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd357a68-c5f5-48d7-a640-155ff4acc91a admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:29.422408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd357a68-c5f5-48d7-a640-155ff4acc91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:29.423976 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd357a68-c5f5-48d7-a640-155ff4acc91a admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:29.434629 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 928/1851] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:29.438647 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711fb6b-34ad-4c2d-88a7-3344256b24a1 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:29.448928 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711fb6b-34ad-4c2d-88a7-3344256b24a1 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:29.454472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d005ca-6138-4e87-b187-e770144a87f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:29.455361 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d005ca-6138-4e87-b187-e770144a87f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:29.455675 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d005ca-6138-4e87-b187-e770144a87f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:29.455947 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d005ca-6138-4e87-b187-e770144a87f4 admin admin] PATH_INFO: `/v3/projects/2a8406c839c84e648324a8b61fc02c0c/users/0c3da193555040b2994b6f9dd7e68739/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:29.458227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d005ca-6138-4e87-b187-e770144a87f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a8406c839c84e648324a8b61fc02c0c, user_id=0c3da193555040b2994b6f9dd7e68739, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:29.460841 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d005ca-6138-4e87-b187-e770144a87f4 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:29.472478 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 924/1852] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:29 2022] PUT /identity/v3/projects/2a8406c839c84e648324a8b61fc02c0c/users/0c3da193555040b2994b6f9dd7e68739/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:29.482724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ffb13-39df-4106-9e10-8065509e74ec None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:29.483012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ffb13-39df-4106-9e10-8065509e74ec None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:29.483348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ffb13-39df-4106-9e10-8065509e74ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:29.514601 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-b85ffb13-39df-4106-9e10-8065509e74ec None None] MFA Rules not processed for user `0c3da193555040b2994b6f9dd7e68739`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:29.515956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-b85ffb13-39df-4106-9e10-8065509e74ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:29.586664 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:29.597676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 929/1853] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:29.607097 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d005ca-6138-4e87-b187-e770144a87f4 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:29.613882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ffb13-39df-4106-9e10-8065509e74ec None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:29.666716 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d005ca-6138-4e87-b187-e770144a87f4 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:29.670447 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8a4c9-8cca-40f6-9a65-fc1325517d42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:29.671091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8a4c9-8cca-40f6-9a65-fc1325517d42 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:29.671370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8a4c9-8cca-40f6-9a65-fc1325517d42 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:29.671641 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8a4c9-8cca-40f6-9a65-fc1325517d42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:29.691399 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:29.701691 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ffb13-39df-4106-9e10-8065509e74ec None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:29.727245 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cac88-ce75-4c82-a127-a79099647e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:29.728262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cac88-ce75-4c82-a127-a79099647e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:29.728681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cac88-ce75-4c82-a127-a79099647e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:29.728977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cac88-ce75-4c82-a127-a79099647e0b admin admin] PATH_INFO: `/v3/users/4da8f6cc3a3245feaa6b0ac35c5b47d2` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:29.730574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cac88-ce75-4c82-a127-a79099647e0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4da8f6cc3a3245feaa6b0ac35c5b47d2)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:29.732688 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cac88-ce75-4c82-a127-a79099647e0b admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:29.762681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8a4c9-8cca-40f6-9a65-fc1325517d42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:29.766180 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8a4c9-8cca-40f6-9a65-fc1325517d42 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:29.793929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 925/1854] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:54:29.820150 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6a6cac88-ce75-4c82-a127-a79099647e0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4da8f6cc3a3245feaa6b0ac35c5b47d2'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:29.820873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6a6cac88-ce75-4c82-a127-a79099647e0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4da8f6cc3a3245feaa6b0ac35c5b47d2'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:29.821535 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6a6cac88-ce75-4c82-a127-a79099647e0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4da8f6cc3a3245feaa6b0ac35c5b47d2'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:29.832235 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6a6cac88-ce75-4c82-a127-a79099647e0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4da8f6cc3a3245feaa6b0ac35c5b47d2'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:29.864139 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6a6cac88-ce75-4c82-a127-a79099647e0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4da8f6cc3a3245feaa6b0ac35c5b47d2'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:29.893727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 930/1855] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:29 2022] DELETE /identity/v3/users/4da8f6cc3a3245feaa6b0ac35c5b47d2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:29.898665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268e759-4ae6-4b5c-97ae-999d36d8d1a5 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:29.899202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268e759-4ae6-4b5c-97ae-999d36d8d1a5 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:29.899632 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268e759-4ae6-4b5c-97ae-999d36d8d1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:29.919768 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-f268e759-4ae6-4b5c-97ae-999d36d8d1a5 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:29.921363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f268e759-4ae6-4b5c-97ae-999d36d8d1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:30.008605 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 926/1856] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:30.019541 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cac88-ce75-4c82-a127-a79099647e0b admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:30.021194 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-6a6cac88-ce75-4c82-a127-a79099647e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:30.107428 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cac88-ce75-4c82-a127-a79099647e0b admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:30.112488 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3100b2-45da-4456-b3ae-7530844ebfd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:30.113288 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3100b2-45da-4456-b3ae-7530844ebfd3 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:30.113660 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3100b2-45da-4456-b3ae-7530844ebfd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:30.113933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3100b2-45da-4456-b3ae-7530844ebfd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:30.126720 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3100b2-45da-4456-b3ae-7530844ebfd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:30.129451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3100b2-45da-4456-b3ae-7530844ebfd3 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:30.145117 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 931/1857] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:30.465604 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268e759-4ae6-4b5c-97ae-999d36d8d1a5 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:30.467350 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f268e759-4ae6-4b5c-97ae-999d36d8d1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:30.481405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268e759-4ae6-4b5c-97ae-999d36d8d1a5 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:30.486332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cd088-02ca-4b06-ad74-c410c9686fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:30.487765 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd088-02ca-4b06-ad74-c410c9686fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:30.488046 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd088-02ca-4b06-ad74-c410c9686fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:30.488323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd088-02ca-4b06-ad74-c410c9686fa5 admin admin] PATH_INFO: `/v3/projects/b4303b3167b14562818b57cc3a6d88c2` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:30.489552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cd088-02ca-4b06-ad74-c410c9686fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4303b3167b14562818b57cc3a6d88c2)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:30.491475 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cd088-02ca-4b06-ad74-c410c9686fa5 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:30.541293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-aa7cd088-02ca-4b06-ad74-c410c9686fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4303b3167b14562818b57cc3a6d88c2', 'request_id': 'req-aa7cd088-02ca-4b06-ad74-c410c9686fa5'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:30.547571 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-aa7cd088-02ca-4b06-ad74-c410c9686fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4303b3167b14562818b57cc3a6d88c2', 'request_id': 'req-aa7cd088-02ca-4b06-ad74-c410c9686fa5'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:30.553829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-aa7cd088-02ca-4b06-ad74-c410c9686fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4303b3167b14562818b57cc3a6d88c2', 'request_id': 'req-aa7cd088-02ca-4b06-ad74-c410c9686fa5'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:30.566329 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-aa7cd088-02ca-4b06-ad74-c410c9686fa5 admin admin] The token cache is being invalidate because project b4303b3167b14562818b57cc3a6d88c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:30.566624 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-aa7cd088-02ca-4b06-ad74-c410c9686fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:30.567243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-aa7cd088-02ca-4b06-ad74-c410c9686fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:30.568775 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 927/1858] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:30 2022] DELETE /identity/v3/projects/b4303b3167b14562818b57cc3a6d88c2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:30.572683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3100b2-45da-4456-b3ae-7530844ebfd3 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:30.582693 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3100b2-45da-4456-b3ae-7530844ebfd3 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:30.599002 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:30.640235 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243e60f-7d20-4e14-bf9c-ad4f35427916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:30.641097 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243e60f-7d20-4e14-bf9c-ad4f35427916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:30.641410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243e60f-7d20-4e14-bf9c-ad4f35427916 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:30.641685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243e60f-7d20-4e14-bf9c-ad4f35427916 admin admin] PATH_INFO: `/v3/users/ca0ba7c325d3401c91f7aac85d32110d` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:30.642850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243e60f-7d20-4e14-bf9c-ad4f35427916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca0ba7c325d3401c91f7aac85d32110d)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:30.645319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243e60f-7d20-4e14-bf9c-ad4f35427916 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:30.695407 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-4243e60f-7d20-4e14-bf9c-ad4f35427916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca0ba7c325d3401c91f7aac85d32110d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:30.696044 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-4243e60f-7d20-4e14-bf9c-ad4f35427916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca0ba7c325d3401c91f7aac85d32110d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:30.696635 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-4243e60f-7d20-4e14-bf9c-ad4f35427916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca0ba7c325d3401c91f7aac85d32110d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:30.703791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-4243e60f-7d20-4e14-bf9c-ad4f35427916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca0ba7c325d3401c91f7aac85d32110d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:30.715050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-4243e60f-7d20-4e14-bf9c-ad4f35427916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca0ba7c325d3401c91f7aac85d32110d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:30.733646 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 932/1859] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:30 2022] DELETE /identity/v3/users/ca0ba7c325d3401c91f7aac85d32110d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:31.000342 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cd088-02ca-4b06-ad74-c410c9686fa5 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:31.001820 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-aa7cd088-02ca-4b06-ad74-c410c9686fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:31.016676 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cd088-02ca-4b06-ad74-c410c9686fa5 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:31.060244 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:31.078979 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a90a1-f82d-44cd-9822-dd03a64afd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:31.079840 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a90a1-f82d-44cd-9822-dd03a64afd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:31.080179 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a90a1-f82d-44cd-9822-dd03a64afd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:31.081012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a90a1-f82d-44cd-9822-dd03a64afd30 admin admin] PATH_INFO: `/v3/projects/b0b25316618a407aba39d500ac75bc51` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:31.082198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a90a1-f82d-44cd-9822-dd03a64afd30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0b25316618a407aba39d500ac75bc51)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:31.084131 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a90a1-f82d-44cd-9822-dd03a64afd30 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:31.139162 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6a8a90a1-f82d-44cd-9822-dd03a64afd30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0b25316618a407aba39d500ac75bc51', 'request_id': 'req-6a8a90a1-f82d-44cd-9822-dd03a64afd30'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:31.146299 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6a8a90a1-f82d-44cd-9822-dd03a64afd30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0b25316618a407aba39d500ac75bc51', 'request_id': 'req-6a8a90a1-f82d-44cd-9822-dd03a64afd30'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:31.152218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6a8a90a1-f82d-44cd-9822-dd03a64afd30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0b25316618a407aba39d500ac75bc51', 'request_id': 'req-6a8a90a1-f82d-44cd-9822-dd03a64afd30'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:31.167767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6a8a90a1-f82d-44cd-9822-dd03a64afd30 admin admin] The token cache is being invalidate because project b0b25316618a407aba39d500ac75bc51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:31.168060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6a8a90a1-f82d-44cd-9822-dd03a64afd30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:31.168699 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6a8a90a1-f82d-44cd-9822-dd03a64afd30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:31.170525 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 928/1860] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:30 2022] DELETE /identity/v3/projects/b0b25316618a407aba39d500ac75bc51 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:31.175535 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3e949-8551-449f-842f-80f0a750df11 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:31.175827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3e949-8551-449f-842f-80f0a750df11 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:31.176135 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3e949-8551-449f-842f-80f0a750df11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:31.193789 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-f7e3e949-8551-449f-842f-80f0a750df11 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:31.195066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-f7e3e949-8551-449f-842f-80f0a750df11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:31.256826 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 933/1861] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:31.264580 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92339b-3166-43a3-92ba-9da2974d0cdd None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:31.264868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92339b-3166-43a3-92ba-9da2974d0cdd None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:31.265147 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92339b-3166-43a3-92ba-9da2974d0cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:31.285239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-fb92339b-3166-43a3-92ba-9da2974d0cdd None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:31.286522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-fb92339b-3166-43a3-92ba-9da2974d0cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:31.296823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 929/1862] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:31.301002 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3e949-8551-449f-842f-80f0a750df11 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:31.312213 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3e949-8551-449f-842f-80f0a750df11 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:31.317889 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27d0e5-0c15-4681-97c7-7654e2c32911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:31.319988 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27d0e5-0c15-4681-97c7-7654e2c32911 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:31.319988 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27d0e5-0c15-4681-97c7-7654e2c32911 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:31.319988 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27d0e5-0c15-4681-97c7-7654e2c32911 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:31.320584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27d0e5-0c15-4681-97c7-7654e2c32911 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:54:31.320997 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27d0e5-0c15-4681-97c7-7654e2c32911 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:31.322724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27d0e5-0c15-4681-97c7-7654e2c32911 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:31.338223 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 934/1863] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:54:31.342887 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92339b-3166-43a3-92ba-9da2974d0cdd None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:31.355313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92339b-3166-43a3-92ba-9da2974d0cdd None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:31.380523 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5e3e8-ca20-49eb-862d-e0c2e453bf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:31.381327 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5e3e8-ca20-49eb-862d-e0c2e453bf5e admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:31.381679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5e3e8-ca20-49eb-862d-e0c2e453bf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:31.382026 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5e3e8-ca20-49eb-862d-e0c2e453bf5e admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:31.382794 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5e3e8-ca20-49eb-862d-e0c2e453bf5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:31.384906 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5e3e8-ca20-49eb-862d-e0c2e453bf5e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:31.426885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 930/1864] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:31 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:31.432540 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27d0e5-0c15-4681-97c7-7654e2c32911 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:31.447459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27d0e5-0c15-4681-97c7-7654e2c32911 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:31.489719 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:31.547492 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a06f1f-8ab8-4df6-a50b-5c496dd87771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:31.548332 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a06f1f-8ab8-4df6-a50b-5c496dd87771 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:31.548867 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a06f1f-8ab8-4df6-a50b-5c496dd87771 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:31.549306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a06f1f-8ab8-4df6-a50b-5c496dd87771 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:31.551471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a06f1f-8ab8-4df6-a50b-5c496dd87771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:31.554349 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a06f1f-8ab8-4df6-a50b-5c496dd87771 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:31.584618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 935/1865] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:31 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:31.589249 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5e3e8-ca20-49eb-862d-e0c2e453bf5e admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:31.602642 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5e3e8-ca20-49eb-862d-e0c2e453bf5e admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:31.608682 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02370bb7-e1f4-4454-a5f1-6a24bc4d71ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:31.609635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02370bb7-e1f4-4454-a5f1-6a24bc4d71ca admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:31.610039 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02370bb7-e1f4-4454-a5f1-6a24bc4d71ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:31.610530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02370bb7-e1f4-4454-a5f1-6a24bc4d71ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:31.611436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02370bb7-e1f4-4454-a5f1-6a24bc4d71ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:31.613442 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02370bb7-e1f4-4454-a5f1-6a24bc4d71ca admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:31.626872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 931/1866] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:31.632050 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a06f1f-8ab8-4df6-a50b-5c496dd87771 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:31.644567 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a06f1f-8ab8-4df6-a50b-5c496dd87771 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:31.666179 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de82b0-06b4-45de-92fe-68d66b5b1925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:31.667898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de82b0-06b4-45de-92fe-68d66b5b1925 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:31.668862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de82b0-06b4-45de-92fe-68d66b5b1925 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:31.669518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de82b0-06b4-45de-92fe-68d66b5b1925 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:31.670309 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de82b0-06b4-45de-92fe-68d66b5b1925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:31.682469 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de82b0-06b4-45de-92fe-68d66b5b1925 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:31.700309 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 936/1867] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:31.701094 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02370bb7-e1f4-4454-a5f1-6a24bc4d71ca admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:31.712904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02370bb7-e1f4-4454-a5f1-6a24bc4d71ca admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:31.718261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69126f-d2fc-4c83-a36d-0323ecba21c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:31.719150 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69126f-d2fc-4c83-a36d-0323ecba21c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:31.719594 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69126f-d2fc-4c83-a36d-0323ecba21c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:31.719907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69126f-d2fc-4c83-a36d-0323ecba21c6 admin admin] PATH_INFO: `/v3/projects/a65025d736274bb1993d8f0f341ebab5/users/be76f1683ea340ef92fccd3d35172a04/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:31.737673 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69126f-d2fc-4c83-a36d-0323ecba21c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65025d736274bb1993d8f0f341ebab5, user_id=be76f1683ea340ef92fccd3d35172a04, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:31.741851 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69126f-d2fc-4c83-a36d-0323ecba21c6 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:31.772437 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 932/1868] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:31 2022] PUT /identity/v3/projects/a65025d736274bb1993d8f0f341ebab5/users/be76f1683ea340ef92fccd3d35172a04/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:31.772691 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3db4cd-6db9-4f07-b380-3c9d92bb615a None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:31.773019 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3db4cd-6db9-4f07-b380-3c9d92bb615a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:31.773399 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3db4cd-6db9-4f07-b380-3c9d92bb615a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:31.828881 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-dd3db4cd-6db9-4f07-b380-3c9d92bb615a None None] MFA Rules not processed for user `be76f1683ea340ef92fccd3d35172a04`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:31.830267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-dd3db4cd-6db9-4f07-b380-3c9d92bb615a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:31.903628 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 937/1869] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:31.904559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69126f-d2fc-4c83-a36d-0323ecba21c6 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:31.967046 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69126f-d2fc-4c83-a36d-0323ecba21c6 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:31.972224 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daee6c7-da67-4d38-bbc5-99285b8508d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:31.972879 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daee6c7-da67-4d38-bbc5-99285b8508d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:31.973476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daee6c7-da67-4d38-bbc5-99285b8508d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:31.973758 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daee6c7-da67-4d38-bbc5-99285b8508d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:31.974443 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daee6c7-da67-4d38-bbc5-99285b8508d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:31.976350 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daee6c7-da67-4d38-bbc5-99285b8508d1 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:31.989796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:32.003627 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 933/1870] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:31 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:32.007684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3db4cd-6db9-4f07-b380-3c9d92bb615a None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:32.018877 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3db4cd-6db9-4f07-b380-3c9d92bb615a None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:32.079257 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe22984-a053-4782-9aa6-b0e05f792250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:32.079945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe22984-a053-4782-9aa6-b0e05f792250 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:32.080230 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe22984-a053-4782-9aa6-b0e05f792250 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:32.081011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe22984-a053-4782-9aa6-b0e05f792250 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:32.081775 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe22984-a053-4782-9aa6-b0e05f792250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:32.083694 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe22984-a053-4782-9aa6-b0e05f792250 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:32.105898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 938/1871] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:32 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:32.110606 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daee6c7-da67-4d38-bbc5-99285b8508d1 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:32.122978 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daee6c7-da67-4d38-bbc5-99285b8508d1 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:32.129301 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee6c3c-2e9e-4040-a663-fa0b63974767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:32.130092 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee6c3c-2e9e-4040-a663-fa0b63974767 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:32.130383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee6c3c-2e9e-4040-a663-fa0b63974767 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:32.130659 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee6c3c-2e9e-4040-a663-fa0b63974767 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:32.131408 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee6c3c-2e9e-4040-a663-fa0b63974767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:32.133003 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee6c3c-2e9e-4040-a663-fa0b63974767 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:32.146890 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 934/1872] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:32.151663 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe22984-a053-4782-9aa6-b0e05f792250 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:32.162767 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe22984-a053-4782-9aa6-b0e05f792250 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:32.168361 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5ad0c-d62c-4772-9cf0-a0c5d3f54a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:32.169410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5ad0c-d62c-4772-9cf0-a0c5d3f54a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:32.169696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5ad0c-d62c-4772-9cf0-a0c5d3f54a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:32.169976 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5ad0c-d62c-4772-9cf0-a0c5d3f54a79 admin admin] PATH_INFO: `/v3/projects/0141db41298547568af533d8bce47060/users/c6e48f6b7a4e4a528da8f5e28049de77/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:32.186015 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5ad0c-d62c-4772-9cf0-a0c5d3f54a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0141db41298547568af533d8bce47060, user_id=c6e48f6b7a4e4a528da8f5e28049de77, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:32.188648 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5ad0c-d62c-4772-9cf0-a0c5d3f54a79 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:32.199641 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:32.204881 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 939/1873] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:32 2022] PUT /identity/v3/projects/0141db41298547568af533d8bce47060/users/c6e48f6b7a4e4a528da8f5e28049de77/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:32.209395 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee6c3c-2e9e-4040-a663-fa0b63974767 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:32.220409 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee6c3c-2e9e-4040-a663-fa0b63974767 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:32.278968 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953614bd-7e43-46b7-8256-29cc923fc970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:32.279641 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953614bd-7e43-46b7-8256-29cc923fc970 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:32.279925 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953614bd-7e43-46b7-8256-29cc923fc970 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:32.280202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953614bd-7e43-46b7-8256-29cc923fc970 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:32.280951 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953614bd-7e43-46b7-8256-29cc923fc970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:32.282571 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953614bd-7e43-46b7-8256-29cc923fc970 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:32.292877 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 935/1874] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:32.296791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5ad0c-d62c-4772-9cf0-a0c5d3f54a79 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:32.310665 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5ad0c-d62c-4772-9cf0-a0c5d3f54a79 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:32.316520 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbb469-81cb-4da9-af1f-22ec4f7bff69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:32.317476 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbb469-81cb-4da9-af1f-22ec4f7bff69 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:32.317753 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbb469-81cb-4da9-af1f-22ec4f7bff69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:32.318035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbb469-81cb-4da9-af1f-22ec4f7bff69 admin admin] PATH_INFO: `/v3/projects/0141db41298547568af533d8bce47060/users/c6e48f6b7a4e4a528da8f5e28049de77/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:32.320196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbb469-81cb-4da9-af1f-22ec4f7bff69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0141db41298547568af533d8bce47060, user_id=c6e48f6b7a4e4a528da8f5e28049de77, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:32.322844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbb469-81cb-4da9-af1f-22ec4f7bff69 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:32.334863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 940/1875] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:32 2022] PUT /identity/v3/projects/0141db41298547568af533d8bce47060/users/c6e48f6b7a4e4a528da8f5e28049de77/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:32.344722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c8470-8a22-4b42-8148-5ba6f56483d1 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:32.345136 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c8470-8a22-4b42-8148-5ba6f56483d1 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:32.345515 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c8470-8a22-4b42-8148-5ba6f56483d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:32.372512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-7b3c8470-8a22-4b42-8148-5ba6f56483d1 None None] MFA Rules not processed for user `c6e48f6b7a4e4a528da8f5e28049de77`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:32.373868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-7b3c8470-8a22-4b42-8148-5ba6f56483d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:32.446940 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 936/1876] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:32.459246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbb469-81cb-4da9-af1f-22ec4f7bff69 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:32.460991 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-b4fbb469-81cb-4da9-af1f-22ec4f7bff69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:32.520985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbb469-81cb-4da9-af1f-22ec4f7bff69 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:32.526520 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c5cde-94ff-4acb-99ca-11c04f90094d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:32.527248 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c5cde-94ff-4acb-99ca-11c04f90094d service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:32.527538 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c5cde-94ff-4acb-99ca-11c04f90094d service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:32.527819 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c5cde-94ff-4acb-99ca-11c04f90094d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:32.541051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c5cde-94ff-4acb-99ca-11c04f90094d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:32.542551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c5cde-94ff-4acb-99ca-11c04f90094d service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:32.552848 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 941/1877] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:32.639130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c8470-8a22-4b42-8148-5ba6f56483d1 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:32.649351 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c8470-8a22-4b42-8148-5ba6f56483d1 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:32.652831 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6c44b-12e3-42ad-b7e6-7a65298d39df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:32.653602 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6c44b-12e3-42ad-b7e6-7a65298d39df service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:32.653884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6c44b-12e3-42ad-b7e6-7a65298d39df service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:32.654183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6c44b-12e3-42ad-b7e6-7a65298d39df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:32.722517 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a6c44b-12e3-42ad-b7e6-7a65298d39df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:32.724570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a6c44b-12e3-42ad-b7e6-7a65298d39df service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:32.734838 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 937/1878] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:33.111169 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c5cde-94ff-4acb-99ca-11c04f90094d service cinder] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:33.188925 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c5cde-94ff-4acb-99ca-11c04f90094d service cinder] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:33.195197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b095c0c-157c-4199-b1f5-23a08b3dee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:33.196207 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b095c0c-157c-4199-b1f5-23a08b3dee08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:33.196524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b095c0c-157c-4199-b1f5-23a08b3dee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:33.196786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b095c0c-157c-4199-b1f5-23a08b3dee08 admin admin] PATH_INFO: `/v3/users/be76f1683ea340ef92fccd3d35172a04` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:33.198765 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b095c0c-157c-4199-b1f5-23a08b3dee08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be76f1683ea340ef92fccd3d35172a04)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:33.200718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b095c0c-157c-4199-b1f5-23a08b3dee08 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:33.287893 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-7b095c0c-157c-4199-b1f5-23a08b3dee08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be76f1683ea340ef92fccd3d35172a04'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:33.288872 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-7b095c0c-157c-4199-b1f5-23a08b3dee08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be76f1683ea340ef92fccd3d35172a04'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:33.289509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-7b095c0c-157c-4199-b1f5-23a08b3dee08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be76f1683ea340ef92fccd3d35172a04'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:33.297223 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-7b095c0c-157c-4199-b1f5-23a08b3dee08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be76f1683ea340ef92fccd3d35172a04'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:33.306621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-7b095c0c-157c-4199-b1f5-23a08b3dee08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be76f1683ea340ef92fccd3d35172a04'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:33.345029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 942/1879] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:33 2022] DELETE /identity/v3/users/be76f1683ea340ef92fccd3d35172a04 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:33.346789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52bc75-58f0-49cf-a9ab-2b88d312bc7a None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:33.347087 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52bc75-58f0-49cf-a9ab-2b88d312bc7a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:33.347368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52bc75-58f0-49cf-a9ab-2b88d312bc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:33.355449 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:33.380715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-df52bc75-58f0-49cf-a9ab-2b88d312bc7a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:33.382022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-df52bc75-58f0-49cf-a9ab-2b88d312bc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:33.457778 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 938/1880] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:33.477215 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b095c0c-157c-4199-b1f5-23a08b3dee08 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:33.478766 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7b095c0c-157c-4199-b1f5-23a08b3dee08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:33.492244 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:33.569475 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b095c0c-157c-4199-b1f5-23a08b3dee08 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:33.574179 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22eb7b-2461-44bf-ab54-5678f481549d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:33.575018 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22eb7b-2461-44bf-ab54-5678f481549d service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:33.575354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22eb7b-2461-44bf-ab54-5678f481549d service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:33.575800 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22eb7b-2461-44bf-ab54-5678f481549d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:33.588686 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22eb7b-2461-44bf-ab54-5678f481549d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:33.590323 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22eb7b-2461-44bf-ab54-5678f481549d service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:33.607713 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 943/1881] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:34.547139 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52bc75-58f0-49cf-a9ab-2b88d312bc7a None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:34.548540 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-df52bc75-58f0-49cf-a9ab-2b88d312bc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:34.630712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52bc75-58f0-49cf-a9ab-2b88d312bc7a None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:34.640956 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee133e5-80c0-409e-b11f-57ace827d31c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:34.641992 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee133e5-80c0-409e-b11f-57ace827d31c service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:34.642443 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee133e5-80c0-409e-b11f-57ace827d31c service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:34.644061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee133e5-80c0-409e-b11f-57ace827d31c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:34.649545 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-0ee133e5-80c0-409e-b11f-57ace827d31c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:34.728816 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22eb7b-2461-44bf-ab54-5678f481549d service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:34.731413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-5d22eb7b-2461-44bf-ab54-5678f481549d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:34.739148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee133e5-80c0-409e-b11f-57ace827d31c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:34.740953 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee133e5-80c0-409e-b11f-57ace827d31c service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:34.745232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22eb7b-2461-44bf-ab54-5678f481549d service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:34.750242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184d3e3-72af-4714-bfa5-f506ef46e566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:34.751107 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184d3e3-72af-4714-bfa5-f506ef46e566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:34.751390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184d3e3-72af-4714-bfa5-f506ef46e566 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:34.751663 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184d3e3-72af-4714-bfa5-f506ef46e566 admin admin] PATH_INFO: `/v3/projects/a65025d736274bb1993d8f0f341ebab5` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:34.751963 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 939/1882] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:34.753535 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184d3e3-72af-4714-bfa5-f506ef46e566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a65025d736274bb1993d8f0f341ebab5)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:34.755497 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184d3e3-72af-4714-bfa5-f506ef46e566 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:34.805640 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5184d3e3-72af-4714-bfa5-f506ef46e566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a65025d736274bb1993d8f0f341ebab5', 'request_id': 'req-5184d3e3-72af-4714-bfa5-f506ef46e566'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:34.812658 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5184d3e3-72af-4714-bfa5-f506ef46e566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a65025d736274bb1993d8f0f341ebab5', 'request_id': 'req-5184d3e3-72af-4714-bfa5-f506ef46e566'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:34.825606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5184d3e3-72af-4714-bfa5-f506ef46e566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a65025d736274bb1993d8f0f341ebab5', 'request_id': 'req-5184d3e3-72af-4714-bfa5-f506ef46e566'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:34.837846 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5184d3e3-72af-4714-bfa5-f506ef46e566 admin admin] The token cache is being invalidate because project a65025d736274bb1993d8f0f341ebab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:34.838302 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5184d3e3-72af-4714-bfa5-f506ef46e566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:34.839026 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5184d3e3-72af-4714-bfa5-f506ef46e566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:34.840659 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 944/1883] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:34 2022] DELETE /identity/v3/projects/a65025d736274bb1993d8f0f341ebab5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:34.844690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee133e5-80c0-409e-b11f-57ace827d31c service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:34.856260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee133e5-80c0-409e-b11f-57ace827d31c service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:34.912170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:34.919343 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507226d-d031-44d0-8a5e-374e4c383abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:34.920211 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507226d-d031-44d0-8a5e-374e4c383abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:34.920488 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507226d-d031-44d0-8a5e-374e4c383abd admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:34.920761 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507226d-d031-44d0-8a5e-374e4c383abd admin admin] PATH_INFO: `/v3/users/c6e48f6b7a4e4a528da8f5e28049de77` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:34.922082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507226d-d031-44d0-8a5e-374e4c383abd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e48f6b7a4e4a528da8f5e28049de77)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:34.924598 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507226d-d031-44d0-8a5e-374e4c383abd admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:34.972432 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-2507226d-d031-44d0-8a5e-374e4c383abd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e48f6b7a4e4a528da8f5e28049de77'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:34.984741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-2507226d-d031-44d0-8a5e-374e4c383abd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e48f6b7a4e4a528da8f5e28049de77'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:34.985468 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-2507226d-d031-44d0-8a5e-374e4c383abd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e48f6b7a4e4a528da8f5e28049de77'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:34.986078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-2507226d-d031-44d0-8a5e-374e4c383abd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e48f6b7a4e4a528da8f5e28049de77'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:34.994690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-2507226d-d031-44d0-8a5e-374e4c383abd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e48f6b7a4e4a528da8f5e28049de77'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:35.027464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 940/1884] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:34 2022] DELETE /identity/v3/users/c6e48f6b7a4e4a528da8f5e28049de77 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:35.519484 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184d3e3-72af-4714-bfa5-f506ef46e566 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:35.521369 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-5184d3e3-72af-4714-bfa5-f506ef46e566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:35.535973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184d3e3-72af-4714-bfa5-f506ef46e566 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:35.602057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e585ed-76d6-4cce-bceb-bc4625183f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:35.602947 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e585ed-76d6-4cce-bceb-bc4625183f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:35.603233 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e585ed-76d6-4cce-bceb-bc4625183f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:35.603649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e585ed-76d6-4cce-bceb-bc4625183f4b admin admin] PATH_INFO: `/v3/projects/0141db41298547568af533d8bce47060` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:35.604913 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e585ed-76d6-4cce-bceb-bc4625183f4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0141db41298547568af533d8bce47060)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:35.606888 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e585ed-76d6-4cce-bceb-bc4625183f4b admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:35.654850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:35.666412 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e5e585ed-76d6-4cce-bceb-bc4625183f4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0141db41298547568af533d8bce47060', 'request_id': 'req-e5e585ed-76d6-4cce-bceb-bc4625183f4b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:35.672769 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e5e585ed-76d6-4cce-bceb-bc4625183f4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0141db41298547568af533d8bce47060', 'request_id': 'req-e5e585ed-76d6-4cce-bceb-bc4625183f4b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:35.682840 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e5e585ed-76d6-4cce-bceb-bc4625183f4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0141db41298547568af533d8bce47060', 'request_id': 'req-e5e585ed-76d6-4cce-bceb-bc4625183f4b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:35.693648 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e5e585ed-76d6-4cce-bceb-bc4625183f4b admin admin] The token cache is being invalidate because project 0141db41298547568af533d8bce47060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:35.693943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e5e585ed-76d6-4cce-bceb-bc4625183f4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:35.694588 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e5e585ed-76d6-4cce-bceb-bc4625183f4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:35.696246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 945/1885] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:35 2022] DELETE /identity/v3/projects/0141db41298547568af533d8bce47060 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:35.701154 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48825b-49c5-4070-8809-48d4a510c8bc None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:35.701670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48825b-49c5-4070-8809-48d4a510c8bc None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:35.701758 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48825b-49c5-4070-8809-48d4a510c8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:35.722399 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-9d48825b-49c5-4070-8809-48d4a510c8bc None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:35.723802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9d48825b-49c5-4070-8809-48d4a510c8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:35.813362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 941/1886] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:54:35.815659 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34daabf4-1a46-40ca-a008-b374cd303ddd None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:35.816117 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34daabf4-1a46-40ca-a008-b374cd303ddd None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:35.816508 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34daabf4-1a46-40ca-a008-b374cd303ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:35.840261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-34daabf4-1a46-40ca-a008-b374cd303ddd None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:35.841606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-34daabf4-1a46-40ca-a008-b374cd303ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:35.850414 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 946/1887] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:35.854678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48825b-49c5-4070-8809-48d4a510c8bc None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:35.864589 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48825b-49c5-4070-8809-48d4a510c8bc None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:35.869232 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a8da4-3fc7-4360-a540-512e58f880cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:35.869920 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a8da4-3fc7-4360-a540-512e58f880cf admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:35.870204 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a8da4-3fc7-4360-a540-512e58f880cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:35.870481 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a8da4-3fc7-4360-a540-512e58f880cf admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:35.871200 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a8da4-3fc7-4360-a540-512e58f880cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:54:35.871507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a8da4-3fc7-4360-a540-512e58f880cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:35.873095 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a8da4-3fc7-4360-a540-512e58f880cf admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:35.885596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 942/1888] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:54:35.890003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34daabf4-1a46-40ca-a008-b374cd303ddd None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:35.900014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34daabf4-1a46-40ca-a008-b374cd303ddd None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:35.904730 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc85cb-bb50-40ab-8fbf-30936fc8b5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:35.905423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc85cb-bb50-40ab-8fbf-30936fc8b5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:35.905712 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc85cb-bb50-40ab-8fbf-30936fc8b5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:35.905986 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc85cb-bb50-40ab-8fbf-30936fc8b5a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:35.906679 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc85cb-bb50-40ab-8fbf-30936fc8b5a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:35.908666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc85cb-bb50-40ab-8fbf-30936fc8b5a4 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:35.934385 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 947/1889] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:35 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:35.938459 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a8da4-3fc7-4360-a540-512e58f880cf admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:35.949163 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a8da4-3fc7-4360-a540-512e58f880cf admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:36.006659 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b9a6a-39db-4e26-a2f5-a42740dceda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:36.007332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b9a6a-39db-4e26-a2f5-a42740dceda8 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:36.007612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b9a6a-39db-4e26-a2f5-a42740dceda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:36.007887 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b9a6a-39db-4e26-a2f5-a42740dceda8 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:36.008587 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b9a6a-39db-4e26-a2f5-a42740dceda8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:36.010575 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b9a6a-39db-4e26-a2f5-a42740dceda8 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:36.018899 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:36.036930 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 943/1890] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:35 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:36.038269 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc85cb-bb50-40ab-8fbf-30936fc8b5a4 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:36.048585 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc85cb-bb50-40ab-8fbf-30936fc8b5a4 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:36.053160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b81264-a529-4781-9e3d-b2551ad9be1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:36.054004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b81264-a529-4781-9e3d-b2551ad9be1b admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:36.054292 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b81264-a529-4781-9e3d-b2551ad9be1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:36.054570 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b81264-a529-4781-9e3d-b2551ad9be1b admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:36.055284 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b81264-a529-4781-9e3d-b2551ad9be1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:36.056863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b81264-a529-4781-9e3d-b2551ad9be1b admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:36.068037 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 948/1891] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:36.071859 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b9a6a-39db-4e26-a2f5-a42740dceda8 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:36.082591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b9a6a-39db-4e26-a2f5-a42740dceda8 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:36.087865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed431c-b2f3-4415-8f69-8f2ce8ddacc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:36.088566 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed431c-b2f3-4415-8f69-8f2ce8ddacc3 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:36.088855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed431c-b2f3-4415-8f69-8f2ce8ddacc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:36.089135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed431c-b2f3-4415-8f69-8f2ce8ddacc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:36.089914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed431c-b2f3-4415-8f69-8f2ce8ddacc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:36.091769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed431c-b2f3-4415-8f69-8f2ce8ddacc3 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:36.109482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 944/1892] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:36.110721 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b81264-a529-4781-9e3d-b2551ad9be1b admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:36.122117 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b81264-a529-4781-9e3d-b2551ad9be1b admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:36.130061 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd5636-7ddc-4708-a11d-1bc87f791ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:36.131174 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd5636-7ddc-4708-a11d-1bc87f791ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:36.131613 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd5636-7ddc-4708-a11d-1bc87f791ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:36.132207 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd5636-7ddc-4708-a11d-1bc87f791ffa admin admin] PATH_INFO: `/v3/projects/ba3d23c9b84749ab82fd6f9894061b27/users/2f922ca778814cd68a5b12fd6ba1a28d/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:36.151730 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd5636-7ddc-4708-a11d-1bc87f791ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3d23c9b84749ab82fd6f9894061b27, user_id=2f922ca778814cd68a5b12fd6ba1a28d, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:36.154958 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd5636-7ddc-4708-a11d-1bc87f791ffa admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:36.170488 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 949/1893] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:36 2022] PUT /identity/v3/projects/ba3d23c9b84749ab82fd6f9894061b27/users/2f922ca778814cd68a5b12fd6ba1a28d/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:36.182509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bffa64-2dbc-4dbe-97f0-0b0e5190b110 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:36.182805 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bffa64-2dbc-4dbe-97f0-0b0e5190b110 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:36.183088 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bffa64-2dbc-4dbe-97f0-0b0e5190b110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:36.212541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-f7bffa64-2dbc-4dbe-97f0-0b0e5190b110 None None] MFA Rules not processed for user `2f922ca778814cd68a5b12fd6ba1a28d`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:36.213816 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f7bffa64-2dbc-4dbe-97f0-0b0e5190b110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:36.296494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 945/1894] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:36.310595 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd5636-7ddc-4708-a11d-1bc87f791ffa admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:36.312894 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-16cd5636-7ddc-4708-a11d-1bc87f791ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:36.421938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd5636-7ddc-4708-a11d-1bc87f791ffa admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:36.436914 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10a5e2-c119-4da4-859e-7166d9a29f11 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3039ec7e613464c8a71f4440dfe8bc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:36.437713 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10a5e2-c119-4da4-859e-7166d9a29f11 service glance] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:36.439367 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10a5e2-c119-4da4-859e-7166d9a29f11 service glance] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:36.439367 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10a5e2-c119-4da4-859e-7166d9a29f11 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:36.451465 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10a5e2-c119-4da4-859e-7166d9a29f11 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:36.453317 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10a5e2-c119-4da4-859e-7166d9a29f11 service glance] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:36.465993 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 950/1895] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:39.867811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bffa64-2dbc-4dbe-97f0-0b0e5190b110 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:39.873321 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f7bffa64-2dbc-4dbe-97f0-0b0e5190b110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:39.886553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecd0fb-c149-47e9-8f4b-e069a941ade8 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:39.887151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecd0fb-c149-47e9-8f4b-e069a941ade8 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:39.887151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecd0fb-c149-47e9-8f4b-e069a941ade8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:39.911960 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-7eecd0fb-c149-47e9-8f4b-e069a941ade8 None None] MFA Rules not processed for user `30176875bbd349a6b3f8dc69c278a774`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:39.912708 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7eecd0fb-c149-47e9-8f4b-e069a941ade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:39.967038 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bffa64-2dbc-4dbe-97f0-0b0e5190b110 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:39.975095 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2ba61-684a-49a9-9666-eb8dc48e47a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:39.976031 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2ba61-684a-49a9-9666-eb8dc48e47a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:39.976320 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2ba61-684a-49a9-9666-eb8dc48e47a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:39.976698 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2ba61-684a-49a9-9666-eb8dc48e47a3 admin admin] PATH_INFO: `/v3/users/131c3dca393f4ad98380dbbd8f566265` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:39.981312 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 951/1896] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:54:39.981497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2ba61-684a-49a9-9666-eb8dc48e47a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=131c3dca393f4ad98380dbbd8f566265)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:39.982399 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2ba61-684a-49a9-9666-eb8dc48e47a3 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:40.047022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-34b2ba61-684a-49a9-9666-eb8dc48e47a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131c3dca393f4ad98380dbbd8f566265'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:40.062295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-34b2ba61-684a-49a9-9666-eb8dc48e47a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131c3dca393f4ad98380dbbd8f566265'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:40.063392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-34b2ba61-684a-49a9-9666-eb8dc48e47a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131c3dca393f4ad98380dbbd8f566265'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:40.066123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-34b2ba61-684a-49a9-9666-eb8dc48e47a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131c3dca393f4ad98380dbbd8f566265'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:40.078897 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-34b2ba61-684a-49a9-9666-eb8dc48e47a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131c3dca393f4ad98380dbbd8f566265'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:40.080675 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:40.112506 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 946/1897] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:39 2022] DELETE /identity/v3/users/131c3dca393f4ad98380dbbd8f566265 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:40.117417 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87f96e-641f-4977-a890-df3944fb0ff5 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:40.118601 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87f96e-641f-4977-a890-df3944fb0ff5 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:40.118601 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87f96e-641f-4977-a890-df3944fb0ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:40.140172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-ba87f96e-641f-4977-a890-df3944fb0ff5 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:40.141552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ba87f96e-641f-4977-a890-df3944fb0ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:40.146163 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:40.226317 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 952/1898] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:40.250934 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2ba61-684a-49a9-9666-eb8dc48e47a3 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:40.253395 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-34b2ba61-684a-49a9-9666-eb8dc48e47a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:40.332854 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2ba61-684a-49a9-9666-eb8dc48e47a3 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:40.336723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cef11-a082-465b-8517-f814512c0bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:40.337406 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cef11-a082-465b-8517-f814512c0bcc service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:40.337686 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cef11-a082-465b-8517-f814512c0bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:40.337965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cef11-a082-465b-8517-f814512c0bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:40.348876 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cef11-a082-465b-8517-f814512c0bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:40.350814 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cef11-a082-465b-8517-f814512c0bcc service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:40.366693 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 947/1899] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:54:40.907626 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87f96e-641f-4977-a890-df3944fb0ff5 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:40.909683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ba87f96e-641f-4977-a890-df3944fb0ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:40.929541 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87f96e-641f-4977-a890-df3944fb0ff5 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:40.934597 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87936e49-fd53-4328-80ba-8202f6b38d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:40.935472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87936e49-fd53-4328-80ba-8202f6b38d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:40.935938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87936e49-fd53-4328-80ba-8202f6b38d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:40.936367 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87936e49-fd53-4328-80ba-8202f6b38d37 admin admin] PATH_INFO: `/v3/projects/5d90bf2a2507429f83a6549147f36e10` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:40.937580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87936e49-fd53-4328-80ba-8202f6b38d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d90bf2a2507429f83a6549147f36e10)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:40.940078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87936e49-fd53-4328-80ba-8202f6b38d37 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:40.995494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-87936e49-fd53-4328-80ba-8202f6b38d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d90bf2a2507429f83a6549147f36e10', 'request_id': 'req-87936e49-fd53-4328-80ba-8202f6b38d37'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.003692 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-87936e49-fd53-4328-80ba-8202f6b38d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d90bf2a2507429f83a6549147f36e10', 'request_id': 'req-87936e49-fd53-4328-80ba-8202f6b38d37'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.013744 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-87936e49-fd53-4328-80ba-8202f6b38d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d90bf2a2507429f83a6549147f36e10', 'request_id': 'req-87936e49-fd53-4328-80ba-8202f6b38d37'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.026650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-87936e49-fd53-4328-80ba-8202f6b38d37 admin admin] The token cache is being invalidate because project 5d90bf2a2507429f83a6549147f36e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:41.026951 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-87936e49-fd53-4328-80ba-8202f6b38d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.027604 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-87936e49-fd53-4328-80ba-8202f6b38d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.029369 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 953/1900] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:40 2022] DELETE /identity/v3/projects/5d90bf2a2507429f83a6549147f36e10 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:41.033736 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cef11-a082-465b-8517-f814512c0bcc service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:41.045363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cef11-a082-465b-8517-f814512c0bcc service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:41.120329 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3d43d-67e7-4196-93a0-f72af8ec1f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:41.121192 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3d43d-67e7-4196-93a0-f72af8ec1f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:41.121504 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3d43d-67e7-4196-93a0-f72af8ec1f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:41.121780 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3d43d-67e7-4196-93a0-f72af8ec1f44 admin admin] PATH_INFO: `/v3/users/0c3da193555040b2994b6f9dd7e68739` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:41.123742 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3d43d-67e7-4196-93a0-f72af8ec1f44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3da193555040b2994b6f9dd7e68739)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:41.126128 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3d43d-67e7-4196-93a0-f72af8ec1f44 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:41.178838 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-44f3d43d-67e7-4196-93a0-f72af8ec1f44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3da193555040b2994b6f9dd7e68739'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.191723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-44f3d43d-67e7-4196-93a0-f72af8ec1f44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3da193555040b2994b6f9dd7e68739'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.192408 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-44f3d43d-67e7-4196-93a0-f72af8ec1f44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3da193555040b2994b6f9dd7e68739'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.192999 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-44f3d43d-67e7-4196-93a0-f72af8ec1f44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3da193555040b2994b6f9dd7e68739'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.199912 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-44f3d43d-67e7-4196-93a0-f72af8ec1f44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3da193555040b2994b6f9dd7e68739'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.212516 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 948/1901] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:41 2022] DELETE /identity/v3/users/0c3da193555040b2994b6f9dd7e68739 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:41.446100 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0b8f1-2f5d-4e4c-88cf-2349ba7d9bb6 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:41.446387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0b8f1-2f5d-4e4c-88cf-2349ba7d9bb6 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:41.446668 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0b8f1-2f5d-4e4c-88cf-2349ba7d9bb6 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:41.448207 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 954/1902] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 13:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:54:41.480167 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559d9c5-27b8-40b1-a21c-0432c8a7339e None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:41.480454 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559d9c5-27b8-40b1-a21c-0432c8a7339e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:41.480732 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559d9c5-27b8-40b1-a21c-0432c8a7339e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:41.502770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-f559d9c5-27b8-40b1-a21c-0432c8a7339e None None] MFA Rules not processed for user `8b0db68b7fda4da29eb13689f3fd7b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:41.504108 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f559d9c5-27b8-40b1-a21c-0432c8a7339e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:41.509643 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:41.579023 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 949/1903] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 13:54:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:41.580755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0b8f1-2f5d-4e4c-88cf-2349ba7d9bb6 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:41.582540 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-32b0b8f1-2f5d-4e4c-88cf-2349ba7d9bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:41.593752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559d9c5-27b8-40b1-a21c-0432c8a7339e None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:41.595111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f559d9c5-27b8-40b1-a21c-0432c8a7339e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:41.607604 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559d9c5-27b8-40b1-a21c-0432c8a7339e None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:41.613516 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60e7d5-bacb-4add-bd77-74066c9293dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0db68b7fda4da29eb13689f3fd7b5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:41.614241 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60e7d5-bacb-4add-bd77-74066c9293dc service placement] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:41.614595 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60e7d5-bacb-4add-bd77-74066c9293dc service placement] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:41.615916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60e7d5-bacb-4add-bd77-74066c9293dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:41.644319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60e7d5-bacb-4add-bd77-74066c9293dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:41.646307 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60e7d5-bacb-4add-bd77-74066c9293dc service placement] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:41.657338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 950/1904] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:54:41.661145 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0b8f1-2f5d-4e4c-88cf-2349ba7d9bb6 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:41.666198 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00a691-0bf6-4d60-b150-5b66d6885057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:41.667153 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00a691-0bf6-4d60-b150-5b66d6885057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:41.667349 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00a691-0bf6-4d60-b150-5b66d6885057 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:41.667624 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00a691-0bf6-4d60-b150-5b66d6885057 admin admin] PATH_INFO: `/v3/users/5084491710d34261b91001f5161d8a64` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:41.669357 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00a691-0bf6-4d60-b150-5b66d6885057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5084491710d34261b91001f5161d8a64)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:41.671944 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00a691-0bf6-4d60-b150-5b66d6885057 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:41.704281 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60e7d5-bacb-4add-bd77-74066c9293dc service placement] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:41.706022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9e60e7d5-bacb-4add-bd77-74066c9293dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:41.719164 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:41.729595 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60e7d5-bacb-4add-bd77-74066c9293dc service placement] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:41.732168 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ab00a691-0bf6-4d60-b150-5b66d6885057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5084491710d34261b91001f5161d8a64'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.732990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ab00a691-0bf6-4d60-b150-5b66d6885057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5084491710d34261b91001f5161d8a64'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.733733 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ab00a691-0bf6-4d60-b150-5b66d6885057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5084491710d34261b91001f5161d8a64'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.735109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa05bc7-ca29-4d2f-8a6f-b372127289f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:41.735968 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa05bc7-ca29-4d2f-8a6f-b372127289f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:41.736788 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa05bc7-ca29-4d2f-8a6f-b372127289f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:41.737114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa05bc7-ca29-4d2f-8a6f-b372127289f1 admin admin] PATH_INFO: `/v3/projects/2a8406c839c84e648324a8b61fc02c0c` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:41.738366 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa05bc7-ca29-4d2f-8a6f-b372127289f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a8406c839c84e648324a8b61fc02c0c)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:41.740281 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa05bc7-ca29-4d2f-8a6f-b372127289f1 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:41.743234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ab00a691-0bf6-4d60-b150-5b66d6885057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5084491710d34261b91001f5161d8a64'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.751704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ab00a691-0bf6-4d60-b150-5b66d6885057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5084491710d34261b91001f5161d8a64'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.770149 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 955/1905] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:41 2022] DELETE /identity/v3/users/5084491710d34261b91001f5161d8a64 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:41.802227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-2aa05bc7-ca29-4d2f-8a6f-b372127289f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a8406c839c84e648324a8b61fc02c0c', 'request_id': 'req-2aa05bc7-ca29-4d2f-8a6f-b372127289f1'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.817463 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-2aa05bc7-ca29-4d2f-8a6f-b372127289f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a8406c839c84e648324a8b61fc02c0c', 'request_id': 'req-2aa05bc7-ca29-4d2f-8a6f-b372127289f1'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.827804 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-2aa05bc7-ca29-4d2f-8a6f-b372127289f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a8406c839c84e648324a8b61fc02c0c', 'request_id': 'req-2aa05bc7-ca29-4d2f-8a6f-b372127289f1'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.842771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-2aa05bc7-ca29-4d2f-8a6f-b372127289f1 admin admin] The token cache is being invalidate because project 2a8406c839c84e648324a8b61fc02c0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:41.843159 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-2aa05bc7-ca29-4d2f-8a6f-b372127289f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.843990 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-2aa05bc7-ca29-4d2f-8a6f-b372127289f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:41.849322 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 951/1906] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:41 2022] DELETE /identity/v3/projects/2a8406c839c84e648324a8b61fc02c0c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:41.852490 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424840c-ce56-47b2-b434-ea5531bd9478 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:41.852849 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424840c-ce56-47b2-b434-ea5531bd9478 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:41.853208 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424840c-ce56-47b2-b434-ea5531bd9478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:41.875613 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-c424840c-ce56-47b2-b434-ea5531bd9478 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:41.878260 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-c424840c-ce56-47b2-b434-ea5531bd9478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:41.961314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 956/1907] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:41.967147 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6c38a-4f43-4f20-a326-0fe78031ba6a None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:41.968087 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6c38a-4f43-4f20-a326-0fe78031ba6a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:41.968375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6c38a-4f43-4f20-a326-0fe78031ba6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:41.993662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-21f6c38a-4f43-4f20-a326-0fe78031ba6a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:41.995027 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-21f6c38a-4f43-4f20-a326-0fe78031ba6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:42.009772 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 952/1908] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:42.012675 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424840c-ce56-47b2-b434-ea5531bd9478 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:42.025960 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424840c-ce56-47b2-b434-ea5531bd9478 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:42.031124 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845b1a5-0d1b-45ae-94fc-e1ac369e75db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:42.031809 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845b1a5-0d1b-45ae-94fc-e1ac369e75db admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.032140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845b1a5-0d1b-45ae-94fc-e1ac369e75db admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.033161 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845b1a5-0d1b-45ae-94fc-e1ac369e75db admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.034433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845b1a5-0d1b-45ae-94fc-e1ac369e75db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:54:42.034849 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6c38a-4f43-4f20-a326-0fe78031ba6a None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:42.035610 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845b1a5-0d1b-45ae-94fc-e1ac369e75db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:42.037572 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845b1a5-0d1b-45ae-94fc-e1ac369e75db admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:42.037849 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-21f6c38a-4f43-4f20-a326-0fe78031ba6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:42.053362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6c38a-4f43-4f20-a326-0fe78031ba6a None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:42.065882 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42201867-d181-4b5c-950b-b7c86158fb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:42.066825 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201867-d181-4b5c-950b-b7c86158fb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.067112 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201867-d181-4b5c-950b-b7c86158fb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.068031 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201867-d181-4b5c-950b-b7c86158fb68 admin admin] PATH_INFO: `/v3/projects/e39e464f5b2b4873a8596c77fa0da348` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.069593 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42201867-d181-4b5c-950b-b7c86158fb68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e39e464f5b2b4873a8596c77fa0da348)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:42.073000 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42201867-d181-4b5c-950b-b7c86158fb68 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:42.073454 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 957/1909] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:54:42.075745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845b1a5-0d1b-45ae-94fc-e1ac369e75db admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:42.099350 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845b1a5-0d1b-45ae-94fc-e1ac369e75db admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:42.107967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163bb18-def9-43b1-92e1-ee7ebb6e1ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:42.109044 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163bb18-def9-43b1-92e1-ee7ebb6e1ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.109466 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163bb18-def9-43b1-92e1-ee7ebb6e1ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.109782 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163bb18-def9-43b1-92e1-ee7ebb6e1ec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.110586 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163bb18-def9-43b1-92e1-ee7ebb6e1ec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:42.115390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163bb18-def9-43b1-92e1-ee7ebb6e1ec7 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:42.131950 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-42201867-d181-4b5c-950b-b7c86158fb68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39e464f5b2b4873a8596c77fa0da348', 'request_id': 'req-42201867-d181-4b5c-950b-b7c86158fb68'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:42.144153 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-42201867-d181-4b5c-950b-b7c86158fb68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39e464f5b2b4873a8596c77fa0da348', 'request_id': 'req-42201867-d181-4b5c-950b-b7c86158fb68'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:42.150545 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 958/1910] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:42 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:42.154696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163bb18-def9-43b1-92e1-ee7ebb6e1ec7 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:42.155632 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-42201867-d181-4b5c-950b-b7c86158fb68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39e464f5b2b4873a8596c77fa0da348', 'request_id': 'req-42201867-d181-4b5c-950b-b7c86158fb68'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:42.159622 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:42.184639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-42201867-d181-4b5c-950b-b7c86158fb68 admin admin] The token cache is being invalidate because project e39e464f5b2b4873a8596c77fa0da348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:42.185254 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-42201867-d181-4b5c-950b-b7c86158fb68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:42.188000 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-42201867-d181-4b5c-950b-b7c86158fb68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:42.192204 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 953/1911] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:42 2022] DELETE /identity/v3/projects/e39e464f5b2b4873a8596c77fa0da348 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:42.198355 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62842a5b-eeac-4782-a0b8-da23ce9b8a5e None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.198794 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62842a5b-eeac-4782-a0b8-da23ce9b8a5e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.199074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62842a5b-eeac-4782-a0b8-da23ce9b8a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.220721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-62842a5b-eeac-4782-a0b8-da23ce9b8a5e None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:42.221963 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-62842a5b-eeac-4782-a0b8-da23ce9b8a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:42.237753 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163bb18-def9-43b1-92e1-ee7ebb6e1ec7 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:42.243884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3afc1-132b-42a8-afe5-42b2ba1979e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:42.244566 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3afc1-132b-42a8-afe5-42b2ba1979e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.244911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3afc1-132b-42a8-afe5-42b2ba1979e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.245516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3afc1-132b-42a8-afe5-42b2ba1979e0 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.246661 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3afc1-132b-42a8-afe5-42b2ba1979e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:42.249108 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3afc1-132b-42a8-afe5-42b2ba1979e0 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:42.274350 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 959/1912] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:42 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:42.277973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3afc1-132b-42a8-afe5-42b2ba1979e0 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:42.280042 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-75b3afc1-132b-42a8-afe5-42b2ba1979e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:42.292611 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3afc1-132b-42a8-afe5-42b2ba1979e0 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:42.293403 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 954/1913] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:42.297977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4ab01-d966-4b4b-be06-643f35618923 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.298275 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4ab01-d966-4b4b-be06-643f35618923 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.298484 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fb5ce-838f-4509-957f-b0054542cd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:42.299648 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4ab01-d966-4b4b-be06-643f35618923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.299976 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fb5ce-838f-4509-957f-b0054542cd8f admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.300159 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fb5ce-838f-4509-957f-b0054542cd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.300545 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fb5ce-838f-4509-957f-b0054542cd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.301455 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fb5ce-838f-4509-957f-b0054542cd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:42.307656 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fb5ce-838f-4509-957f-b0054542cd8f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:42.309772 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:42.323105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 960/1914] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:42.325405 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fb5ce-838f-4509-957f-b0054542cd8f admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:42.332186 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-49c4ab01-d966-4b4b-be06-643f35618923 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:42.334055 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-49c4ab01-d966-4b4b-be06-643f35618923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:42.337092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fb5ce-838f-4509-957f-b0054542cd8f admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:42.341730 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3a4c9-704b-4882-9d98-291622731090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:42.342510 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3a4c9-704b-4882-9d98-291622731090 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.343061 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3a4c9-704b-4882-9d98-291622731090 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.343181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 955/1915] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:42.343261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3a4c9-704b-4882-9d98-291622731090 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.343911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3a4c9-704b-4882-9d98-291622731090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:42.345573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3a4c9-704b-4882-9d98-291622731090 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:42.347392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4ab01-d966-4b4b-be06-643f35618923 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:42.356397 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4ab01-d966-4b4b-be06-643f35618923 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:42.360894 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 961/1916] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:42.362708 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3a4c9-704b-4882-9d98-291622731090 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:42.363632 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d93bb-8876-451e-b241-6a0213a06f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:42.364294 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d93bb-8876-451e-b241-6a0213a06f27 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.364571 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d93bb-8876-451e-b241-6a0213a06f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.364842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d93bb-8876-451e-b241-6a0213a06f27 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.365587 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d93bb-8876-451e-b241-6a0213a06f27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:54:42.365894 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d93bb-8876-451e-b241-6a0213a06f27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:42.367496 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d93bb-8876-451e-b241-6a0213a06f27 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:42.379791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3a4c9-704b-4882-9d98-291622731090 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:42.384820 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5cdab-c180-45cf-89b9-a4270ce5fdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:42.385766 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5cdab-c180-45cf-89b9-a4270ce5fdb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.386040 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5cdab-c180-45cf-89b9-a4270ce5fdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.386313 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5cdab-c180-45cf-89b9-a4270ce5fdb6 admin admin] PATH_INFO: `/v3/projects/dcf5fe9266c64898a9246bbfb20cfbc8/users/80ad1311a46641dd948aed61d450dbb9/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.390375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 956/1917] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:54:42.395080 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d93bb-8876-451e-b241-6a0213a06f27 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:42.402059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5cdab-c180-45cf-89b9-a4270ce5fdb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf5fe9266c64898a9246bbfb20cfbc8, user_id=80ad1311a46641dd948aed61d450dbb9, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:42.405965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5cdab-c180-45cf-89b9-a4270ce5fdb6 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:42.406364 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d93bb-8876-451e-b241-6a0213a06f27 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:42.412832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5840d7c-d4f1-4b0d-837a-7405976b3584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:42.413621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5840d7c-d4f1-4b0d-837a-7405976b3584 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.413923 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5840d7c-d4f1-4b0d-837a-7405976b3584 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.414947 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5840d7c-d4f1-4b0d-837a-7405976b3584 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.415724 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5840d7c-d4f1-4b0d-837a-7405976b3584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:42.419063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5840d7c-d4f1-4b0d-837a-7405976b3584 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:42.425454 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 962/1918] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:42 2022] PUT /identity/v3/projects/dcf5fe9266c64898a9246bbfb20cfbc8/users/80ad1311a46641dd948aed61d450dbb9/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:42.436777 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa378e7d-c88d-4b74-81d6-e728cc15a30a None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.437073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa378e7d-c88d-4b74-81d6-e728cc15a30a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.438217 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa378e7d-c88d-4b74-81d6-e728cc15a30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.455494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 957/1919] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:42 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:42.459950 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5840d7c-d4f1-4b0d-837a-7405976b3584 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:42.482555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-aa378e7d-c88d-4b74-81d6-e728cc15a30a None None] MFA Rules not processed for user `80ad1311a46641dd948aed61d450dbb9`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:42.484046 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-aa378e7d-c88d-4b74-81d6-e728cc15a30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:42.546331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5840d7c-d4f1-4b0d-837a-7405976b3584 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:42.552270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5b20e-58d0-43e9-99ad-661ceda3cdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:42.552932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5b20e-58d0-43e9-99ad-661ceda3cdd1 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.553210 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5b20e-58d0-43e9-99ad-661ceda3cdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.553512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5b20e-58d0-43e9-99ad-661ceda3cdd1 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.554226 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5b20e-58d0-43e9-99ad-661ceda3cdd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:42.556296 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5b20e-58d0-43e9-99ad-661ceda3cdd1 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:42.571767 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 963/1920] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:42.582368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 958/1921] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:42 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:42.585424 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa378e7d-c88d-4b74-81d6-e728cc15a30a None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:42.586365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5b20e-58d0-43e9-99ad-661ceda3cdd1 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:42.586848 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-aa378e7d-c88d-4b74-81d6-e728cc15a30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:42.597858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5b20e-58d0-43e9-99ad-661ceda3cdd1 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:42.603170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49f224-52c8-4396-a7f8-930d91e5fcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:42.603833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49f224-52c8-4396-a7f8-930d91e5fcb2 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.604113 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49f224-52c8-4396-a7f8-930d91e5fcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.604799 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49f224-52c8-4396-a7f8-930d91e5fcb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.605109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49f224-52c8-4396-a7f8-930d91e5fcb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:42.606750 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49f224-52c8-4396-a7f8-930d91e5fcb2 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:42.618251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 959/1922] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:42.621925 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49f224-52c8-4396-a7f8-930d91e5fcb2 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:42.632201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49f224-52c8-4396-a7f8-930d91e5fcb2 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:42.637708 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed955e-0e2a-40d1-b781-f607ac2a6315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:42.638420 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed955e-0e2a-40d1-b781-f607ac2a6315 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.638949 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed955e-0e2a-40d1-b781-f607ac2a6315 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.639091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed955e-0e2a-40d1-b781-f607ac2a6315 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.639744 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed955e-0e2a-40d1-b781-f607ac2a6315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:42.641502 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed955e-0e2a-40d1-b781-f607ac2a6315 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:42.656346 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 960/1923] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:42.662493 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed955e-0e2a-40d1-b781-f607ac2a6315 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:42.665504 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa378e7d-c88d-4b74-81d6-e728cc15a30a None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:42.674939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed955e-0e2a-40d1-b781-f607ac2a6315 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:42.680870 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d109e-ee42-4713-8d40-9df735ab2574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:42.681934 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d109e-ee42-4713-8d40-9df735ab2574 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.682310 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d109e-ee42-4713-8d40-9df735ab2574 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.682682 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d109e-ee42-4713-8d40-9df735ab2574 admin admin] PATH_INFO: `/v3/projects/f92c599b842d434488a17d0db4afdff1/users/1198c5b7cf43494dbe462c89353fc1af/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.683905 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae740a87-f2f5-4f0a-bbb6-05ffb3b2388d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:42.684685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae740a87-f2f5-4f0a-bbb6-05ffb3b2388d service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.684976 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae740a87-f2f5-4f0a-bbb6-05ffb3b2388d service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.685921 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae740a87-f2f5-4f0a-bbb6-05ffb3b2388d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.696504 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae740a87-f2f5-4f0a-bbb6-05ffb3b2388d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:42.698588 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae740a87-f2f5-4f0a-bbb6-05ffb3b2388d service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:42.706562 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d109e-ee42-4713-8d40-9df735ab2574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92c599b842d434488a17d0db4afdff1, user_id=1198c5b7cf43494dbe462c89353fc1af, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:42.707833 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 964/1924] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:42.710201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d109e-ee42-4713-8d40-9df735ab2574 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:42.714157 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:42.738136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae740a87-f2f5-4f0a-bbb6-05ffb3b2388d service cinder] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:42.745331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 961/1925] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:42 2022] PUT /identity/v3/projects/f92c599b842d434488a17d0db4afdff1/users/1198c5b7cf43494dbe462c89353fc1af/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:42.751415 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae740a87-f2f5-4f0a-bbb6-05ffb3b2388d service cinder] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:42.753207 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340d23a-b49a-41bf-82b1-4750b56e897c None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.754110 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340d23a-b49a-41bf-82b1-4750b56e897c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.758008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340d23a-b49a-41bf-82b1-4750b56e897c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.798588 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-8340d23a-b49a-41bf-82b1-4750b56e897c None None] MFA Rules not processed for user `1198c5b7cf43494dbe462c89353fc1af`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:42.800752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-8340d23a-b49a-41bf-82b1-4750b56e897c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:42.806714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:42.821176 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719238e-b2db-4fbc-98f8-fe4ffc09a8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:42.822225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719238e-b2db-4fbc-98f8-fe4ffc09a8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.822502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719238e-b2db-4fbc-98f8-fe4ffc09a8db admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.822774 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719238e-b2db-4fbc-98f8-fe4ffc09a8db admin admin] PATH_INFO: `/v3/users/80ad1311a46641dd948aed61d450dbb9` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.824755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719238e-b2db-4fbc-98f8-fe4ffc09a8db admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ad1311a46641dd948aed61d450dbb9)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:42.827124 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719238e-b2db-4fbc-98f8-fe4ffc09a8db admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:42.893075 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d719238e-b2db-4fbc-98f8-fe4ffc09a8db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ad1311a46641dd948aed61d450dbb9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:42.893836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d719238e-b2db-4fbc-98f8-fe4ffc09a8db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ad1311a46641dd948aed61d450dbb9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:42.894465 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d719238e-b2db-4fbc-98f8-fe4ffc09a8db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ad1311a46641dd948aed61d450dbb9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:42.895562 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 962/1926] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:42.902872 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d719238e-b2db-4fbc-98f8-fe4ffc09a8db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ad1311a46641dd948aed61d450dbb9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:42.910609 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340d23a-b49a-41bf-82b1-4750b56e897c None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:42.912962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-8340d23a-b49a-41bf-82b1-4750b56e897c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:42.913720 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d719238e-b2db-4fbc-98f8-fe4ffc09a8db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ad1311a46641dd948aed61d450dbb9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:42.942392 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 965/1927] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:42 2022] DELETE /identity/v3/users/80ad1311a46641dd948aed61d450dbb9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:42.944594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17082edd-bd4d-46ac-8e78-1c55e18e3c4a None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:42.944888 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17082edd-bd4d-46ac-8e78-1c55e18e3c4a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:42.945162 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17082edd-bd4d-46ac-8e78-1c55e18e3c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:42.969445 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-17082edd-bd4d-46ac-8e78-1c55e18e3c4a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:42.970081 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-17082edd-bd4d-46ac-8e78-1c55e18e3c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:43.026917 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340d23a-b49a-41bf-82b1-4750b56e897c None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:43.050297 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 966/1928] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:43.072706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17082edd-bd4d-46ac-8e78-1c55e18e3c4a None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:43.074623 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-17082edd-bd4d-46ac-8e78-1c55e18e3c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:43.125997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7f440-cd68-40b5-bd8b-58a617ae4bc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:43.127600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7f440-cd68-40b5-bd8b-58a617ae4bc2 service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:43.127990 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7f440-cd68-40b5-bd8b-58a617ae4bc2 service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:43.128509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7f440-cd68-40b5-bd8b-58a617ae4bc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:43.131243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-79e7f440-cd68-40b5-bd8b-58a617ae4bc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:43.169024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17082edd-bd4d-46ac-8e78-1c55e18e3c4a None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:43.173090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0d748-04cc-455f-b790-722c62227687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:43.174477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0d748-04cc-455f-b790-722c62227687 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:43.174761 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0d748-04cc-455f-b790-722c62227687 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:43.175035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0d748-04cc-455f-b790-722c62227687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:43.183914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:43.184985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0d748-04cc-455f-b790-722c62227687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:43.186919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0d748-04cc-455f-b790-722c62227687 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:43.198330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 967/1929] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:43.237525 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7f440-cd68-40b5-bd8b-58a617ae4bc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:43.239376 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7f440-cd68-40b5-bd8b-58a617ae4bc2 service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:43.251555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 963/1930] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:43.703097 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0d748-04cc-455f-b790-722c62227687 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:43.705321 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-18d0d748-04cc-455f-b790-722c62227687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:43.754662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0d748-04cc-455f-b790-722c62227687 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:43.759735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c858f8-add2-4a72-bcd5-8abfe669598c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:43.766448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c858f8-add2-4a72-bcd5-8abfe669598c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:43.766744 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c858f8-add2-4a72-bcd5-8abfe669598c admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:43.767217 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c858f8-add2-4a72-bcd5-8abfe669598c admin admin] PATH_INFO: `/v3/projects/dcf5fe9266c64898a9246bbfb20cfbc8` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:43.769457 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c858f8-add2-4a72-bcd5-8abfe669598c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcf5fe9266c64898a9246bbfb20cfbc8)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:43.771493 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c858f8-add2-4a72-bcd5-8abfe669598c admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:43.789062 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:43.832990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-38c858f8-add2-4a72-bcd5-8abfe669598c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcf5fe9266c64898a9246bbfb20cfbc8', 'request_id': 'req-38c858f8-add2-4a72-bcd5-8abfe669598c'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:43.839420 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-38c858f8-add2-4a72-bcd5-8abfe669598c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcf5fe9266c64898a9246bbfb20cfbc8', 'request_id': 'req-38c858f8-add2-4a72-bcd5-8abfe669598c'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:43.847437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-38c858f8-add2-4a72-bcd5-8abfe669598c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcf5fe9266c64898a9246bbfb20cfbc8', 'request_id': 'req-38c858f8-add2-4a72-bcd5-8abfe669598c'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:43.859001 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-38c858f8-add2-4a72-bcd5-8abfe669598c admin admin] The token cache is being invalidate because project dcf5fe9266c64898a9246bbfb20cfbc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:43.859290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-38c858f8-add2-4a72-bcd5-8abfe669598c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:43.859940 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-38c858f8-add2-4a72-bcd5-8abfe669598c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:43.862066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 968/1931] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:43 2022] DELETE /identity/v3/projects/dcf5fe9266c64898a9246bbfb20cfbc8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:43.866909 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ff6bc-fc26-45ed-90d4-e5baa8e0de64 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:43.867199 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ff6bc-fc26-45ed-90d4-e5baa8e0de64 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:43.867477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ff6bc-fc26-45ed-90d4-e5baa8e0de64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:43.886109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-328ff6bc-fc26-45ed-90d4-e5baa8e0de64 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:43.887661 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-328ff6bc-fc26-45ed-90d4-e5baa8e0de64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:43.955448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 964/1932] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:43.963427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c740d-36b3-4160-aa03-f4caac503826 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:43.963717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c740d-36b3-4160-aa03-f4caac503826 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:43.964003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c740d-36b3-4160-aa03-f4caac503826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:43.983226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-aa5c740d-36b3-4160-aa03-f4caac503826 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:43.984992 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-aa5c740d-36b3-4160-aa03-f4caac503826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:43.997058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 969/1933] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:43.998268 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ff6bc-fc26-45ed-90d4-e5baa8e0de64 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:44.011686 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ff6bc-fc26-45ed-90d4-e5baa8e0de64 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:44.018118 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d322c98-6b2f-4710-be22-476fdd9704f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:44.018334 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d322c98-6b2f-4710-be22-476fdd9704f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:44.018621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d322c98-6b2f-4710-be22-476fdd9704f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:44.018901 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d322c98-6b2f-4710-be22-476fdd9704f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:44.019658 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d322c98-6b2f-4710-be22-476fdd9704f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:54:44.019966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d322c98-6b2f-4710-be22-476fdd9704f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:44.021643 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d322c98-6b2f-4710-be22-476fdd9704f1 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:44.035559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 965/1934] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:54:44.039701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c740d-36b3-4160-aa03-f4caac503826 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:44.049873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c740d-36b3-4160-aa03-f4caac503826 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:44.055319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350db7c-3814-43c5-917e-989bae03d108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:44.056061 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350db7c-3814-43c5-917e-989bae03d108 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:44.056473 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350db7c-3814-43c5-917e-989bae03d108 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:44.056820 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350db7c-3814-43c5-917e-989bae03d108 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:44.057655 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350db7c-3814-43c5-917e-989bae03d108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:44.059682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350db7c-3814-43c5-917e-989bae03d108 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:44.085549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 970/1935] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:44 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:44.089757 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d322c98-6b2f-4710-be22-476fdd9704f1 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:44.100219 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d322c98-6b2f-4710-be22-476fdd9704f1 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:44.161258 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296efa21-d4ca-47d8-865c-a75cc27ef1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:44.161947 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296efa21-d4ca-47d8-865c-a75cc27ef1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:44.162247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296efa21-d4ca-47d8-865c-a75cc27ef1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:44.162519 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296efa21-d4ca-47d8-865c-a75cc27ef1c9 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:44.163211 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296efa21-d4ca-47d8-865c-a75cc27ef1c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:44.165140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296efa21-d4ca-47d8-865c-a75cc27ef1c9 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:44.187413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 966/1936] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:44 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:44.192258 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350db7c-3814-43c5-917e-989bae03d108 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:44.203101 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350db7c-3814-43c5-917e-989bae03d108 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:44.208009 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514f410-8dcf-4f18-85d6-6d5981b6dc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:44.208749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514f410-8dcf-4f18-85d6-6d5981b6dc95 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:44.209099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514f410-8dcf-4f18-85d6-6d5981b6dc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:44.209481 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514f410-8dcf-4f18-85d6-6d5981b6dc95 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:44.210211 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514f410-8dcf-4f18-85d6-6d5981b6dc95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:44.211791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514f410-8dcf-4f18-85d6-6d5981b6dc95 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:44.225311 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 971/1937] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:44.227641 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296efa21-d4ca-47d8-865c-a75cc27ef1c9 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:44.238238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296efa21-d4ca-47d8-865c-a75cc27ef1c9 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:44.242769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76de72-995d-4dff-aea5-d734263d34ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:44.243419 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76de72-995d-4dff-aea5-d734263d34ba admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:44.243701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76de72-995d-4dff-aea5-d734263d34ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:44.243997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76de72-995d-4dff-aea5-d734263d34ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:44.244809 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76de72-995d-4dff-aea5-d734263d34ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:44.246429 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76de72-995d-4dff-aea5-d734263d34ba admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:44.256483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 967/1938] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:44.260552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514f410-8dcf-4f18-85d6-6d5981b6dc95 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:44.270502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514f410-8dcf-4f18-85d6-6d5981b6dc95 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:44.275065 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce2bce-adb8-4a27-96ea-062914d0188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:44.275933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce2bce-adb8-4a27-96ea-062914d0188c admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:44.276217 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce2bce-adb8-4a27-96ea-062914d0188c admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:44.276493 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce2bce-adb8-4a27-96ea-062914d0188c admin admin] PATH_INFO: `/v3/projects/eac47c383e614cd6be04e937809b28a4/users/435de5dc26cf44f69b12da8bd9d74454/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:44.291447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce2bce-adb8-4a27-96ea-062914d0188c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac47c383e614cd6be04e937809b28a4, user_id=435de5dc26cf44f69b12da8bd9d74454, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:44.294118 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce2bce-adb8-4a27-96ea-062914d0188c admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:44.307371 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 972/1939] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:44 2022] PUT /identity/v3/projects/eac47c383e614cd6be04e937809b28a4/users/435de5dc26cf44f69b12da8bd9d74454/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:44.318776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad813f-23de-4a09-a116-b36442117a76 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:44.319251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad813f-23de-4a09-a116-b36442117a76 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:44.319632 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad813f-23de-4a09-a116-b36442117a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:44.353610 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-c7ad813f-23de-4a09-a116-b36442117a76 None None] MFA Rules not processed for user `435de5dc26cf44f69b12da8bd9d74454`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:44.354813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c7ad813f-23de-4a09-a116-b36442117a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:44.368300 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:44.422019 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 968/1940] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:44.433412 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce2bce-adb8-4a27-96ea-062914d0188c admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:44.435115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-36ce2bce-adb8-4a27-96ea-062914d0188c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:44.494248 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce2bce-adb8-4a27-96ea-062914d0188c admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:44.497765 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b87a8-d8fb-44f2-99ed-a8805eba92fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:44.498404 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b87a8-d8fb-44f2-99ed-a8805eba92fe service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:44.498685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b87a8-d8fb-44f2-99ed-a8805eba92fe service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:44.498958 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b87a8-d8fb-44f2-99ed-a8805eba92fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:44.507590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b87a8-d8fb-44f2-99ed-a8805eba92fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:44.508998 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b87a8-d8fb-44f2-99ed-a8805eba92fe service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:44.518075 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 973/1941] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:44.538667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad813f-23de-4a09-a116-b36442117a76 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:44.612477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad813f-23de-4a09-a116-b36442117a76 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:44.617113 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02a39b-b482-499b-ae2c-219883deec81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:44.618014 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02a39b-b482-499b-ae2c-219883deec81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:44.618301 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02a39b-b482-499b-ae2c-219883deec81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:44.618575 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02a39b-b482-499b-ae2c-219883deec81 admin admin] PATH_INFO: `/v3/users/435de5dc26cf44f69b12da8bd9d74454` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:44.619882 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02a39b-b482-499b-ae2c-219883deec81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435de5dc26cf44f69b12da8bd9d74454)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:44.621846 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02a39b-b482-499b-ae2c-219883deec81 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:44.674645 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-9d02a39b-b482-499b-ae2c-219883deec81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435de5dc26cf44f69b12da8bd9d74454'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:44.687194 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-9d02a39b-b482-499b-ae2c-219883deec81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435de5dc26cf44f69b12da8bd9d74454'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:44.687928 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-9d02a39b-b482-499b-ae2c-219883deec81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435de5dc26cf44f69b12da8bd9d74454'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:44.688552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-9d02a39b-b482-499b-ae2c-219883deec81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435de5dc26cf44f69b12da8bd9d74454'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:44.695963 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-9d02a39b-b482-499b-ae2c-219883deec81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435de5dc26cf44f69b12da8bd9d74454'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:44.709404 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 969/1942] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:44 2022] DELETE /identity/v3/users/435de5dc26cf44f69b12da8bd9d74454 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:44.713983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f45c-5032-4bb4-bfeb-e5d6ee063507 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:44.714274 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f45c-5032-4bb4-bfeb-e5d6ee063507 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:44.714549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f45c-5032-4bb4-bfeb-e5d6ee063507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:44.731681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-dd18f45c-5032-4bb4-bfeb-e5d6ee063507 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:44.732938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-dd18f45c-5032-4bb4-bfeb-e5d6ee063507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:44.764960 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:44.793742 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 974/1943] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:54:44.803550 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02a39b-b482-499b-ae2c-219883deec81 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:44.805119 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9d02a39b-b482-499b-ae2c-219883deec81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:44.849982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:44.870563 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02a39b-b482-499b-ae2c-219883deec81 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:44.874535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b18600-a79e-4370-b5f4-8335b7c14a1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:44.875281 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b18600-a79e-4370-b5f4-8335b7c14a1b service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:44.875569 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b18600-a79e-4370-b5f4-8335b7c14a1b service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:44.875898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b18600-a79e-4370-b5f4-8335b7c14a1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:44.886323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b18600-a79e-4370-b5f4-8335b7c14a1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:44.887770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b18600-a79e-4370-b5f4-8335b7c14a1b service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:44.898214 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 970/1944] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:45.190706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18f45c-5032-4bb4-bfeb-e5d6ee063507 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:45.192856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-dd18f45c-5032-4bb4-bfeb-e5d6ee063507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:45.212268 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18f45c-5032-4bb4-bfeb-e5d6ee063507 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:45.217617 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570468a-4ffb-4a97-ac51-d83848f96fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:45.218630 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570468a-4ffb-4a97-ac51-d83848f96fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:45.218896 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570468a-4ffb-4a97-ac51-d83848f96fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:45.219213 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570468a-4ffb-4a97-ac51-d83848f96fb5 admin admin] PATH_INFO: `/v3/projects/eac47c383e614cd6be04e937809b28a4` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:45.220551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570468a-4ffb-4a97-ac51-d83848f96fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eac47c383e614cd6be04e937809b28a4)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:45.222555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570468a-4ffb-4a97-ac51-d83848f96fb5 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:45.272120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0570468a-4ffb-4a97-ac51-d83848f96fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eac47c383e614cd6be04e937809b28a4', 'request_id': 'req-0570468a-4ffb-4a97-ac51-d83848f96fb5'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:45.278220 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0570468a-4ffb-4a97-ac51-d83848f96fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eac47c383e614cd6be04e937809b28a4', 'request_id': 'req-0570468a-4ffb-4a97-ac51-d83848f96fb5'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:45.285081 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0570468a-4ffb-4a97-ac51-d83848f96fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eac47c383e614cd6be04e937809b28a4', 'request_id': 'req-0570468a-4ffb-4a97-ac51-d83848f96fb5'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:45.295354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0570468a-4ffb-4a97-ac51-d83848f96fb5 admin admin] The token cache is being invalidate because project eac47c383e614cd6be04e937809b28a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:45.295641 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0570468a-4ffb-4a97-ac51-d83848f96fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:45.296259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0570468a-4ffb-4a97-ac51-d83848f96fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:45.297851 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 975/1945] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:45 2022] DELETE /identity/v3/projects/eac47c383e614cd6be04e937809b28a4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:45.303286 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1ff41-695b-4fc9-a84c-1abc517c785e None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:45.303772 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1ff41-695b-4fc9-a84c-1abc517c785e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:45.303888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1ff41-695b-4fc9-a84c-1abc517c785e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:45.322172 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-9ba1ff41-695b-4fc9-a84c-1abc517c785e None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:45.323668 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9ba1ff41-695b-4fc9-a84c-1abc517c785e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:45.384406 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 971/1946] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:45.392911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11441a-e7ed-4191-81bf-0350262b1305 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:45.393211 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11441a-e7ed-4191-81bf-0350262b1305 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:45.393563 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11441a-e7ed-4191-81bf-0350262b1305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:45.412465 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-ef11441a-e7ed-4191-81bf-0350262b1305 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:45.413754 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ef11441a-e7ed-4191-81bf-0350262b1305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:45.421676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 976/1947] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:45.426403 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1ff41-695b-4fc9-a84c-1abc517c785e None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:45.435993 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1ff41-695b-4fc9-a84c-1abc517c785e None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:45.441241 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18445f-5b95-4f45-a0c1-750b9c720ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:45.441917 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18445f-5b95-4f45-a0c1-750b9c720ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:45.442203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18445f-5b95-4f45-a0c1-750b9c720ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:45.442484 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18445f-5b95-4f45-a0c1-750b9c720ee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:45.443203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18445f-5b95-4f45-a0c1-750b9c720ee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:54:45.443512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18445f-5b95-4f45-a0c1-750b9c720ee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:45.445108 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18445f-5b95-4f45-a0c1-750b9c720ee2 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:45.456677 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 972/1948] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:54:45.460934 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11441a-e7ed-4191-81bf-0350262b1305 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:45.470188 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11441a-e7ed-4191-81bf-0350262b1305 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:45.475056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71702efa-e289-4b30-b91b-a021c9e9c090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:45.475773 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71702efa-e289-4b30-b91b-a021c9e9c090 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:45.476070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71702efa-e289-4b30-b91b-a021c9e9c090 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:45.476349 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71702efa-e289-4b30-b91b-a021c9e9c090 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:45.477031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71702efa-e289-4b30-b91b-a021c9e9c090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:45.478955 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71702efa-e289-4b30-b91b-a021c9e9c090 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:45.508285 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 977/1949] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:45 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:45.516634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18445f-5b95-4f45-a0c1-750b9c720ee2 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:45.527402 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18445f-5b95-4f45-a0c1-750b9c720ee2 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:45.591919 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141dc00e-ef29-491f-8376-0af960176339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:45.592505 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dc00e-ef29-491f-8376-0af960176339 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:45.592787 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dc00e-ef29-491f-8376-0af960176339 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:45.593070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dc00e-ef29-491f-8376-0af960176339 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:45.593789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141dc00e-ef29-491f-8376-0af960176339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:45.595754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141dc00e-ef29-491f-8376-0af960176339 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:45.618120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 973/1950] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:45 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:45.622679 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71702efa-e289-4b30-b91b-a021c9e9c090 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:45.634744 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71702efa-e289-4b30-b91b-a021c9e9c090 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:45.640096 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28db24-e85e-405c-987c-a4c8c2e851b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:45.640796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28db24-e85e-405c-987c-a4c8c2e851b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:45.641131 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28db24-e85e-405c-987c-a4c8c2e851b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:45.641457 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28db24-e85e-405c-987c-a4c8c2e851b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:45.642228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28db24-e85e-405c-987c-a4c8c2e851b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:45.643967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28db24-e85e-405c-987c-a4c8c2e851b0 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:45.665472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 978/1951] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:45.666935 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141dc00e-ef29-491f-8376-0af960176339 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:45.677612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141dc00e-ef29-491f-8376-0af960176339 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:45.682322 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa22386-f2de-443c-a331-54ab61dfb81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:45.682982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa22386-f2de-443c-a331-54ab61dfb81e admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:45.683265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa22386-f2de-443c-a331-54ab61dfb81e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:45.683543 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa22386-f2de-443c-a331-54ab61dfb81e admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:45.684595 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa22386-f2de-443c-a331-54ab61dfb81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:45.685871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa22386-f2de-443c-a331-54ab61dfb81e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:45.696048 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 974/1952] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:45.700142 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28db24-e85e-405c-987c-a4c8c2e851b0 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:45.710088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28db24-e85e-405c-987c-a4c8c2e851b0 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:45.714649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165459f1-8e70-491e-991e-307e251c3044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:45.715519 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165459f1-8e70-491e-991e-307e251c3044 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:45.715801 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165459f1-8e70-491e-991e-307e251c3044 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:45.716363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165459f1-8e70-491e-991e-307e251c3044 admin admin] PATH_INFO: `/v3/projects/dad5524601db4aa69cbfbae55290b60b/users/068b441151dc4334b84d7fffe2bd0285/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:45.731390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165459f1-8e70-491e-991e-307e251c3044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad5524601db4aa69cbfbae55290b60b, user_id=068b441151dc4334b84d7fffe2bd0285, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:45.734047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165459f1-8e70-491e-991e-307e251c3044 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:45.747253 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 979/1953] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:45 2022] PUT /identity/v3/projects/dad5524601db4aa69cbfbae55290b60b/users/068b441151dc4334b84d7fffe2bd0285/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:45.757777 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764fc17-a904-477d-a3ef-f53bd92cd70d None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:45.758065 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764fc17-a904-477d-a3ef-f53bd92cd70d None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:45.758344 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764fc17-a904-477d-a3ef-f53bd92cd70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:45.784196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-1764fc17-a904-477d-a3ef-f53bd92cd70d None None] MFA Rules not processed for user `068b441151dc4334b84d7fffe2bd0285`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:45.785419 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1764fc17-a904-477d-a3ef-f53bd92cd70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:45.816326 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:45.848946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 975/1954] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:45.853442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165459f1-8e70-491e-991e-307e251c3044 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:45.921710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:45.926132 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165459f1-8e70-491e-991e-307e251c3044 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:45.932436 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb6d8c-4d1f-4f83-b044-dcfa3e355ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:45.933251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb6d8c-4d1f-4f83-b044-dcfa3e355ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:45.933774 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb6d8c-4d1f-4f83-b044-dcfa3e355ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:45.934221 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb6d8c-4d1f-4f83-b044-dcfa3e355ef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:45.934939 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb6d8c-4d1f-4f83-b044-dcfa3e355ef9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:45.936824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb6d8c-4d1f-4f83-b044-dcfa3e355ef9 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:45.960731 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 980/1955] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:45 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:45.964694 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764fc17-a904-477d-a3ef-f53bd92cd70d None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:45.975581 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764fc17-a904-477d-a3ef-f53bd92cd70d None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:46.033243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ad1b2-28cf-4f4f-af08-feff9216082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:46.033946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ad1b2-28cf-4f4f-af08-feff9216082a admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:46.034231 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ad1b2-28cf-4f4f-af08-feff9216082a admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:46.034506 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ad1b2-28cf-4f4f-af08-feff9216082a admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:46.035233 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ad1b2-28cf-4f4f-af08-feff9216082a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:46.037171 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ad1b2-28cf-4f4f-af08-feff9216082a admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:46.059764 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 976/1956] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:45 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:46.061080 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb6d8c-4d1f-4f83-b044-dcfa3e355ef9 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:46.072102 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb6d8c-4d1f-4f83-b044-dcfa3e355ef9 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:46.076911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15175dbd-d7f6-48c1-a6a2-21577f8f90ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:46.077886 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15175dbd-d7f6-48c1-a6a2-21577f8f90ce admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:46.078115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15175dbd-d7f6-48c1-a6a2-21577f8f90ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:46.078569 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15175dbd-d7f6-48c1-a6a2-21577f8f90ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:46.080292 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15175dbd-d7f6-48c1-a6a2-21577f8f90ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:46.082797 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15175dbd-d7f6-48c1-a6a2-21577f8f90ce admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:46.100969 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 981/1957] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:46.105209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ad1b2-28cf-4f4f-af08-feff9216082a admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:46.120718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ad1b2-28cf-4f4f-af08-feff9216082a admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:46.127676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15175dbd-d7f6-48c1-a6a2-21577f8f90ce admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:46.127774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c593c-7332-46b6-ab80-fd8313bdd041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:46.128222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c593c-7332-46b6-ab80-fd8313bdd041 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:46.128505 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c593c-7332-46b6-ab80-fd8313bdd041 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:46.128641 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-15175dbd-d7f6-48c1-a6a2-21577f8f90ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:46.128773 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c593c-7332-46b6-ab80-fd8313bdd041 admin admin] PATH_INFO: `/v3/projects/8ab28e02319e4b2dbdcf08570d4caec4/users/e187c7e1c00949d6bd8e18233d3c205a/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:46.141553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15175dbd-d7f6-48c1-a6a2-21577f8f90ce admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:46.146164 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c593c-7332-46b6-ab80-fd8313bdd041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab28e02319e4b2dbdcf08570d4caec4, user_id=e187c7e1c00949d6bd8e18233d3c205a, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:46.146945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47567e-6eb1-4dc7-aede-b0314ee5a4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:46.147815 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47567e-6eb1-4dc7-aede-b0314ee5a4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:46.148098 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47567e-6eb1-4dc7-aede-b0314ee5a4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:46.148374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47567e-6eb1-4dc7-aede-b0314ee5a4bc admin admin] PATH_INFO: `/v3/users/1198c5b7cf43494dbe462c89353fc1af` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:46.148907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c593c-7332-46b6-ab80-fd8313bdd041 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:46.149584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47567e-6eb1-4dc7-aede-b0314ee5a4bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1198c5b7cf43494dbe462c89353fc1af)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:46.151474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47567e-6eb1-4dc7-aede-b0314ee5a4bc admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:46.164304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 977/1958] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:46 2022] PUT /identity/v3/projects/8ab28e02319e4b2dbdcf08570d4caec4/users/e187c7e1c00949d6bd8e18233d3c205a/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:46.168114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c593c-7332-46b6-ab80-fd8313bdd041 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:46.201997 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-db47567e-6eb1-4dc7-aede-b0314ee5a4bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1198c5b7cf43494dbe462c89353fc1af'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:46.202665 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-db47567e-6eb1-4dc7-aede-b0314ee5a4bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1198c5b7cf43494dbe462c89353fc1af'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:46.203280 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-db47567e-6eb1-4dc7-aede-b0314ee5a4bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1198c5b7cf43494dbe462c89353fc1af'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:46.210857 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-db47567e-6eb1-4dc7-aede-b0314ee5a4bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1198c5b7cf43494dbe462c89353fc1af'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:46.220415 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-db47567e-6eb1-4dc7-aede-b0314ee5a4bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1198c5b7cf43494dbe462c89353fc1af'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:46.238727 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c593c-7332-46b6-ab80-fd8313bdd041 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:46.244701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfba63d-3688-40e7-91ea-eb9f15a69562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:46.245613 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfba63d-3688-40e7-91ea-eb9f15a69562 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:46.246107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfba63d-3688-40e7-91ea-eb9f15a69562 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:46.246456 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfba63d-3688-40e7-91ea-eb9f15a69562 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:46.247298 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfba63d-3688-40e7-91ea-eb9f15a69562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:46.248964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfba63d-3688-40e7-91ea-eb9f15a69562 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:46.257286 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 982/1959] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:46 2022] DELETE /identity/v3/users/1198c5b7cf43494dbe462c89353fc1af => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:46.258883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce742ec7-15ee-4a1c-95a0-feb79f99dd0a None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:46.259179 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce742ec7-15ee-4a1c-95a0-feb79f99dd0a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:46.259526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce742ec7-15ee-4a1c-95a0-feb79f99dd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:46.265314 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 978/1960] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:46.267861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfba63d-3688-40e7-91ea-eb9f15a69562 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:46.269927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-edfba63d-3688-40e7-91ea-eb9f15a69562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:46.280502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-ce742ec7-15ee-4a1c-95a0-feb79f99dd0a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:46.281707 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ce742ec7-15ee-4a1c-95a0-feb79f99dd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:46.288058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfba63d-3688-40e7-91ea-eb9f15a69562 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:46.333199 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:46.356120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 983/1961] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:46.366256 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf9c15-be90-4707-bcc0-ecbcab78586b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:46.367069 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce742ec7-15ee-4a1c-95a0-feb79f99dd0a None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:46.367287 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf9c15-be90-4707-bcc0-ecbcab78586b admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:46.367620 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf9c15-be90-4707-bcc0-ecbcab78586b admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:46.367836 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf9c15-be90-4707-bcc0-ecbcab78586b admin admin] PATH_INFO: `/v3/projects/8ab28e02319e4b2dbdcf08570d4caec4/users/e187c7e1c00949d6bd8e18233d3c205a/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:46.370669 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ce742ec7-15ee-4a1c-95a0-feb79f99dd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:46.373109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf9c15-be90-4707-bcc0-ecbcab78586b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab28e02319e4b2dbdcf08570d4caec4, user_id=e187c7e1c00949d6bd8e18233d3c205a, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:46.375776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf9c15-be90-4707-bcc0-ecbcab78586b admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:46.393911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 979/1962] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:46 2022] PUT /identity/v3/projects/8ab28e02319e4b2dbdcf08570d4caec4/users/e187c7e1c00949d6bd8e18233d3c205a/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:46.408008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69a461-296c-4abf-862b-eb2bd709b4ce None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:46.408538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69a461-296c-4abf-862b-eb2bd709b4ce None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:46.409019 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69a461-296c-4abf-862b-eb2bd709b4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:46.443925 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-1b69a461-296c-4abf-862b-eb2bd709b4ce None None] MFA Rules not processed for user `e187c7e1c00949d6bd8e18233d3c205a`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:46.445176 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1b69a461-296c-4abf-862b-eb2bd709b4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:46.446548 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:46.463982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce742ec7-15ee-4a1c-95a0-feb79f99dd0a None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:46.533572 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccd955-07e2-43f8-9882-44aa1a70bd12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:46.534320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccd955-07e2-43f8-9882-44aa1a70bd12 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:46.534675 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccd955-07e2-43f8-9882-44aa1a70bd12 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:46.535028 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccd955-07e2-43f8-9882-44aa1a70bd12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:46.537652 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 980/1963] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:46.550507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69a461-296c-4abf-862b-eb2bd709b4ce None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:46.552790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1b69a461-296c-4abf-862b-eb2bd709b4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:46.605361 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccd955-07e2-43f8-9882-44aa1a70bd12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:46.606848 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccd955-07e2-43f8-9882-44aa1a70bd12 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:46.610875 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69a461-296c-4abf-862b-eb2bd709b4ce None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:46.614573 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5ee2f-4beb-404e-a414-f36fba0247af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:46.615221 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5ee2f-4beb-404e-a414-f36fba0247af service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:46.615502 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5ee2f-4beb-404e-a414-f36fba0247af service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:46.615778 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5ee2f-4beb-404e-a414-f36fba0247af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:46.616698 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 984/1964] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:54:46.617742 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-8ee5ee2f-4beb-404e-a414-f36fba0247af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:46.697965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5ee2f-4beb-404e-a414-f36fba0247af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:46.699673 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5ee2f-4beb-404e-a414-f36fba0247af service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:46.714173 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 981/1965] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:54:46.973885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccd955-07e2-43f8-9882-44aa1a70bd12 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:46.975321 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-72ccd955-07e2-43f8-9882-44aa1a70bd12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:46.997492 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccd955-07e2-43f8-9882-44aa1a70bd12 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:47.005025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aec3a0-0f02-471a-ad48-43bd95fcd59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:47.009838 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aec3a0-0f02-471a-ad48-43bd95fcd59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:47.010350 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aec3a0-0f02-471a-ad48-43bd95fcd59f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:47.010832 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aec3a0-0f02-471a-ad48-43bd95fcd59f admin admin] PATH_INFO: `/v3/projects/f92c599b842d434488a17d0db4afdff1` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:47.012934 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aec3a0-0f02-471a-ad48-43bd95fcd59f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f92c599b842d434488a17d0db4afdff1)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:47.015268 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aec3a0-0f02-471a-ad48-43bd95fcd59f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:47.071123 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c7aec3a0-0f02-471a-ad48-43bd95fcd59f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f92c599b842d434488a17d0db4afdff1', 'request_id': 'req-c7aec3a0-0f02-471a-ad48-43bd95fcd59f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:47.077505 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c7aec3a0-0f02-471a-ad48-43bd95fcd59f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f92c599b842d434488a17d0db4afdff1', 'request_id': 'req-c7aec3a0-0f02-471a-ad48-43bd95fcd59f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:47.085131 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c7aec3a0-0f02-471a-ad48-43bd95fcd59f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f92c599b842d434488a17d0db4afdff1', 'request_id': 'req-c7aec3a0-0f02-471a-ad48-43bd95fcd59f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:47.097232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c7aec3a0-0f02-471a-ad48-43bd95fcd59f admin admin] The token cache is being invalidate because project f92c599b842d434488a17d0db4afdff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:47.097589 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c7aec3a0-0f02-471a-ad48-43bd95fcd59f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:47.098232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c7aec3a0-0f02-471a-ad48-43bd95fcd59f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:47.100046 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 985/1966] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:46 2022] DELETE /identity/v3/projects/f92c599b842d434488a17d0db4afdff1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:47.104821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18892e83-2fc7-4d21-a0f5-28502342216f None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:47.105106 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18892e83-2fc7-4d21-a0f5-28502342216f None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:47.105422 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18892e83-2fc7-4d21-a0f5-28502342216f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:47.123457 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-18892e83-2fc7-4d21-a0f5-28502342216f None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:47.124552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-18892e83-2fc7-4d21-a0f5-28502342216f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:47.129341 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:47.188723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 982/1967] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:47.197897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b638098-8608-4eb1-bc0b-50255c7015dd None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:47.198190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b638098-8608-4eb1-bc0b-50255c7015dd None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:47.198472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b638098-8608-4eb1-bc0b-50255c7015dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:47.216843 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-8b638098-8608-4eb1-bc0b-50255c7015dd None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:47.218077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8b638098-8608-4eb1-bc0b-50255c7015dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:47.226022 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 986/1968] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:47.229952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18892e83-2fc7-4d21-a0f5-28502342216f None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:47.239433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18892e83-2fc7-4d21-a0f5-28502342216f None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:47.243965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce96dd-725c-4068-991a-c3e15ec61811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:47.244605 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce96dd-725c-4068-991a-c3e15ec61811 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:47.244882 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce96dd-725c-4068-991a-c3e15ec61811 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:47.245152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce96dd-725c-4068-991a-c3e15ec61811 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:47.245893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce96dd-725c-4068-991a-c3e15ec61811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:54:47.246193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce96dd-725c-4068-991a-c3e15ec61811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:47.247774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce96dd-725c-4068-991a-c3e15ec61811 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:47.260198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 983/1969] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:54:47.264073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b638098-8608-4eb1-bc0b-50255c7015dd None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:47.273887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b638098-8608-4eb1-bc0b-50255c7015dd None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:47.278421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff400d5-4675-403e-8295-27c04f10f0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:47.279057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff400d5-4675-403e-8295-27c04f10f0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:47.279334 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff400d5-4675-403e-8295-27c04f10f0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:47.279605 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff400d5-4675-403e-8295-27c04f10f0e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:47.280346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff400d5-4675-403e-8295-27c04f10f0e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:47.282521 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff400d5-4675-403e-8295-27c04f10f0e8 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:47.307480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 987/1970] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:47 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:47.311584 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce96dd-725c-4068-991a-c3e15ec61811 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:47.321827 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce96dd-725c-4068-991a-c3e15ec61811 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:47.377763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db27a7-bb05-450b-8578-81c37167b0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:47.378360 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db27a7-bb05-450b-8578-81c37167b0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:47.378613 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db27a7-bb05-450b-8578-81c37167b0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:47.378886 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db27a7-bb05-450b-8578-81c37167b0f9 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:47.379565 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db27a7-bb05-450b-8578-81c37167b0f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:47.381518 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db27a7-bb05-450b-8578-81c37167b0f9 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:47.403808 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 984/1971] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:47 2022] POST /identity/v3/users => generated 303 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:47.407954 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff400d5-4675-403e-8295-27c04f10f0e8 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:47.414732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:47.418777 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff400d5-4675-403e-8295-27c04f10f0e8 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:47.425168 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec89c8-0bf1-4f71-af4f-7ac5199fc31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:47.426056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec89c8-0bf1-4f71-af4f-7ac5199fc31a admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:47.426912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec89c8-0bf1-4f71-af4f-7ac5199fc31a admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:47.426912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec89c8-0bf1-4f71-af4f-7ac5199fc31a admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:47.427879 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec89c8-0bf1-4f71-af4f-7ac5199fc31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:47.429617 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec89c8-0bf1-4f71-af4f-7ac5199fc31a admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:47.451536 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 988/1972] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:47.456556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db27a7-bb05-450b-8578-81c37167b0f9 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:47.468739 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db27a7-bb05-450b-8578-81c37167b0f9 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:47.484548 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b331b-a67c-4787-a96a-558699e05e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:47.485500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b331b-a67c-4787-a96a-558699e05e44 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:47.486113 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b331b-a67c-4787-a96a-558699e05e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:47.486625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b331b-a67c-4787-a96a-558699e05e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:47.487642 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b331b-a67c-4787-a96a-558699e05e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:47.489621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b331b-a67c-4787-a96a-558699e05e44 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:47.504297 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 985/1973] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:47.508174 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec89c8-0bf1-4f71-af4f-7ac5199fc31a admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:47.519131 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec89c8-0bf1-4f71-af4f-7ac5199fc31a admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:47.525209 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fba9b-482e-436c-9d1f-ab3004c39e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:47.526557 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fba9b-482e-436c-9d1f-ab3004c39e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:47.526902 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fba9b-482e-436c-9d1f-ab3004c39e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:47.527386 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fba9b-482e-436c-9d1f-ab3004c39e0f admin admin] PATH_INFO: `/v3/projects/ed93e9f929ce480c82f8a7c3ff661b6e/users/e8afb7751ad9496b8620b190d4d9ecde/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:47.544655 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fba9b-482e-436c-9d1f-ab3004c39e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed93e9f929ce480c82f8a7c3ff661b6e, user_id=e8afb7751ad9496b8620b190d4d9ecde, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:47.547327 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fba9b-482e-436c-9d1f-ab3004c39e0f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:47.565967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 989/1974] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:47 2022] PUT /identity/v3/projects/ed93e9f929ce480c82f8a7c3ff661b6e/users/e8afb7751ad9496b8620b190d4d9ecde/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:47.570787 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfe921-460a-40fe-bb4f-92646cd17e04 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:47.571232 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfe921-460a-40fe-bb4f-92646cd17e04 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:47.571524 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfe921-460a-40fe-bb4f-92646cd17e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:47.594149 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-5fcfe921-460a-40fe-bb4f-92646cd17e04 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:47.596208 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-5fcfe921-460a-40fe-bb4f-92646cd17e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:47.665662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 986/1975] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:54:47.676220 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fba9b-482e-436c-9d1f-ab3004c39e0f admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:47.678010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-383fba9b-482e-436c-9d1f-ab3004c39e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:47.737251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fba9b-482e-436c-9d1f-ab3004c39e0f admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:47.741257 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606a3f6-5412-4102-9c19-17e2c93f7578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:47.741257 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606a3f6-5412-4102-9c19-17e2c93f7578 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:47.741257 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606a3f6-5412-4102-9c19-17e2c93f7578 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:47.741257 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606a3f6-5412-4102-9c19-17e2c93f7578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:47.753975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606a3f6-5412-4102-9c19-17e2c93f7578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:47.755534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606a3f6-5412-4102-9c19-17e2c93f7578 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:47.765604 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 990/1976] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:48.397006 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da1831-c7f5-458f-b745-a03b4e6a7e76 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:48.397497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da1831-c7f5-458f-b745-a03b4e6a7e76 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:48.398647 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da1831-c7f5-458f-b745-a03b4e6a7e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:48.426271 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-14da1831-c7f5-458f-b745-a03b4e6a7e76 None None] MFA Rules not processed for user `e8afb7751ad9496b8620b190d4d9ecde`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:48.427481 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-14da1831-c7f5-458f-b745-a03b4e6a7e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:48.431415 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:48.494991 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 987/1977] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:48 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:48.499492 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606a3f6-5412-4102-9c19-17e2c93f7578 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:48.511062 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606a3f6-5412-4102-9c19-17e2c93f7578 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:48.516554 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da069e93-1d1e-4336-8faa-0c021108c8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:48.517758 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da069e93-1d1e-4336-8faa-0c021108c8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:48.518039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da069e93-1d1e-4336-8faa-0c021108c8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:48.518314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da069e93-1d1e-4336-8faa-0c021108c8d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:48.519001 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da069e93-1d1e-4336-8faa-0c021108c8d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:48.520866 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da069e93-1d1e-4336-8faa-0c021108c8d3 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:48.549041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 991/1978] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:48 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:48.553659 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da1831-c7f5-458f-b745-a03b4e6a7e76 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:48.564666 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da1831-c7f5-458f-b745-a03b4e6a7e76 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:48.622878 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abcd14-8488-408b-9663-929dbab63a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:48.623545 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abcd14-8488-408b-9663-929dbab63a49 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:48.623830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abcd14-8488-408b-9663-929dbab63a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:48.624106 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abcd14-8488-408b-9663-929dbab63a49 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:48.624782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abcd14-8488-408b-9663-929dbab63a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:48.627520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abcd14-8488-408b-9663-929dbab63a49 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:48.650346 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 988/1979] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:48 2022] POST /identity/v3/users => generated 308 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:48.654495 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da069e93-1d1e-4336-8faa-0c021108c8d3 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:48.665028 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da069e93-1d1e-4336-8faa-0c021108c8d3 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:48.669763 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56cac5-b2ce-4869-946e-489896e48731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:48.670509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56cac5-b2ce-4869-946e-489896e48731 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:48.670896 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56cac5-b2ce-4869-946e-489896e48731 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:48.671246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56cac5-b2ce-4869-946e-489896e48731 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:48.672037 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56cac5-b2ce-4869-946e-489896e48731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:48.673735 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56cac5-b2ce-4869-946e-489896e48731 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:48.685160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 992/1980] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:48.689924 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abcd14-8488-408b-9663-929dbab63a49 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:48.700417 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abcd14-8488-408b-9663-929dbab63a49 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:48.705897 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c334871-142a-4dbf-9e9f-5def00f1b79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:48.706778 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c334871-142a-4dbf-9e9f-5def00f1b79b admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:48.707061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c334871-142a-4dbf-9e9f-5def00f1b79b admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:48.707338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c334871-142a-4dbf-9e9f-5def00f1b79b admin admin] PATH_INFO: `/v3/projects/15ac4b63337e44eca5dc951f0eee6652/users/acb76fdaf5b34fe19ecd03b2120fb0b1/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:48.724626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c334871-142a-4dbf-9e9f-5def00f1b79b admin admin] RBAC: Authorizing `identity:create_grant(project_id=15ac4b63337e44eca5dc951f0eee6652, user_id=acb76fdaf5b34fe19ecd03b2120fb0b1, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:48.727565 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c334871-142a-4dbf-9e9f-5def00f1b79b admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:48.742300 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 989/1981] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:48 2022] PUT /identity/v3/projects/15ac4b63337e44eca5dc951f0eee6652/users/acb76fdaf5b34fe19ecd03b2120fb0b1/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:48.746337 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56cac5-b2ce-4869-946e-489896e48731 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:48.757790 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56cac5-b2ce-4869-946e-489896e48731 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:48.816461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4912d8-e20f-4bf4-93e8-7a8eb5fcc8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:48.817124 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4912d8-e20f-4bf4-93e8-7a8eb5fcc8ba admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:48.817468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4912d8-e20f-4bf4-93e8-7a8eb5fcc8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:48.817851 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4912d8-e20f-4bf4-93e8-7a8eb5fcc8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:48.818452 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4912d8-e20f-4bf4-93e8-7a8eb5fcc8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:48.820043 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4912d8-e20f-4bf4-93e8-7a8eb5fcc8ba admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:48.830483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 993/1982] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:48.834710 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c334871-142a-4dbf-9e9f-5def00f1b79b admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:48.845098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c334871-142a-4dbf-9e9f-5def00f1b79b admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:48.849912 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636e6f8-5623-47b6-9ac6-e883fb21a5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:48.850921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636e6f8-5623-47b6-9ac6-e883fb21a5f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:48.851201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636e6f8-5623-47b6-9ac6-e883fb21a5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:48.851472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636e6f8-5623-47b6-9ac6-e883fb21a5f1 admin admin] PATH_INFO: `/v3/projects/15ac4b63337e44eca5dc951f0eee6652/users/acb76fdaf5b34fe19ecd03b2120fb0b1/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:48.853458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636e6f8-5623-47b6-9ac6-e883fb21a5f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15ac4b63337e44eca5dc951f0eee6652, user_id=acb76fdaf5b34fe19ecd03b2120fb0b1, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:48.856132 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636e6f8-5623-47b6-9ac6-e883fb21a5f1 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:48.867959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 990/1983] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:48 2022] PUT /identity/v3/projects/15ac4b63337e44eca5dc951f0eee6652/users/acb76fdaf5b34fe19ecd03b2120fb0b1/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:49.353953 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4912d8-e20f-4bf4-93e8-7a8eb5fcc8ba admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:49.356020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-4d4912d8-e20f-4bf4-93e8-7a8eb5fcc8ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:49.369332 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4912d8-e20f-4bf4-93e8-7a8eb5fcc8ba admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:49.420423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:49.451130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6e3dc-53ee-4a17-b316-c22c429fc293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:49.452015 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6e3dc-53ee-4a17-b316-c22c429fc293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:49.452236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6e3dc-53ee-4a17-b316-c22c429fc293 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:49.452480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6e3dc-53ee-4a17-b316-c22c429fc293 admin admin] PATH_INFO: `/v3/users/068b441151dc4334b84d7fffe2bd0285` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:49.454134 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6e3dc-53ee-4a17-b316-c22c429fc293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=068b441151dc4334b84d7fffe2bd0285)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:49.455898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6e3dc-53ee-4a17-b316-c22c429fc293 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:49.516543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b3d6e3dc-53ee-4a17-b316-c22c429fc293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '068b441151dc4334b84d7fffe2bd0285'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:49.517421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b3d6e3dc-53ee-4a17-b316-c22c429fc293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '068b441151dc4334b84d7fffe2bd0285'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:49.518058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b3d6e3dc-53ee-4a17-b316-c22c429fc293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '068b441151dc4334b84d7fffe2bd0285'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:49.518187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8fc09-a7f6-45e8-92e1-2ef8cf91df3f None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:49.518555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8fc09-a7f6-45e8-92e1-2ef8cf91df3f None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:49.518685 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8fc09-a7f6-45e8-92e1-2ef8cf91df3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:49.531167 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b3d6e3dc-53ee-4a17-b316-c22c429fc293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '068b441151dc4334b84d7fffe2bd0285'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:49.539909 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b3d6e3dc-53ee-4a17-b316-c22c429fc293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '068b441151dc4334b84d7fffe2bd0285'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:49.550072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-3ab8fc09-a7f6-45e8-92e1-2ef8cf91df3f None None] MFA Rules not processed for user `acb76fdaf5b34fe19ecd03b2120fb0b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:49.551845 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-3ab8fc09-a7f6-45e8-92e1-2ef8cf91df3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:49.565756 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 994/1984] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:49 2022] DELETE /identity/v3/users/068b441151dc4334b84d7fffe2bd0285 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:49.571741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a7a2b-567b-48ea-b0ff-55f1cf7bd119 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:49.572212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a7a2b-567b-48ea-b0ff-55f1cf7bd119 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:49.572643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a7a2b-567b-48ea-b0ff-55f1cf7bd119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:49.598019 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-396a7a2b-567b-48ea-b0ff-55f1cf7bd119 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:49.599826 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-396a7a2b-567b-48ea-b0ff-55f1cf7bd119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:49.602571 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:49.656762 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 991/1985] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:49 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:54:49.699225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 995/1986] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:49.709726 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8fc09-a7f6-45e8-92e1-2ef8cf91df3f None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:49.711221 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-3ab8fc09-a7f6-45e8-92e1-2ef8cf91df3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:49.793883 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8fc09-a7f6-45e8-92e1-2ef8cf91df3f None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:49.927539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653e489-8057-458e-82a4-4d3808346d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:49.928226 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653e489-8057-458e-82a4-4d3808346d06 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:49.928512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653e489-8057-458e-82a4-4d3808346d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:49.928788 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653e489-8057-458e-82a4-4d3808346d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:49.940638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653e489-8057-458e-82a4-4d3808346d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:49.942251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653e489-8057-458e-82a4-4d3808346d06 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:49.954499 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 992/1987] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:50.416585 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747a4a7-7747-4032-85ce-1d6e865bc461 None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:50.416912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747a4a7-7747-4032-85ce-1d6e865bc461 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:50.417173 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747a4a7-7747-4032-85ce-1d6e865bc461 None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:50.419605 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 996/1988] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 13:54:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:54:50.435051 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1978a-1922-4bd1-9094-9124832ddf2a None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:50.435350 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1978a-1922-4bd1-9094-9124832ddf2a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:50.435648 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1978a-1922-4bd1-9094-9124832ddf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:50.453775 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-75f1978a-1922-4bd1-9094-9124832ddf2a None None] MFA Rules not processed for user `8b0db68b7fda4da29eb13689f3fd7b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:50.455195 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-75f1978a-1922-4bd1-9094-9124832ddf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:50.523153 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 993/1989] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 13:54:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:50.714042 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747a4a7-7747-4032-85ce-1d6e865bc461 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:50.715789 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7747a4a7-7747-4032-85ce-1d6e865bc461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:50.738680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747a4a7-7747-4032-85ce-1d6e865bc461 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:50.743816 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed62cf8-149e-485b-b9eb-d735a0b8c2ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0db68b7fda4da29eb13689f3fd7b5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:50.744503 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed62cf8-149e-485b-b9eb-d735a0b8c2ed service placement] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:50.744781 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed62cf8-149e-485b-b9eb-d735a0b8c2ed service placement] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:50.745061 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed62cf8-149e-485b-b9eb-d735a0b8c2ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:50.763439 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed62cf8-149e-485b-b9eb-d735a0b8c2ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:50.765046 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed62cf8-149e-485b-b9eb-d735a0b8c2ed service placement] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:50.783503 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 997/1990] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:50.808903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1978a-1922-4bd1-9094-9124832ddf2a None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:50.815991 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-75f1978a-1922-4bd1-9094-9124832ddf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:50.853445 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1978a-1922-4bd1-9094-9124832ddf2a None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:50.859097 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94d114-d463-43f7-aa69-0f6812dd701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:50.859975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94d114-d463-43f7-aa69-0f6812dd701b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:50.860459 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94d114-d463-43f7-aa69-0f6812dd701b admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:50.861256 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94d114-d463-43f7-aa69-0f6812dd701b admin admin] PATH_INFO: `/v3/projects/dad5524601db4aa69cbfbae55290b60b` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:50.862482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94d114-d463-43f7-aa69-0f6812dd701b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad5524601db4aa69cbfbae55290b60b)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:50.865034 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94d114-d463-43f7-aa69-0f6812dd701b admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:50.902761 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:50.917008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6b94d114-d463-43f7-aa69-0f6812dd701b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad5524601db4aa69cbfbae55290b60b', 'request_id': 'req-6b94d114-d463-43f7-aa69-0f6812dd701b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:50.924460 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6b94d114-d463-43f7-aa69-0f6812dd701b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad5524601db4aa69cbfbae55290b60b', 'request_id': 'req-6b94d114-d463-43f7-aa69-0f6812dd701b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:50.930605 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6b94d114-d463-43f7-aa69-0f6812dd701b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad5524601db4aa69cbfbae55290b60b', 'request_id': 'req-6b94d114-d463-43f7-aa69-0f6812dd701b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:50.946768 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6b94d114-d463-43f7-aa69-0f6812dd701b admin admin] The token cache is being invalidate because project dad5524601db4aa69cbfbae55290b60b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:50.947063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6b94d114-d463-43f7-aa69-0f6812dd701b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:50.948168 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6b94d114-d463-43f7-aa69-0f6812dd701b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:50.950393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 994/1991] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:50 2022] DELETE /identity/v3/projects/dad5524601db4aa69cbfbae55290b60b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:50.954593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed62cf8-149e-485b-b9eb-d735a0b8c2ed service placement] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:50.972189 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed62cf8-149e-485b-b9eb-d735a0b8c2ed service placement] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:51.026779 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:51.049666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03402d3b-f95e-4555-b9ba-40e6072db1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:51.050634 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03402d3b-f95e-4555-b9ba-40e6072db1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:51.050995 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03402d3b-f95e-4555-b9ba-40e6072db1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:51.051341 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03402d3b-f95e-4555-b9ba-40e6072db1b4 admin admin] PATH_INFO: `/v3/users/e187c7e1c00949d6bd8e18233d3c205a` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:51.052645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03402d3b-f95e-4555-b9ba-40e6072db1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e187c7e1c00949d6bd8e18233d3c205a)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:51.054733 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03402d3b-f95e-4555-b9ba-40e6072db1b4 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:51.112516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-03402d3b-f95e-4555-b9ba-40e6072db1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e187c7e1c00949d6bd8e18233d3c205a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.113605 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-03402d3b-f95e-4555-b9ba-40e6072db1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e187c7e1c00949d6bd8e18233d3c205a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.115028 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-03402d3b-f95e-4555-b9ba-40e6072db1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e187c7e1c00949d6bd8e18233d3c205a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.123423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-03402d3b-f95e-4555-b9ba-40e6072db1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e187c7e1c00949d6bd8e18233d3c205a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.132949 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-03402d3b-f95e-4555-b9ba-40e6072db1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e187c7e1c00949d6bd8e18233d3c205a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.159398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 998/1992] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:50 2022] DELETE /identity/v3/users/e187c7e1c00949d6bd8e18233d3c205a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:51.323656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94d114-d463-43f7-aa69-0f6812dd701b admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:51.325138 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6b94d114-d463-43f7-aa69-0f6812dd701b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:51.339997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94d114-d463-43f7-aa69-0f6812dd701b admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:51.402888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3669a-3a0a-4773-a698-03b2017d0266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:51.403764 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3669a-3a0a-4773-a698-03b2017d0266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:51.404044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3669a-3a0a-4773-a698-03b2017d0266 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:51.404920 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3669a-3a0a-4773-a698-03b2017d0266 admin admin] PATH_INFO: `/v3/users/e8afb7751ad9496b8620b190d4d9ecde` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:51.406167 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3669a-3a0a-4773-a698-03b2017d0266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8afb7751ad9496b8620b190d4d9ecde)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:51.408800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3669a-3a0a-4773-a698-03b2017d0266 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:51.463413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-45a3669a-3a0a-4773-a698-03b2017d0266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8afb7751ad9496b8620b190d4d9ecde'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.487751 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-45a3669a-3a0a-4773-a698-03b2017d0266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8afb7751ad9496b8620b190d4d9ecde'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.488572 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-45a3669a-3a0a-4773-a698-03b2017d0266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8afb7751ad9496b8620b190d4d9ecde'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.489255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-45a3669a-3a0a-4773-a698-03b2017d0266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8afb7751ad9496b8620b190d4d9ecde'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.497554 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-45a3669a-3a0a-4773-a698-03b2017d0266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8afb7751ad9496b8620b190d4d9ecde'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.523036 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 995/1993] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:51 2022] DELETE /identity/v3/users/e8afb7751ad9496b8620b190d4d9ecde => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:51.560012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03402d3b-f95e-4555-b9ba-40e6072db1b4 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:51.561734 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-03402d3b-f95e-4555-b9ba-40e6072db1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:51.593694 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03402d3b-f95e-4555-b9ba-40e6072db1b4 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:51.658076 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a83ec-11f1-45e4-9af9-34a4ac01c768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:51.659185 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a83ec-11f1-45e4-9af9-34a4ac01c768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:51.659591 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a83ec-11f1-45e4-9af9-34a4ac01c768 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:51.660003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a83ec-11f1-45e4-9af9-34a4ac01c768 admin admin] PATH_INFO: `/v3/projects/8ab28e02319e4b2dbdcf08570d4caec4` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:51.661476 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a83ec-11f1-45e4-9af9-34a4ac01c768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ab28e02319e4b2dbdcf08570d4caec4)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:51.663904 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a83ec-11f1-45e4-9af9-34a4ac01c768 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:51.714374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-172a83ec-11f1-45e4-9af9-34a4ac01c768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ab28e02319e4b2dbdcf08570d4caec4', 'request_id': 'req-172a83ec-11f1-45e4-9af9-34a4ac01c768'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.720556 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-172a83ec-11f1-45e4-9af9-34a4ac01c768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ab28e02319e4b2dbdcf08570d4caec4', 'request_id': 'req-172a83ec-11f1-45e4-9af9-34a4ac01c768'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.728856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-172a83ec-11f1-45e4-9af9-34a4ac01c768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ab28e02319e4b2dbdcf08570d4caec4', 'request_id': 'req-172a83ec-11f1-45e4-9af9-34a4ac01c768'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.731479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:51.741899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-172a83ec-11f1-45e4-9af9-34a4ac01c768 admin admin] The token cache is being invalidate because project 8ab28e02319e4b2dbdcf08570d4caec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:51.742482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-172a83ec-11f1-45e4-9af9-34a4ac01c768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.743355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-172a83ec-11f1-45e4-9af9-34a4ac01c768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.745224 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 999/1994] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:51 2022] DELETE /identity/v3/projects/8ab28e02319e4b2dbdcf08570d4caec4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:51.752340 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8464f7-05da-4bb2-9201-f8fb7eaf48ad None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:51.752843 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8464f7-05da-4bb2-9201-f8fb7eaf48ad None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:51.752950 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8464f7-05da-4bb2-9201-f8fb7eaf48ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:51.773662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a83ec-11f1-45e4-9af9-34a4ac01c768 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:51.774564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-6b8464f7-05da-4bb2-9201-f8fb7eaf48ad None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:51.775388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-172a83ec-11f1-45e4-9af9-34a4ac01c768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:51.775827 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6b8464f7-05da-4bb2-9201-f8fb7eaf48ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:51.820434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:51.843893 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a83ec-11f1-45e4-9af9-34a4ac01c768 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:51.848576 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57fc5f-cbe0-4ec7-b46a-c9c10a3f02d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:51.849318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 996/1995] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:51.849528 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57fc5f-cbe0-4ec7-b46a-c9c10a3f02d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:51.849811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57fc5f-cbe0-4ec7-b46a-c9c10a3f02d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:51.850086 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57fc5f-cbe0-4ec7-b46a-c9c10a3f02d2 admin admin] PATH_INFO: `/v3/projects/ed93e9f929ce480c82f8a7c3ff661b6e` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:51.851287 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57fc5f-cbe0-4ec7-b46a-c9c10a3f02d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed93e9f929ce480c82f8a7c3ff661b6e)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:51.853196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57fc5f-cbe0-4ec7-b46a-c9c10a3f02d2 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:51.856926 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3047dd4-dff0-41e9-824b-443031683f04 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:51.857243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3047dd4-dff0-41e9-824b-443031683f04 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:51.857553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3047dd4-dff0-41e9-824b-443031683f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:51.877747 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-f3047dd4-dff0-41e9-824b-443031683f04 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:51.879474 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f3047dd4-dff0-41e9-824b-443031683f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:51.888194 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 997/1996] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:51.892969 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3047dd4-dff0-41e9-824b-443031683f04 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:51.900260 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-df57fc5f-cbe0-4ec7-b46a-c9c10a3f02d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed93e9f929ce480c82f8a7c3ff661b6e', 'request_id': 'req-df57fc5f-cbe0-4ec7-b46a-c9c10a3f02d2'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.901852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3047dd4-dff0-41e9-824b-443031683f04 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:51.906472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-df57fc5f-cbe0-4ec7-b46a-c9c10a3f02d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed93e9f929ce480c82f8a7c3ff661b6e', 'request_id': 'req-df57fc5f-cbe0-4ec7-b46a-c9c10a3f02d2'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.916273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-df57fc5f-cbe0-4ec7-b46a-c9c10a3f02d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed93e9f929ce480c82f8a7c3ff661b6e', 'request_id': 'req-df57fc5f-cbe0-4ec7-b46a-c9c10a3f02d2'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.929713 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-df57fc5f-cbe0-4ec7-b46a-c9c10a3f02d2 admin admin] The token cache is being invalidate because project ed93e9f929ce480c82f8a7c3ff661b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:51.930172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-df57fc5f-cbe0-4ec7-b46a-c9c10a3f02d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.930991 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-df57fc5f-cbe0-4ec7-b46a-c9c10a3f02d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:51.932576 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1000/1997] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:51 2022] DELETE /identity/v3/projects/ed93e9f929ce480c82f8a7c3ff661b6e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:51.936420 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57fc5f-cbe0-4ec7-b46a-c9c10a3f02d2 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:51.937793 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-df57fc5f-cbe0-4ec7-b46a-c9c10a3f02d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:51.965904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd9584-d347-4073-adcd-f0b896b66176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:51.966647 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd9584-d347-4073-adcd-f0b896b66176 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:51.967038 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd9584-d347-4073-adcd-f0b896b66176 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:51.967444 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd9584-d347-4073-adcd-f0b896b66176 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:51.968602 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd9584-d347-4073-adcd-f0b896b66176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:54:51.968952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd9584-d347-4073-adcd-f0b896b66176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:51.971337 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd9584-d347-4073-adcd-f0b896b66176 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:51.988633 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 998/1998] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:54:51.993152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd9584-d347-4073-adcd-f0b896b66176 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:51.995597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-25cd9584-d347-4073-adcd-f0b896b66176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:52.009400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd9584-d347-4073-adcd-f0b896b66176 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:52.018623 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57fc5f-cbe0-4ec7-b46a-c9c10a3f02d2 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:52.022130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ddb53-0237-4d10-bf69-11c716f8499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:52.022825 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ddb53-0237-4d10-bf69-11c716f8499e admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:52.023111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ddb53-0237-4d10-bf69-11c716f8499e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:52.023288 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e37153-f92e-4e82-b169-1ebb02ae9129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:52.023408 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ddb53-0237-4d10-bf69-11c716f8499e admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:52.024095 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ddb53-0237-4d10-bf69-11c716f8499e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:52.024349 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e37153-f92e-4e82-b169-1ebb02ae9129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:52.024700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e37153-f92e-4e82-b169-1ebb02ae9129 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:52.025041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e37153-f92e-4e82-b169-1ebb02ae9129 admin admin] PATH_INFO: `/v3/users/acb76fdaf5b34fe19ecd03b2120fb0b1` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:52.026047 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ddb53-0237-4d10-bf69-11c716f8499e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:52.026383 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e37153-f92e-4e82-b169-1ebb02ae9129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acb76fdaf5b34fe19ecd03b2120fb0b1)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:52.028373 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e37153-f92e-4e82-b169-1ebb02ae9129 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:52.051360 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:52.052870 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 999/1999] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:51 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:52.057071 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ddb53-0237-4d10-bf69-11c716f8499e admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:52.078720 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-63e37153-f92e-4e82-b169-1ebb02ae9129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acb76fdaf5b34fe19ecd03b2120fb0b1'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:52.079404 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-63e37153-f92e-4e82-b169-1ebb02ae9129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acb76fdaf5b34fe19ecd03b2120fb0b1'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:52.080028 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-63e37153-f92e-4e82-b169-1ebb02ae9129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acb76fdaf5b34fe19ecd03b2120fb0b1'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:52.086769 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-63e37153-f92e-4e82-b169-1ebb02ae9129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acb76fdaf5b34fe19ecd03b2120fb0b1'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:52.094788 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-63e37153-f92e-4e82-b169-1ebb02ae9129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acb76fdaf5b34fe19ecd03b2120fb0b1'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:52.113062 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1001/2000] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:51 2022] DELETE /identity/v3/users/acb76fdaf5b34fe19ecd03b2120fb0b1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:52.121983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ddb53-0237-4d10-bf69-11c716f8499e admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:52.175414 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:52.188554 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb0f07-439a-46f7-9668-5115f9811da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:52.190293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb0f07-439a-46f7-9668-5115f9811da4 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:52.190997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb0f07-439a-46f7-9668-5115f9811da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:52.191662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb0f07-439a-46f7-9668-5115f9811da4 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:52.194055 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb0f07-439a-46f7-9668-5115f9811da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:52.199667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb0f07-439a-46f7-9668-5115f9811da4 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:52.222001 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1000/2001] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:52 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:52.226316 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e37153-f92e-4e82-b169-1ebb02ae9129 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:52.228004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-63e37153-f92e-4e82-b169-1ebb02ae9129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:52.241351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e37153-f92e-4e82-b169-1ebb02ae9129 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:52.245978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54baddf-1a40-4338-94a9-03b7bd7f3a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:52.246641 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54baddf-1a40-4338-94a9-03b7bd7f3a38 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:52.246930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54baddf-1a40-4338-94a9-03b7bd7f3a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:52.247215 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54baddf-1a40-4338-94a9-03b7bd7f3a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:52.247941 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54baddf-1a40-4338-94a9-03b7bd7f3a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:52.249555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54baddf-1a40-4338-94a9-03b7bd7f3a38 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:52.260390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1002/2002] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:52.264597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb0f07-439a-46f7-9668-5115f9811da4 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:52.274650 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb0f07-439a-46f7-9668-5115f9811da4 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:52.279565 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d06a42-0c63-4a0f-bf2d-71d077ae4719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:52.280219 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d06a42-0c63-4a0f-bf2d-71d077ae4719 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:52.280503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d06a42-0c63-4a0f-bf2d-71d077ae4719 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:52.280782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d06a42-0c63-4a0f-bf2d-71d077ae4719 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:52.281561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d06a42-0c63-4a0f-bf2d-71d077ae4719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:52.283279 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d06a42-0c63-4a0f-bf2d-71d077ae4719 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:52.293595 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1001/2003] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:52.298505 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54baddf-1a40-4338-94a9-03b7bd7f3a38 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:52.310578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d06a42-0c63-4a0f-bf2d-71d077ae4719 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:52.316177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-70d06a42-0c63-4a0f-bf2d-71d077ae4719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:52.316931 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54baddf-1a40-4338-94a9-03b7bd7f3a38 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:52.331501 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e96834-24b0-403c-979a-1fd418fcaf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:52.332863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e96834-24b0-403c-979a-1fd418fcaf61 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:52.333103 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e96834-24b0-403c-979a-1fd418fcaf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:52.333481 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e96834-24b0-403c-979a-1fd418fcaf61 admin admin] PATH_INFO: `/v3/projects/db95e3fe3aba40d9a6abeb36275d8b21/users/6ae75a5b5f6e4dd292b5ac939bf07c18/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:52.348675 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d06a42-0c63-4a0f-bf2d-71d077ae4719 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:52.354672 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a16066-107a-404e-8e36-7e9657bf8ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:52.355541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a16066-107a-404e-8e36-7e9657bf8ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:52.355829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a16066-107a-404e-8e36-7e9657bf8ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:52.356109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a16066-107a-404e-8e36-7e9657bf8ef1 admin admin] PATH_INFO: `/v3/projects/15ac4b63337e44eca5dc951f0eee6652` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:52.357452 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a16066-107a-404e-8e36-7e9657bf8ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15ac4b63337e44eca5dc951f0eee6652)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:52.358596 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e96834-24b0-403c-979a-1fd418fcaf61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db95e3fe3aba40d9a6abeb36275d8b21, user_id=6ae75a5b5f6e4dd292b5ac939bf07c18, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:52.359564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a16066-107a-404e-8e36-7e9657bf8ef1 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:52.362622 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e96834-24b0-403c-979a-1fd418fcaf61 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:52.379441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1003/2004] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:52 2022] PUT /identity/v3/projects/db95e3fe3aba40d9a6abeb36275d8b21/users/6ae75a5b5f6e4dd292b5ac939bf07c18/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:52.393058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868f036-d0e3-425f-b7e3-981153d250fc None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:52.393489 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868f036-d0e3-425f-b7e3-981153d250fc None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:52.393904 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868f036-d0e3-425f-b7e3-981153d250fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:52.421483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-39a16066-107a-404e-8e36-7e9657bf8ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15ac4b63337e44eca5dc951f0eee6652', 'request_id': 'req-39a16066-107a-404e-8e36-7e9657bf8ef1'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:52.425609 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-0868f036-d0e3-425f-b7e3-981153d250fc None None] MFA Rules not processed for user `6ae75a5b5f6e4dd292b5ac939bf07c18`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:52.426829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0868f036-d0e3-425f-b7e3-981153d250fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:52.430229 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-39a16066-107a-404e-8e36-7e9657bf8ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15ac4b63337e44eca5dc951f0eee6652', 'request_id': 'req-39a16066-107a-404e-8e36-7e9657bf8ef1'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:52.436933 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-39a16066-107a-404e-8e36-7e9657bf8ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15ac4b63337e44eca5dc951f0eee6652', 'request_id': 'req-39a16066-107a-404e-8e36-7e9657bf8ef1'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:52.450508 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-39a16066-107a-404e-8e36-7e9657bf8ef1 admin admin] The token cache is being invalidate because project 15ac4b63337e44eca5dc951f0eee6652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:52.450795 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-39a16066-107a-404e-8e36-7e9657bf8ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:52.451557 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-39a16066-107a-404e-8e36-7e9657bf8ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:52.453148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1002/2005] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:52 2022] DELETE /identity/v3/projects/15ac4b63337e44eca5dc951f0eee6652 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:52.458185 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a183693-bc13-4a8e-832b-27fff7ffe589 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:52.458961 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a183693-bc13-4a8e-832b-27fff7ffe589 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:52.459312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a183693-bc13-4a8e-832b-27fff7ffe589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:52.478771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-0a183693-bc13-4a8e-832b-27fff7ffe589 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:52.479936 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-0a183693-bc13-4a8e-832b-27fff7ffe589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:52.497460 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1004/2006] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:52.508081 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868f036-d0e3-425f-b7e3-981153d250fc None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:52.509427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0868f036-d0e3-425f-b7e3-981153d250fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:52.546339 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1003/2007] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:54:52.554363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baa4a9-5cdd-47a4-8804-fd342190aca6 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:52.554702 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baa4a9-5cdd-47a4-8804-fd342190aca6 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:52.554994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baa4a9-5cdd-47a4-8804-fd342190aca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:52.566534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868f036-d0e3-425f-b7e3-981153d250fc None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:52.570666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87636c5-d077-444e-b2b5-c84aa11a607c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:52.571306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87636c5-d077-444e-b2b5-c84aa11a607c service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:52.571588 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87636c5-d077-444e-b2b5-c84aa11a607c service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:52.571862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87636c5-d077-444e-b2b5-c84aa11a607c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:52.572459 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-b7baa4a9-5cdd-47a4-8804-fd342190aca6 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:52.573693 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-b7baa4a9-5cdd-47a4-8804-fd342190aca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:52.580511 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87636c5-d077-444e-b2b5-c84aa11a607c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:52.581567 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1004/2008] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:54:52.582034 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87636c5-d077-444e-b2b5-c84aa11a607c service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:52.585535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7baa4a9-5cdd-47a4-8804-fd342190aca6 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:52.585955 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:52.594015 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1005/2009] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:54:52.595973 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7baa4a9-5cdd-47a4-8804-fd342190aca6 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:52.601083 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be01192-4df7-4fe6-a61b-d95fac67c453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:52.601740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be01192-4df7-4fe6-a61b-d95fac67c453 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:52.602026 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be01192-4df7-4fe6-a61b-d95fac67c453 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:52.602308 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be01192-4df7-4fe6-a61b-d95fac67c453 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:52.603036 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be01192-4df7-4fe6-a61b-d95fac67c453 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:54:52.603350 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be01192-4df7-4fe6-a61b-d95fac67c453 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:52.604960 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be01192-4df7-4fe6-a61b-d95fac67c453 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:52.617606 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1005/2010] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:54:52.621779 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87636c5-d077-444e-b2b5-c84aa11a607c service cinder] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:52.632646 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87636c5-d077-444e-b2b5-c84aa11a607c service cinder] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:52.637229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243911f3-d288-400c-8da9-b2cb236a91d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:52.637909 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243911f3-d288-400c-8da9-b2cb236a91d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:52.638196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243911f3-d288-400c-8da9-b2cb236a91d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:52.638476 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243911f3-d288-400c-8da9-b2cb236a91d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:52.639162 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243911f3-d288-400c-8da9-b2cb236a91d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:52.641044 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243911f3-d288-400c-8da9-b2cb236a91d5 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:52.667807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1006/2011] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:52 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:52.671961 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be01192-4df7-4fe6-a61b-d95fac67c453 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:52.683860 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be01192-4df7-4fe6-a61b-d95fac67c453 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:52.731212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:52.767468 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70a5e2-2217-433e-8869-35feb0a8c3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:52.768235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70a5e2-2217-433e-8869-35feb0a8c3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:52.768404 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70a5e2-2217-433e-8869-35feb0a8c3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:52.768681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70a5e2-2217-433e-8869-35feb0a8c3f4 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:52.769647 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70a5e2-2217-433e-8869-35feb0a8c3f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:52.771504 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70a5e2-2217-433e-8869-35feb0a8c3f4 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:52.793508 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1006/2012] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:52 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:52.797219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243911f3-d288-400c-8da9-b2cb236a91d5 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:52.809371 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243911f3-d288-400c-8da9-b2cb236a91d5 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:52.818281 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d94edd-804e-4236-8ef3-e79432a65c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:52.818919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d94edd-804e-4236-8ef3-e79432a65c13 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:52.819295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d94edd-804e-4236-8ef3-e79432a65c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:52.820983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d94edd-804e-4236-8ef3-e79432a65c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:52.821855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d94edd-804e-4236-8ef3-e79432a65c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:52.823452 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d94edd-804e-4236-8ef3-e79432a65c13 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:52.840385 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1007/2013] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:52.842280 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70a5e2-2217-433e-8869-35feb0a8c3f4 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:52.859982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70a5e2-2217-433e-8869-35feb0a8c3f4 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:52.867273 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d3448-643c-455b-827f-0195afcff5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:52.868199 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d3448-643c-455b-827f-0195afcff5ef admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:52.868587 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d3448-643c-455b-827f-0195afcff5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:52.868967 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d3448-643c-455b-827f-0195afcff5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:52.870154 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d3448-643c-455b-827f-0195afcff5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:52.872055 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d3448-643c-455b-827f-0195afcff5ef admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:52.887106 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1007/2014] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:52.890232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d94edd-804e-4236-8ef3-e79432a65c13 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:52.905344 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d94edd-804e-4236-8ef3-e79432a65c13 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:52.911863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88a8e7-0f87-44b2-9af3-b00f39784692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:52.912963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88a8e7-0f87-44b2-9af3-b00f39784692 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:52.913251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88a8e7-0f87-44b2-9af3-b00f39784692 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:52.913560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88a8e7-0f87-44b2-9af3-b00f39784692 admin admin] PATH_INFO: `/v3/projects/6e8fd24970124c0c8a904adf0ebad228/users/3ef02efb9af04353bc5a04091eedc258/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:52.932930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88a8e7-0f87-44b2-9af3-b00f39784692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8fd24970124c0c8a904adf0ebad228, user_id=3ef02efb9af04353bc5a04091eedc258, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:52.936789 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88a8e7-0f87-44b2-9af3-b00f39784692 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:52.956562 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1008/2015] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:52 2022] PUT /identity/v3/projects/6e8fd24970124c0c8a904adf0ebad228/users/3ef02efb9af04353bc5a04091eedc258/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:52.967281 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342321f-0a41-4d7b-b349-e279a819e603 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:52.967521 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342321f-0a41-4d7b-b349-e279a819e603 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:52.967803 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342321f-0a41-4d7b-b349-e279a819e603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:52.999297 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-4342321f-0a41-4d7b-b349-e279a819e603 None None] MFA Rules not processed for user `3ef02efb9af04353bc5a04091eedc258`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:53.000581 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-4342321f-0a41-4d7b-b349-e279a819e603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:53.072184 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1008/2016] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:53.076693 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88a8e7-0f87-44b2-9af3-b00f39784692 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:53.142323 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88a8e7-0f87-44b2-9af3-b00f39784692 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:53.146952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7917727-9798-4e06-9f24-226b6107deca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:53.147605 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7917727-9798-4e06-9f24-226b6107deca admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:53.147885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7917727-9798-4e06-9f24-226b6107deca admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:53.148159 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7917727-9798-4e06-9f24-226b6107deca admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:53.148853 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7917727-9798-4e06-9f24-226b6107deca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:53.150758 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7917727-9798-4e06-9f24-226b6107deca admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:53.174353 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1009/2017] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:53 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:53.178556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342321f-0a41-4d7b-b349-e279a819e603 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:53.190316 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342321f-0a41-4d7b-b349-e279a819e603 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:53.247709 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b25163-e1b2-45e8-bf8b-b5eb4425d8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:53.248428 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b25163-e1b2-45e8-bf8b-b5eb4425d8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:53.248708 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b25163-e1b2-45e8-bf8b-b5eb4425d8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:53.248985 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b25163-e1b2-45e8-bf8b-b5eb4425d8e2 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:53.249755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b25163-e1b2-45e8-bf8b-b5eb4425d8e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:53.252361 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b25163-e1b2-45e8-bf8b-b5eb4425d8e2 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:53.273050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1009/2018] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:53 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:53.277381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7917727-9798-4e06-9f24-226b6107deca admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:53.287509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7917727-9798-4e06-9f24-226b6107deca admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:53.295051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527d5df-c0ba-4ef2-8e56-6f3aab708da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:53.295738 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d5df-c0ba-4ef2-8e56-6f3aab708da1 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:53.296019 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d5df-c0ba-4ef2-8e56-6f3aab708da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:53.296290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d5df-c0ba-4ef2-8e56-6f3aab708da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:53.296999 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527d5df-c0ba-4ef2-8e56-6f3aab708da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:53.298642 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527d5df-c0ba-4ef2-8e56-6f3aab708da1 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:53.309629 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1010/2019] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:53.314438 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b25163-e1b2-45e8-bf8b-b5eb4425d8e2 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:53.324679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b25163-e1b2-45e8-bf8b-b5eb4425d8e2 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:53.330431 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa5900-cea7-42dc-b44d-1a87ead82d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:53.331315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa5900-cea7-42dc-b44d-1a87ead82d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:53.331600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa5900-cea7-42dc-b44d-1a87ead82d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:53.331886 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa5900-cea7-42dc-b44d-1a87ead82d9d admin admin] PATH_INFO: `/v3/projects/fee3bbe00eb14b9c9c5ca661a95261e3/users/7bb277cb53574f09b4ffe10f5dfcc7f5/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:53.347012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa5900-cea7-42dc-b44d-1a87ead82d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee3bbe00eb14b9c9c5ca661a95261e3, user_id=7bb277cb53574f09b4ffe10f5dfcc7f5, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:53.350058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa5900-cea7-42dc-b44d-1a87ead82d9d admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:53.364330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1010/2020] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:53 2022] PUT /identity/v3/projects/fee3bbe00eb14b9c9c5ca661a95261e3/users/7bb277cb53574f09b4ffe10f5dfcc7f5/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:53.368560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527d5df-c0ba-4ef2-8e56-6f3aab708da1 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:53.380909 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527d5df-c0ba-4ef2-8e56-6f3aab708da1 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:53.443683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152202b-ccc4-4042-b01e-89c584a09c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:53.444349 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152202b-ccc4-4042-b01e-89c584a09c08 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:53.444634 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152202b-ccc4-4042-b01e-89c584a09c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:53.444913 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152202b-ccc4-4042-b01e-89c584a09c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:53.445676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152202b-ccc4-4042-b01e-89c584a09c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:53.448267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152202b-ccc4-4042-b01e-89c584a09c08 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:53.459725 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1011/2021] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:53.464234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa5900-cea7-42dc-b44d-1a87ead82d9d admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:53.474865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa5900-cea7-42dc-b44d-1a87ead82d9d admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:53.479624 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e569cf-c50c-441f-924d-9ef751593913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:53.480488 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e569cf-c50c-441f-924d-9ef751593913 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:53.480767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e569cf-c50c-441f-924d-9ef751593913 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:53.481041 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e569cf-c50c-441f-924d-9ef751593913 admin admin] PATH_INFO: `/v3/projects/fee3bbe00eb14b9c9c5ca661a95261e3/users/7bb277cb53574f09b4ffe10f5dfcc7f5/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:53.483067 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e569cf-c50c-441f-924d-9ef751593913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee3bbe00eb14b9c9c5ca661a95261e3, user_id=7bb277cb53574f09b4ffe10f5dfcc7f5, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:53.485901 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e569cf-c50c-441f-924d-9ef751593913 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:53.488892 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:53.498264 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1011/2022] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:53 2022] PUT /identity/v3/projects/fee3bbe00eb14b9c9c5ca661a95261e3/users/7bb277cb53574f09b4ffe10f5dfcc7f5/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:53.511516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b008ad4-a358-47d3-b081-13d5a88fbe05 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:53.511869 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b008ad4-a358-47d3-b081-13d5a88fbe05 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:53.512193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b008ad4-a358-47d3-b081-13d5a88fbe05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:53.535689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:53.544742 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-7b008ad4-a358-47d3-b081-13d5a88fbe05 None None] MFA Rules not processed for user `7bb277cb53574f09b4ffe10f5dfcc7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:53.546333 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7b008ad4-a358-47d3-b081-13d5a88fbe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:53.636342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1012/2023] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:53 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:53.648028 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e569cf-c50c-441f-924d-9ef751593913 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:53.712017 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e569cf-c50c-441f-924d-9ef751593913 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:53.715640 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec067564-9d2c-49d6-bf61-e5f70c88a5f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:53.716280 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec067564-9d2c-49d6-bf61-e5f70c88a5f3 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:53.716561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec067564-9d2c-49d6-bf61-e5f70c88a5f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:53.716835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec067564-9d2c-49d6-bf61-e5f70c88a5f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:53.726065 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec067564-9d2c-49d6-bf61-e5f70c88a5f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:53.727488 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec067564-9d2c-49d6-bf61-e5f70c88a5f3 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:53.737243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1012/2024] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:53 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:54.149557 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b008ad4-a358-47d3-b081-13d5a88fbe05 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:54.221811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b008ad4-a358-47d3-b081-13d5a88fbe05 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:54.226622 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009c9c2-4908-4f56-ab47-d28be3241279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:54.227503 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009c9c2-4908-4f56-ab47-d28be3241279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:54.227793 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009c9c2-4908-4f56-ab47-d28be3241279 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:54.228074 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009c9c2-4908-4f56-ab47-d28be3241279 admin admin] PATH_INFO: `/v3/users/3ef02efb9af04353bc5a04091eedc258` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:54.229323 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009c9c2-4908-4f56-ab47-d28be3241279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef02efb9af04353bc5a04091eedc258)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:54.231229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009c9c2-4908-4f56-ab47-d28be3241279 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:54.279453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0009c9c2-4908-4f56-ab47-d28be3241279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef02efb9af04353bc5a04091eedc258'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:54.280124 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0009c9c2-4908-4f56-ab47-d28be3241279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef02efb9af04353bc5a04091eedc258'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:54.280731 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0009c9c2-4908-4f56-ab47-d28be3241279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef02efb9af04353bc5a04091eedc258'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:54.288492 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0009c9c2-4908-4f56-ab47-d28be3241279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef02efb9af04353bc5a04091eedc258'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:54.296144 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0009c9c2-4908-4f56-ab47-d28be3241279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef02efb9af04353bc5a04091eedc258'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:54.314455 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1013/2025] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:54 2022] DELETE /identity/v3/users/3ef02efb9af04353bc5a04091eedc258 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:54.319166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49669c7-ab32-4d7e-b1a8-82e1d8b9493b None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:54.319608 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49669c7-ab32-4d7e-b1a8-82e1d8b9493b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:54.319871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49669c7-ab32-4d7e-b1a8-82e1d8b9493b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:54.338421 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-b49669c7-ab32-4d7e-b1a8-82e1d8b9493b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:54.339826 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-b49669c7-ab32-4d7e-b1a8-82e1d8b9493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:54.412657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1013/2026] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:54.421087 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009c9c2-4908-4f56-ab47-d28be3241279 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:54.422546 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0009c9c2-4908-4f56-ab47-d28be3241279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:54.440648 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:54.483181 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009c9c2-4908-4f56-ab47-d28be3241279 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:54.486904 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e21987-80a7-4240-88dc-31b049447090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:54.487551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e21987-80a7-4240-88dc-31b049447090 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:54.487835 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e21987-80a7-4240-88dc-31b049447090 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:54.488164 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e21987-80a7-4240-88dc-31b049447090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:54.500860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e21987-80a7-4240-88dc-31b049447090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:54.502607 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e21987-80a7-4240-88dc-31b049447090 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:54.512376 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1014/2027] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:54.901585 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49669c7-ab32-4d7e-b1a8-82e1d8b9493b None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:54.903042 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-b49669c7-ab32-4d7e-b1a8-82e1d8b9493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:54.916103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49669c7-ab32-4d7e-b1a8-82e1d8b9493b None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:54.921352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a7a1d-49d7-4b66-bc3f-17ad1cc88c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:54.922358 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a7a1d-49d7-4b66-bc3f-17ad1cc88c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:54.923210 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a7a1d-49d7-4b66-bc3f-17ad1cc88c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:54.923505 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a7a1d-49d7-4b66-bc3f-17ad1cc88c0c admin admin] PATH_INFO: `/v3/projects/6e8fd24970124c0c8a904adf0ebad228` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:54.925201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a7a1d-49d7-4b66-bc3f-17ad1cc88c0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e8fd24970124c0c8a904adf0ebad228)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:54.927169 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a7a1d-49d7-4b66-bc3f-17ad1cc88c0c admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:54.974342 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-473a7a1d-49d7-4b66-bc3f-17ad1cc88c0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e8fd24970124c0c8a904adf0ebad228', 'request_id': 'req-473a7a1d-49d7-4b66-bc3f-17ad1cc88c0c'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:54.986019 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-473a7a1d-49d7-4b66-bc3f-17ad1cc88c0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e8fd24970124c0c8a904adf0ebad228', 'request_id': 'req-473a7a1d-49d7-4b66-bc3f-17ad1cc88c0c'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:54.991857 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-473a7a1d-49d7-4b66-bc3f-17ad1cc88c0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e8fd24970124c0c8a904adf0ebad228', 'request_id': 'req-473a7a1d-49d7-4b66-bc3f-17ad1cc88c0c'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:55.008347 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-473a7a1d-49d7-4b66-bc3f-17ad1cc88c0c admin admin] The token cache is being invalidate because project 6e8fd24970124c0c8a904adf0ebad228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:55.008637 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-473a7a1d-49d7-4b66-bc3f-17ad1cc88c0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:55.009297 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-473a7a1d-49d7-4b66-bc3f-17ad1cc88c0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:55.010835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1014/2028] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:54 2022] DELETE /identity/v3/projects/6e8fd24970124c0c8a904adf0ebad228 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:55.014933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e21987-80a7-4240-88dc-31b049447090 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:55.025697 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e21987-80a7-4240-88dc-31b049447090 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:55.085704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf7603-08c6-47d1-8b63-24e7901391fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:55.086614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf7603-08c6-47d1-8b63-24e7901391fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:55.086897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf7603-08c6-47d1-8b63-24e7901391fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:55.087171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf7603-08c6-47d1-8b63-24e7901391fb admin admin] PATH_INFO: `/v3/users/7bb277cb53574f09b4ffe10f5dfcc7f5` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:55.088364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf7603-08c6-47d1-8b63-24e7901391fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb277cb53574f09b4ffe10f5dfcc7f5)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:55.090312 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf7603-08c6-47d1-8b63-24e7901391fb admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:55.144661 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-4faf7603-08c6-47d1-8b63-24e7901391fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb277cb53574f09b4ffe10f5dfcc7f5'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:55.145555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-4faf7603-08c6-47d1-8b63-24e7901391fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb277cb53574f09b4ffe10f5dfcc7f5'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:55.146321 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-4faf7603-08c6-47d1-8b63-24e7901391fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb277cb53574f09b4ffe10f5dfcc7f5'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:55.156199 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-4faf7603-08c6-47d1-8b63-24e7901391fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb277cb53574f09b4ffe10f5dfcc7f5'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:55.165141 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-4faf7603-08c6-47d1-8b63-24e7901391fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb277cb53574f09b4ffe10f5dfcc7f5'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:55.183332 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1015/2029] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:55 2022] DELETE /identity/v3/users/7bb277cb53574f09b4ffe10f5dfcc7f5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:55.460609 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a7a1d-49d7-4b66-bc3f-17ad1cc88c0c admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:55.462094 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-473a7a1d-49d7-4b66-bc3f-17ad1cc88c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:55.477659 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a7a1d-49d7-4b66-bc3f-17ad1cc88c0c admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:55.505646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:55.544281 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae734198-b607-45ca-9688-77d7d6a1953b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:55.545140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae734198-b607-45ca-9688-77d7d6a1953b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:55.545455 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae734198-b607-45ca-9688-77d7d6a1953b admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:55.545731 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae734198-b607-45ca-9688-77d7d6a1953b admin admin] PATH_INFO: `/v3/projects/fee3bbe00eb14b9c9c5ca661a95261e3` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:55.546897 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae734198-b607-45ca-9688-77d7d6a1953b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee3bbe00eb14b9c9c5ca661a95261e3)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:55.549428 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae734198-b607-45ca-9688-77d7d6a1953b admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:55.594235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ae734198-b607-45ca-9688-77d7d6a1953b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee3bbe00eb14b9c9c5ca661a95261e3', 'request_id': 'req-ae734198-b607-45ca-9688-77d7d6a1953b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:55.600626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ae734198-b607-45ca-9688-77d7d6a1953b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee3bbe00eb14b9c9c5ca661a95261e3', 'request_id': 'req-ae734198-b607-45ca-9688-77d7d6a1953b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:55.605946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ae734198-b607-45ca-9688-77d7d6a1953b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee3bbe00eb14b9c9c5ca661a95261e3', 'request_id': 'req-ae734198-b607-45ca-9688-77d7d6a1953b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:55.618249 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ae734198-b607-45ca-9688-77d7d6a1953b admin admin] The token cache is being invalidate because project fee3bbe00eb14b9c9c5ca661a95261e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:55.618534 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ae734198-b607-45ca-9688-77d7d6a1953b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:55.619150 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ae734198-b607-45ca-9688-77d7d6a1953b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:55.620643 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1015/2030] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:55 2022] DELETE /identity/v3/projects/fee3bbe00eb14b9c9c5ca661a95261e3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:55.625666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb16545-b9f1-4247-837b-13bf186ecfc6 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:55.625994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb16545-b9f1-4247-837b-13bf186ecfc6 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:55.627477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb16545-b9f1-4247-837b-13bf186ecfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:55.645323 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-feb16545-b9f1-4247-837b-13bf186ecfc6 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:55.646519 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-feb16545-b9f1-4247-837b-13bf186ecfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:55.684747 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:55.706689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1016/2031] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:55.714110 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8b9b5-1e74-4410-bd15-fcaca5248d62 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:55.714469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8b9b5-1e74-4410-bd15-fcaca5248d62 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:55.714815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8b9b5-1e74-4410-bd15-fcaca5248d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:55.725676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb16545-b9f1-4247-837b-13bf186ecfc6 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:55.727071 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-feb16545-b9f1-4247-837b-13bf186ecfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:55.734008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-1cc8b9b5-1e74-4410-bd15-fcaca5248d62 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:55.735922 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1cc8b9b5-1e74-4410-bd15-fcaca5248d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:55.742871 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb16545-b9f1-4247-837b-13bf186ecfc6 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:55.747672 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1016/2032] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:55.750858 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926e65c-a016-42a4-8f7e-1cecc5e32e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:55.750858 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926e65c-a016-42a4-8f7e-1cecc5e32e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:55.750858 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926e65c-a016-42a4-8f7e-1cecc5e32e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:55.750858 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926e65c-a016-42a4-8f7e-1cecc5e32e14 admin admin] PATH_INFO: `/v3/users/6ae75a5b5f6e4dd292b5ac939bf07c18` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:55.752166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8b9b5-1e74-4410-bd15-fcaca5248d62 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:55.752774 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926e65c-a016-42a4-8f7e-1cecc5e32e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae75a5b5f6e4dd292b5ac939bf07c18)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:55.755372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926e65c-a016-42a4-8f7e-1cecc5e32e14 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:55.764023 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8b9b5-1e74-4410-bd15-fcaca5248d62 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:55.770656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f566243-0cbf-4ec5-a47c-9f907cac72df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:55.773705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f566243-0cbf-4ec5-a47c-9f907cac72df admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:55.773705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f566243-0cbf-4ec5-a47c-9f907cac72df admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:55.773705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f566243-0cbf-4ec5-a47c-9f907cac72df admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:55.773705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f566243-0cbf-4ec5-a47c-9f907cac72df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:54:55.773705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f566243-0cbf-4ec5-a47c-9f907cac72df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:55.775212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f566243-0cbf-4ec5-a47c-9f907cac72df admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:55.788562 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1017/2033] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:54:55.793056 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f566243-0cbf-4ec5-a47c-9f907cac72df admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:55.803582 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f566243-0cbf-4ec5-a47c-9f907cac72df admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:55.809213 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ade40-074b-4ce4-9938-50d8e8c0fbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:55.809916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ade40-074b-4ce4-9938-50d8e8c0fbb0 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:55.810199 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ade40-074b-4ce4-9938-50d8e8c0fbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:55.810415 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5926e65c-a016-42a4-8f7e-1cecc5e32e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae75a5b5f6e4dd292b5ac939bf07c18'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:55.810530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ade40-074b-4ce4-9938-50d8e8c0fbb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:55.811072 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5926e65c-a016-42a4-8f7e-1cecc5e32e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae75a5b5f6e4dd292b5ac939bf07c18'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:55.811171 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ade40-074b-4ce4-9938-50d8e8c0fbb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:55.811675 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5926e65c-a016-42a4-8f7e-1cecc5e32e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae75a5b5f6e4dd292b5ac939bf07c18'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:55.813027 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ade40-074b-4ce4-9938-50d8e8c0fbb0 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:55.818479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5926e65c-a016-42a4-8f7e-1cecc5e32e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae75a5b5f6e4dd292b5ac939bf07c18'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:55.827032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5926e65c-a016-42a4-8f7e-1cecc5e32e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae75a5b5f6e4dd292b5ac939bf07c18'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:55.846052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1018/2034] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:55 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:55.847048 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ade40-074b-4ce4-9938-50d8e8c0fbb0 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:55.848118 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1017/2035] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:54:55 2022] DELETE /identity/v3/users/6ae75a5b5f6e4dd292b5ac939bf07c18 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:55.849889 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-616ade40-074b-4ce4-9938-50d8e8c0fbb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:55.852361 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2f74f-b88c-43c7-87cc-ebf880fd62d1 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:55.852674 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2f74f-b88c-43c7-87cc-ebf880fd62d1 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:55.852982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2f74f-b88c-43c7-87cc-ebf880fd62d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:55.869955 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-7ba2f74f-b88c-43c7-87cc-ebf880fd62d1 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:55.871146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7ba2f74f-b88c-43c7-87cc-ebf880fd62d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:55.917037 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ade40-074b-4ce4-9938-50d8e8c0fbb0 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:55.930355 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:55.931645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1018/2036] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:54:55.944054 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2f74f-b88c-43c7-87cc-ebf880fd62d1 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:55.946246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7ba2f74f-b88c-43c7-87cc-ebf880fd62d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:55.987192 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8c0ba-3adb-46f5-8c17-0e57485b331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:55.987857 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8c0ba-3adb-46f5-8c17-0e57485b331b admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:55.988265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8c0ba-3adb-46f5-8c17-0e57485b331b admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:55.988747 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8c0ba-3adb-46f5-8c17-0e57485b331b admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:55.989749 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8c0ba-3adb-46f5-8c17-0e57485b331b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:55.992795 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8c0ba-3adb-46f5-8c17-0e57485b331b admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:56.008584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2f74f-b88c-43c7-87cc-ebf880fd62d1 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:56.014114 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8d285-6a3a-4884-9ce6-67b1eeeae829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:56.014820 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8d285-6a3a-4884-9ce6-67b1eeeae829 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:56.015059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8d285-6a3a-4884-9ce6-67b1eeeae829 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:56.015326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8d285-6a3a-4884-9ce6-67b1eeeae829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:56.022470 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:56.030249 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1019/2037] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:55 2022] POST /identity/v3/users => generated 282 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:56.030410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8d285-6a3a-4884-9ce6-67b1eeeae829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:56.031826 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8d285-6a3a-4884-9ce6-67b1eeeae829 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:56.034887 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8c0ba-3adb-46f5-8c17-0e57485b331b admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:56.044046 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1019/2038] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:54:56.047252 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8c0ba-3adb-46f5-8c17-0e57485b331b admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:56.052779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ef0fc-2721-4f85-ab46-9dbe1c20b874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:56.053483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ef0fc-2721-4f85-ab46-9dbe1c20b874 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:56.053767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ef0fc-2721-4f85-ab46-9dbe1c20b874 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:56.054045 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ef0fc-2721-4f85-ab46-9dbe1c20b874 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:56.054865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ef0fc-2721-4f85-ab46-9dbe1c20b874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:56.056470 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ef0fc-2721-4f85-ab46-9dbe1c20b874 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:56.070463 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1020/2039] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:56.071651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8d285-6a3a-4884-9ce6-67b1eeeae829 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:56.082046 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8d285-6a3a-4884-9ce6-67b1eeeae829 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:56.087184 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02014cde-f13d-47b4-8115-094cff5e4730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:56.087909 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02014cde-f13d-47b4-8115-094cff5e4730 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:56.088360 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02014cde-f13d-47b4-8115-094cff5e4730 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:56.088599 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02014cde-f13d-47b4-8115-094cff5e4730 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:56.089449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02014cde-f13d-47b4-8115-094cff5e4730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:56.091159 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02014cde-f13d-47b4-8115-094cff5e4730 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:56.102422 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1020/2040] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:56.106406 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ef0fc-2721-4f85-ab46-9dbe1c20b874 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:56.116597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ef0fc-2721-4f85-ab46-9dbe1c20b874 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:56.121482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ded2f5-a59c-47cc-b7b4-e6421c315569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:56.122401 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ded2f5-a59c-47cc-b7b4-e6421c315569 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:56.122665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ded2f5-a59c-47cc-b7b4-e6421c315569 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:56.122937 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ded2f5-a59c-47cc-b7b4-e6421c315569 admin admin] PATH_INFO: `/v3/projects/7a3199797090475e96e9bd67b0b1c3eb/users/593663c32b2149bf9c80043e55310c57/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:56.139094 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ded2f5-a59c-47cc-b7b4-e6421c315569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3199797090475e96e9bd67b0b1c3eb, user_id=593663c32b2149bf9c80043e55310c57, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:56.142341 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ded2f5-a59c-47cc-b7b4-e6421c315569 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:56.155622 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1021/2041] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:56 2022] PUT /identity/v3/projects/7a3199797090475e96e9bd67b0b1c3eb/users/593663c32b2149bf9c80043e55310c57/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:56.166410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89949d-e601-428e-a5bf-28f447a76f5b None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:56.166924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89949d-e601-428e-a5bf-28f447a76f5b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:56.167005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89949d-e601-428e-a5bf-28f447a76f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:56.197705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-8f89949d-e601-428e-a5bf-28f447a76f5b None None] MFA Rules not processed for user `593663c32b2149bf9c80043e55310c57`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:56.199088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8f89949d-e601-428e-a5bf-28f447a76f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:56.281684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1021/2042] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:56.286255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ded2f5-a59c-47cc-b7b4-e6421c315569 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:56.348544 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ded2f5-a59c-47cc-b7b4-e6421c315569 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:56.353373 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f75d0-f752-4dae-9031-34c834b8dd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:56.354105 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f75d0-f752-4dae-9031-34c834b8dd30 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:56.355008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f75d0-f752-4dae-9031-34c834b8dd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:56.355295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f75d0-f752-4dae-9031-34c834b8dd30 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:56.355996 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f75d0-f752-4dae-9031-34c834b8dd30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:56.357961 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f75d0-f752-4dae-9031-34c834b8dd30 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:56.387172 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1022/2043] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:56 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:54:56.391301 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89949d-e601-428e-a5bf-28f447a76f5b None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:56.405111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f75d0-f752-4dae-9031-34c834b8dd30 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:56.406291 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89949d-e601-428e-a5bf-28f447a76f5b None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:56.407218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e86f75d0-f752-4dae-9031-34c834b8dd30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:56.472980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e5cad-c8b2-46a5-bf8d-e20b03c5d19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:56.473776 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e5cad-c8b2-46a5-bf8d-e20b03c5d19e admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:56.474122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e5cad-c8b2-46a5-bf8d-e20b03c5d19e admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:56.474464 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e5cad-c8b2-46a5-bf8d-e20b03c5d19e admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:56.475142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:56.475623 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e5cad-c8b2-46a5-bf8d-e20b03c5d19e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:56.477158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e5cad-c8b2-46a5-bf8d-e20b03c5d19e admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:56.479728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f75d0-f752-4dae-9031-34c834b8dd30 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:56.486931 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91813875-ee6d-4654-b805-0e5bfd307893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:56.488174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91813875-ee6d-4654-b805-0e5bfd307893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:56.488499 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91813875-ee6d-4654-b805-0e5bfd307893 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:56.488888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91813875-ee6d-4654-b805-0e5bfd307893 admin admin] PATH_INFO: `/v3/projects/db95e3fe3aba40d9a6abeb36275d8b21` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:56.490276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91813875-ee6d-4654-b805-0e5bfd307893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db95e3fe3aba40d9a6abeb36275d8b21)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:56.492408 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91813875-ee6d-4654-b805-0e5bfd307893 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:56.499056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1022/2044] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:56 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:56.500060 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e5cad-c8b2-46a5-bf8d-e20b03c5d19e admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:56.510521 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e5cad-c8b2-46a5-bf8d-e20b03c5d19e admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:56.515183 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8ecc0-3beb-4e24-8fdd-d30cd4c84b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:56.515825 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8ecc0-3beb-4e24-8fdd-d30cd4c84b38 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:56.516105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8ecc0-3beb-4e24-8fdd-d30cd4c84b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:56.516379 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8ecc0-3beb-4e24-8fdd-d30cd4c84b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:56.517728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8ecc0-3beb-4e24-8fdd-d30cd4c84b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:56.519274 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8ecc0-3beb-4e24-8fdd-d30cd4c84b38 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:56.529666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1023/2045] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:56.533683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8ecc0-3beb-4e24-8fdd-d30cd4c84b38 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:56.542999 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-91813875-ee6d-4654-b805-0e5bfd307893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db95e3fe3aba40d9a6abeb36275d8b21', 'request_id': 'req-91813875-ee6d-4654-b805-0e5bfd307893'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:56.543553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8ecc0-3beb-4e24-8fdd-d30cd4c84b38 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:56.549875 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-91813875-ee6d-4654-b805-0e5bfd307893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db95e3fe3aba40d9a6abeb36275d8b21', 'request_id': 'req-91813875-ee6d-4654-b805-0e5bfd307893'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:56.555698 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-91813875-ee6d-4654-b805-0e5bfd307893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db95e3fe3aba40d9a6abeb36275d8b21', 'request_id': 'req-91813875-ee6d-4654-b805-0e5bfd307893'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:56.569576 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-91813875-ee6d-4654-b805-0e5bfd307893 admin admin] The token cache is being invalidate because project db95e3fe3aba40d9a6abeb36275d8b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:54:56.569871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-91813875-ee6d-4654-b805-0e5bfd307893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:56.570513 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-91813875-ee6d-4654-b805-0e5bfd307893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:54:56.572076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1023/2046] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:54:56 2022] DELETE /identity/v3/projects/db95e3fe3aba40d9a6abeb36275d8b21 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:56.577074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440445-3ac2-4ce7-b13f-abc3c74e690f None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:56.577427 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440445-3ac2-4ce7-b13f-abc3c74e690f None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:56.577714 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440445-3ac2-4ce7-b13f-abc3c74e690f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:56.590319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:56.595594 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-80440445-3ac2-4ce7-b13f-abc3c74e690f None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:56.596923 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-80440445-3ac2-4ce7-b13f-abc3c74e690f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:56.601449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6628c-81b8-4913-8617-a74c37d5a12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:56.602445 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6628c-81b8-4913-8617-a74c37d5a12a admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:56.602803 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6628c-81b8-4913-8617-a74c37d5a12a admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:56.603151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6628c-81b8-4913-8617-a74c37d5a12a admin admin] PATH_INFO: `/v3/projects/0731c528d383441588b9be5c5bfa4b4a/users/92adcd3867d44d578b2849ac83e0cf58/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:56.605002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1024/2047] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:54:56.613155 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d7e0a-429c-4dac-981f-e2827003b8f8 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:56.613560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d7e0a-429c-4dac-981f-e2827003b8f8 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:56.613763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d7e0a-429c-4dac-981f-e2827003b8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:56.621195 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6628c-81b8-4913-8617-a74c37d5a12a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0731c528d383441588b9be5c5bfa4b4a, user_id=92adcd3867d44d578b2849ac83e0cf58, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:56.624031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6628c-81b8-4913-8617-a74c37d5a12a admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:56.634917 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-2c0d7e0a-429c-4dac-981f-e2827003b8f8 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:56.636134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-2c0d7e0a-429c-4dac-981f-e2827003b8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:56.639980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1024/2048] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:56 2022] PUT /identity/v3/projects/0731c528d383441588b9be5c5bfa4b4a/users/92adcd3867d44d578b2849ac83e0cf58/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:54:56.644032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6628c-81b8-4913-8617-a74c37d5a12a admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:56.646360 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-add6628c-81b8-4913-8617-a74c37d5a12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:56.718415 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6628c-81b8-4913-8617-a74c37d5a12a admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:56.722809 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1025/2049] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:54:56.727288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d7e0a-429c-4dac-981f-e2827003b8f8 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:56.732938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d18c46-0dbc-4a1b-9ce8-4a1bfec0025e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:56.733694 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d18c46-0dbc-4a1b-9ce8-4a1bfec0025e admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:56.734519 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d18c46-0dbc-4a1b-9ce8-4a1bfec0025e admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:56.734808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d18c46-0dbc-4a1b-9ce8-4a1bfec0025e admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:56.735656 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d18c46-0dbc-4a1b-9ce8-4a1bfec0025e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:56.737234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d18c46-0dbc-4a1b-9ce8-4a1bfec0025e admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:56.737847 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d7e0a-429c-4dac-981f-e2827003b8f8 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:56.742702 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0b961-2f2f-4ebb-b5c5-c0e3b6064e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:56.743429 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0b961-2f2f-4ebb-b5c5-c0e3b6064e18 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:56.743789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0b961-2f2f-4ebb-b5c5-c0e3b6064e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:56.744138 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0b961-2f2f-4ebb-b5c5-c0e3b6064e18 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:56.745015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0b961-2f2f-4ebb-b5c5-c0e3b6064e18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:54:56.745242 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0b961-2f2f-4ebb-b5c5-c0e3b6064e18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:56.746898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0b961-2f2f-4ebb-b5c5-c0e3b6064e18 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:56.748575 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1025/2050] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:54:56.753098 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d18c46-0dbc-4a1b-9ce8-4a1bfec0025e admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:56.764067 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1026/2051] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:54:56.764421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d18c46-0dbc-4a1b-9ce8-4a1bfec0025e admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:56.769557 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0b961-2f2f-4ebb-b5c5-c0e3b6064e18 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:56.770113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371bf8a-7827-4347-b842-510535bce39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:56.771109 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371bf8a-7827-4347-b842-510535bce39e admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:56.771498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371bf8a-7827-4347-b842-510535bce39e admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:56.771872 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371bf8a-7827-4347-b842-510535bce39e admin admin] PATH_INFO: `/v3/projects/0731c528d383441588b9be5c5bfa4b4a/users/92adcd3867d44d578b2849ac83e0cf58/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:56.774171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371bf8a-7827-4347-b842-510535bce39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0731c528d383441588b9be5c5bfa4b4a, user_id=92adcd3867d44d578b2849ac83e0cf58, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:56.777150 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371bf8a-7827-4347-b842-510535bce39e admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:56.782201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0b961-2f2f-4ebb-b5c5-c0e3b6064e18 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:56.789711 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1026/2052] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:56 2022] PUT /identity/v3/projects/0731c528d383441588b9be5c5bfa4b4a/users/92adcd3867d44d578b2849ac83e0cf58/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:56.801300 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45732fb0-6afe-468d-9693-27bcdc764947 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:56.801618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45732fb0-6afe-468d-9693-27bcdc764947 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:56.801995 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45732fb0-6afe-468d-9693-27bcdc764947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:56.829912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-45732fb0-6afe-468d-9693-27bcdc764947 None None] MFA Rules not processed for user `92adcd3867d44d578b2849ac83e0cf58`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:56.831190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-45732fb0-6afe-468d-9693-27bcdc764947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:56.847968 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6515938-4c29-4d36-8e10-53b75f043e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:56.848712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6515938-4c29-4d36-8e10-53b75f043e02 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:56.849382 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6515938-4c29-4d36-8e10-53b75f043e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:56.849382 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6515938-4c29-4d36-8e10-53b75f043e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:56.850286 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6515938-4c29-4d36-8e10-53b75f043e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:56.852285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6515938-4c29-4d36-8e10-53b75f043e02 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:56.867047 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:56.885332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1027/2053] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:54:56 2022] POST /identity/v3/projects => generated 399 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:56.889369 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6515938-4c29-4d36-8e10-53b75f043e02 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:56.926595 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1027/2054] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:56.938870 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45732fb0-6afe-468d-9693-27bcdc764947 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:56.940324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-45732fb0-6afe-468d-9693-27bcdc764947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:56.988371 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:56.990263 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6515938-4c29-4d36-8e10-53b75f043e02 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:56.996958 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee17c8-9c20-43ac-9db9-c5e81453d576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:56.997980 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee17c8-9c20-43ac-9db9-c5e81453d576 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:56.998331 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee17c8-9c20-43ac-9db9-c5e81453d576 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:56.998680 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee17c8-9c20-43ac-9db9-c5e81453d576 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:56.999791 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee17c8-9c20-43ac-9db9-c5e81453d576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:57.002426 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45732fb0-6afe-468d-9693-27bcdc764947 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:57.002737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee17c8-9c20-43ac-9db9-c5e81453d576 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:57.029431 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1028/2055] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:54:56 2022] POST /identity/v3/users => generated 300 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:54:57.033907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee17c8-9c20-43ac-9db9-c5e81453d576 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:57.052158 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee17c8-9c20-43ac-9db9-c5e81453d576 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:57.056866 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e6548-fd4b-4f8a-9e6c-9abc5331c0e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:57.057638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e6548-fd4b-4f8a-9e6c-9abc5331c0e7 service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:57.057917 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e6548-fd4b-4f8a-9e6c-9abc5331c0e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:57.058192 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e6548-fd4b-4f8a-9e6c-9abc5331c0e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:57.058373 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f57f3d-c5d7-408f-9a6e-050c9bf03df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:57.059209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f57f3d-c5d7-408f-9a6e-050c9bf03df3 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:57.059826 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f57f3d-c5d7-408f-9a6e-050c9bf03df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:57.060599 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f57f3d-c5d7-408f-9a6e-050c9bf03df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:57.061654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f57f3d-c5d7-408f-9a6e-050c9bf03df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:57.064123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f57f3d-c5d7-408f-9a6e-050c9bf03df3 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:57.080934 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1029/2056] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:57.085323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f57f3d-c5d7-408f-9a6e-050c9bf03df3 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:57.102160 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f57f3d-c5d7-408f-9a6e-050c9bf03df3 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:57.108264 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8dd9d-016a-4a10-8cef-f8fae3ecfeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:57.109026 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8dd9d-016a-4a10-8cef-f8fae3ecfeb9 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:57.109409 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8dd9d-016a-4a10-8cef-f8fae3ecfeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:57.109751 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8dd9d-016a-4a10-8cef-f8fae3ecfeb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:57.110591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8dd9d-016a-4a10-8cef-f8fae3ecfeb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:57.113040 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8dd9d-016a-4a10-8cef-f8fae3ecfeb9 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:57.127270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1030/2057] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:54:57.133135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8dd9d-016a-4a10-8cef-f8fae3ecfeb9 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:57.147941 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8dd9d-016a-4a10-8cef-f8fae3ecfeb9 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:57.155832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b342c0-6983-4e76-a3e1-f7420f0f8e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:57.157006 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b342c0-6983-4e76-a3e1-f7420f0f8e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:57.157476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b342c0-6983-4e76-a3e1-f7420f0f8e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:57.157889 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b342c0-6983-4e76-a3e1-f7420f0f8e29 admin admin] PATH_INFO: `/v3/projects/b4f907cb44e74a70b609bf08845c5731/users/060bc0359d49425789dd5196461632b7/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:57.164519 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e6548-fd4b-4f8a-9e6c-9abc5331c0e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:57.166505 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e6548-fd4b-4f8a-9e6c-9abc5331c0e7 service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:57.184283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1028/2058] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:54:57.193215 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b342c0-6983-4e76-a3e1-f7420f0f8e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f907cb44e74a70b609bf08845c5731, user_id=060bc0359d49425789dd5196461632b7, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:57.195933 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b342c0-6983-4e76-a3e1-f7420f0f8e29 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:57.215431 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1031/2059] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:54:57 2022] PUT /identity/v3/projects/b4f907cb44e74a70b609bf08845c5731/users/060bc0359d49425789dd5196461632b7/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:54:57.228125 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64822f-198e-47f1-8161-ebce4512feec None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:57.228407 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64822f-198e-47f1-8161-ebce4512feec None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:57.228671 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64822f-198e-47f1-8161-ebce4512feec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:57.275249 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-7a64822f-198e-47f1-8161-ebce4512feec None None] MFA Rules not processed for user `060bc0359d49425789dd5196461632b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:54:57.276894 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7a64822f-198e-47f1-8161-ebce4512feec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:57.295633 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b342c0-6983-4e76-a3e1-f7420f0f8e29 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:57.297640 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-76b342c0-6983-4e76-a3e1-f7420f0f8e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:57.365714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1029/2060] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:54:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:54:57.374709 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b342c0-6983-4e76-a3e1-f7420f0f8e29 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:57.377728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64822f-198e-47f1-8161-ebce4512feec None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:54:57.379298 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25972dbc-0cdf-4642-9c01-049b8fa9a00f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:57.379947 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25972dbc-0cdf-4642-9c01-049b8fa9a00f service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:57.380373 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25972dbc-0cdf-4642-9c01-049b8fa9a00f service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:57.380884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25972dbc-0cdf-4642-9c01-049b8fa9a00f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:57.383930 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-25972dbc-0cdf-4642-9c01-049b8fa9a00f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:54:57.389083 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64822f-198e-47f1-8161-ebce4512feec None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:54:57.393765 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e412b-d3f3-4159-bf82-b9fbe5e378e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:54:57.394781 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e412b-d3f3-4159-bf82-b9fbe5e378e5 service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:54:57.395442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e412b-d3f3-4159-bf82-b9fbe5e378e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:54:57.396035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e412b-d3f3-4159-bf82-b9fbe5e378e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:54:57.406573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e412b-d3f3-4159-bf82-b9fbe5e378e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:57.408107 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e412b-d3f3-4159-bf82-b9fbe5e378e5 service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:57.418435 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1030/2061] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:54:57.452137 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:57.464893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25972dbc-0cdf-4642-9c01-049b8fa9a00f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:54:57.466382 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25972dbc-0cdf-4642-9c01-049b8fa9a00f service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:54:57.476113 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1032/2062] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:54:57 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:55:00.615799 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ac41f-9bc8-4667-8a77-3484ef025d37 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:00.616259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ac41f-9bc8-4667-8a77-3484ef025d37 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:00.616368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ac41f-9bc8-4667-8a77-3484ef025d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:00.635043 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-0d7ac41f-9bc8-4667-8a77-3484ef025d37 None None] MFA Rules not processed for user `135410329e56486c8ccb65b1f2d87aca`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:00.636246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0d7ac41f-9bc8-4667-8a77-3484ef025d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:00.655541 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:00.698624 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1031/2063] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 13:55:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:00.742271 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25972dbc-0cdf-4642-9c01-049b8fa9a00f service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:00.743712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-25972dbc-0cdf-4642-9c01-049b8fa9a00f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:00.812020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25972dbc-0cdf-4642-9c01-049b8fa9a00f service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:00.817908 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455d99e-b3d5-4be4-a437-0814be332185 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e517dc43cc6d401e820c65ad4c941386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:00.818755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455d99e-b3d5-4be4-a437-0814be332185 service swift] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:00.819035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455d99e-b3d5-4be4-a437-0814be332185 service swift] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:00.819310 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455d99e-b3d5-4be4-a437-0814be332185 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:00.827618 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455d99e-b3d5-4be4-a437-0814be332185 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:00.829440 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455d99e-b3d5-4be4-a437-0814be332185 service swift] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:00.838198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1033/2064] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 13:55:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 13:55:02.501184 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ac41f-9bc8-4667-8a77-3484ef025d37 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:02.593198 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ac41f-9bc8-4667-8a77-3484ef025d37 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:02.598939 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d743b2-6932-4fe2-9abf-311ba2f12ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:02.599820 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d743b2-6932-4fe2-9abf-311ba2f12ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:02.600100 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d743b2-6932-4fe2-9abf-311ba2f12ada admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:02.600373 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d743b2-6932-4fe2-9abf-311ba2f12ada admin admin] PATH_INFO: `/v3/users/060bc0359d49425789dd5196461632b7` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:02.601836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d743b2-6932-4fe2-9abf-311ba2f12ada admin admin] RBAC: Authorizing `identity:delete_user(user_id=060bc0359d49425789dd5196461632b7)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:02.604746 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d743b2-6932-4fe2-9abf-311ba2f12ada admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:02.670245 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-f4d743b2-6932-4fe2-9abf-311ba2f12ada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '060bc0359d49425789dd5196461632b7'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:02.674102 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-f4d743b2-6932-4fe2-9abf-311ba2f12ada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '060bc0359d49425789dd5196461632b7'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:02.675347 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-f4d743b2-6932-4fe2-9abf-311ba2f12ada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '060bc0359d49425789dd5196461632b7'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:02.695685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-f4d743b2-6932-4fe2-9abf-311ba2f12ada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '060bc0359d49425789dd5196461632b7'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:02.708100 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-f4d743b2-6932-4fe2-9abf-311ba2f12ada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '060bc0359d49425789dd5196461632b7'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:02.738822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1032/2065] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:55:02 2022] DELETE /identity/v3/users/060bc0359d49425789dd5196461632b7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:02.740176 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236e67e-c078-4701-a497-0868202a0cc0 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:02.740695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236e67e-c078-4701-a497-0868202a0cc0 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:02.741314 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236e67e-c078-4701-a497-0868202a0cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:02.762171 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-5236e67e-c078-4701-a497-0868202a0cc0 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:02.763667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-5236e67e-c078-4701-a497-0868202a0cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:02.840324 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1034/2066] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:55:02.850095 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d743b2-6932-4fe2-9abf-311ba2f12ada admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:02.851604 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-f4d743b2-6932-4fe2-9abf-311ba2f12ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:02.964484 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:02.970243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d743b2-6932-4fe2-9abf-311ba2f12ada admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:02.981399 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b7311-5f7d-4cff-9362-f8932b03b41b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:02.983021 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b7311-5f7d-4cff-9362-f8932b03b41b service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:02.983316 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b7311-5f7d-4cff-9362-f8932b03b41b service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:02.984605 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b7311-5f7d-4cff-9362-f8932b03b41b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:03.003632 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b7311-5f7d-4cff-9362-f8932b03b41b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:03.005406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b7311-5f7d-4cff-9362-f8932b03b41b service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:03.018919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1033/2067] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:55:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:55:03.433250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236e67e-c078-4701-a497-0868202a0cc0 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:03.435293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-5236e67e-c078-4701-a497-0868202a0cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:03.453492 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236e67e-c078-4701-a497-0868202a0cc0 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:03.458887 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e10c8b-d4a0-4edc-bc9b-63109cb7efbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:03.459764 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e10c8b-d4a0-4edc-bc9b-63109cb7efbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:03.460047 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e10c8b-d4a0-4edc-bc9b-63109cb7efbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:03.460326 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e10c8b-d4a0-4edc-bc9b-63109cb7efbb admin admin] PATH_INFO: `/v3/projects/b4f907cb44e74a70b609bf08845c5731` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:03.461557 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e10c8b-d4a0-4edc-bc9b-63109cb7efbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f907cb44e74a70b609bf08845c5731)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:03.463488 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e10c8b-d4a0-4edc-bc9b-63109cb7efbb admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:03.517395 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-a1e10c8b-d4a0-4edc-bc9b-63109cb7efbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f907cb44e74a70b609bf08845c5731', 'request_id': 'req-a1e10c8b-d4a0-4edc-bc9b-63109cb7efbb'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:03.524169 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-a1e10c8b-d4a0-4edc-bc9b-63109cb7efbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f907cb44e74a70b609bf08845c5731', 'request_id': 'req-a1e10c8b-d4a0-4edc-bc9b-63109cb7efbb'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:03.532183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-a1e10c8b-d4a0-4edc-bc9b-63109cb7efbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f907cb44e74a70b609bf08845c5731', 'request_id': 'req-a1e10c8b-d4a0-4edc-bc9b-63109cb7efbb'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:03.546663 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-a1e10c8b-d4a0-4edc-bc9b-63109cb7efbb admin admin] The token cache is being invalidate because project b4f907cb44e74a70b609bf08845c5731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:55:03.546946 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-a1e10c8b-d4a0-4edc-bc9b-63109cb7efbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:03.547555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-a1e10c8b-d4a0-4edc-bc9b-63109cb7efbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:03.549646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1035/2068] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:55:03 2022] DELETE /identity/v3/projects/b4f907cb44e74a70b609bf08845c5731 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:04.077760 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b7311-5f7d-4cff-9362-f8932b03b41b service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:04.079905 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-6a5b7311-5f7d-4cff-9362-f8932b03b41b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:04.095538 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b7311-5f7d-4cff-9362-f8932b03b41b service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:04.158860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714de48-4662-42d3-b7bc-17208d9cca67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:04.159652 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714de48-4662-42d3-b7bc-17208d9cca67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:04.160059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714de48-4662-42d3-b7bc-17208d9cca67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:04.160200 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714de48-4662-42d3-b7bc-17208d9cca67 admin admin] PATH_INFO: `/v3/users/2f922ca778814cd68a5b12fd6ba1a28d` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:04.161544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714de48-4662-42d3-b7bc-17208d9cca67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f922ca778814cd68a5b12fd6ba1a28d)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:04.163513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714de48-4662-42d3-b7bc-17208d9cca67 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:04.216666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-1714de48-4662-42d3-b7bc-17208d9cca67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f922ca778814cd68a5b12fd6ba1a28d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:04.217607 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-1714de48-4662-42d3-b7bc-17208d9cca67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f922ca778814cd68a5b12fd6ba1a28d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:04.218206 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-1714de48-4662-42d3-b7bc-17208d9cca67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f922ca778814cd68a5b12fd6ba1a28d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:04.225665 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-1714de48-4662-42d3-b7bc-17208d9cca67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f922ca778814cd68a5b12fd6ba1a28d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:04.234891 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-1714de48-4662-42d3-b7bc-17208d9cca67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f922ca778814cd68a5b12fd6ba1a28d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:04.255516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1034/2069] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:55:04 2022] DELETE /identity/v3/users/2f922ca778814cd68a5b12fd6ba1a28d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:04.260681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3635d2-a3b7-42ff-ac34-1bc87272a83d None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:04.261180 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3635d2-a3b7-42ff-ac34-1bc87272a83d None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:04.261357 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3635d2-a3b7-42ff-ac34-1bc87272a83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:04.269552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:04.285018 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-ad3635d2-a3b7-42ff-ac34-1bc87272a83d None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:04.286707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ad3635d2-a3b7-42ff-ac34-1bc87272a83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:04.365023 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1036/2070] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:04.377025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714de48-4662-42d3-b7bc-17208d9cca67 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:04.378455 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-1714de48-4662-42d3-b7bc-17208d9cca67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:04.506294 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714de48-4662-42d3-b7bc-17208d9cca67 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:04.511547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746ab81-3130-4977-b6f9-f85df01583a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:04.515177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746ab81-3130-4977-b6f9-f85df01583a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:04.515661 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746ab81-3130-4977-b6f9-f85df01583a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:04.516123 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746ab81-3130-4977-b6f9-f85df01583a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:04.528962 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746ab81-3130-4977-b6f9-f85df01583a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:04.530693 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746ab81-3130-4977-b6f9-f85df01583a9 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:04.546718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1035/2071] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:55:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:55:04.668448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3635d2-a3b7-42ff-ac34-1bc87272a83d None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:04.676942 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ad3635d2-a3b7-42ff-ac34-1bc87272a83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:04.693993 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3635d2-a3b7-42ff-ac34-1bc87272a83d None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:04.699528 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba06d9a-1b8b-4972-8cfc-365a98d3c03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:04.700570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba06d9a-1b8b-4972-8cfc-365a98d3c03c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:04.700853 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba06d9a-1b8b-4972-8cfc-365a98d3c03c admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:04.701145 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba06d9a-1b8b-4972-8cfc-365a98d3c03c admin admin] PATH_INFO: `/v3/users/593663c32b2149bf9c80043e55310c57` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:04.702841 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba06d9a-1b8b-4972-8cfc-365a98d3c03c admin admin] RBAC: Authorizing `identity:delete_user(user_id=593663c32b2149bf9c80043e55310c57)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:04.705453 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba06d9a-1b8b-4972-8cfc-365a98d3c03c admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:04.781851 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7ba06d9a-1b8b-4972-8cfc-365a98d3c03c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '593663c32b2149bf9c80043e55310c57'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:04.803556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7ba06d9a-1b8b-4972-8cfc-365a98d3c03c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '593663c32b2149bf9c80043e55310c57'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:04.804573 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7ba06d9a-1b8b-4972-8cfc-365a98d3c03c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '593663c32b2149bf9c80043e55310c57'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:04.805870 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7ba06d9a-1b8b-4972-8cfc-365a98d3c03c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '593663c32b2149bf9c80043e55310c57'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:04.819278 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7ba06d9a-1b8b-4972-8cfc-365a98d3c03c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '593663c32b2149bf9c80043e55310c57'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:04.837102 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1037/2072] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:55:04 2022] DELETE /identity/v3/users/593663c32b2149bf9c80043e55310c57 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:04.843111 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab08e7-fb8b-4fe9-9d5a-587124fe563f None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:04.843602 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab08e7-fb8b-4fe9-9d5a-587124fe563f None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:04.843948 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab08e7-fb8b-4fe9-9d5a-587124fe563f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:04.874546 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-8cab08e7-fb8b-4fe9-9d5a-587124fe563f None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:04.877468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8cab08e7-fb8b-4fe9-9d5a-587124fe563f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:04.888711 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:04.957082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba06d9a-1b8b-4972-8cfc-365a98d3c03c admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:04.958828 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-7ba06d9a-1b8b-4972-8cfc-365a98d3c03c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:05.008350 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1036/2073] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:55:05.023597 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab08e7-fb8b-4fe9-9d5a-587124fe563f None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:05.025399 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8cab08e7-fb8b-4fe9-9d5a-587124fe563f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:05.103363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba06d9a-1b8b-4972-8cfc-365a98d3c03c admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:05.115121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae1a59-01d4-4cdb-b84a-76901bcd366c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:05.120062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae1a59-01d4-4cdb-b84a-76901bcd366c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:05.120618 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae1a59-01d4-4cdb-b84a-76901bcd366c admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:05.121099 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae1a59-01d4-4cdb-b84a-76901bcd366c admin admin] PATH_INFO: `/v3/projects/ba3d23c9b84749ab82fd6f9894061b27` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:05.122635 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae1a59-01d4-4cdb-b84a-76901bcd366c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3d23c9b84749ab82fd6f9894061b27)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:05.124800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae1a59-01d4-4cdb-b84a-76901bcd366c admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:05.158905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:05.160223 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab08e7-fb8b-4fe9-9d5a-587124fe563f None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:05.168363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a40be8-96c3-4c57-9c6d-eb775e3d4510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:05.170404 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a40be8-96c3-4c57-9c6d-eb775e3d4510 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:05.170624 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a40be8-96c3-4c57-9c6d-eb775e3d4510 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:05.172559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a40be8-96c3-4c57-9c6d-eb775e3d4510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:05.188763 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a40be8-96c3-4c57-9c6d-eb775e3d4510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:05.190448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a40be8-96c3-4c57-9c6d-eb775e3d4510 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:05.202612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-27ae1a59-01d4-4cdb-b84a-76901bcd366c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3d23c9b84749ab82fd6f9894061b27', 'request_id': 'req-27ae1a59-01d4-4cdb-b84a-76901bcd366c'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:05.205611 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1037/2074] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:55:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:55:05.217463 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-27ae1a59-01d4-4cdb-b84a-76901bcd366c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3d23c9b84749ab82fd6f9894061b27', 'request_id': 'req-27ae1a59-01d4-4cdb-b84a-76901bcd366c'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:05.225682 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-27ae1a59-01d4-4cdb-b84a-76901bcd366c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3d23c9b84749ab82fd6f9894061b27', 'request_id': 'req-27ae1a59-01d4-4cdb-b84a-76901bcd366c'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:05.245356 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-27ae1a59-01d4-4cdb-b84a-76901bcd366c admin admin] The token cache is being invalidate because project ba3d23c9b84749ab82fd6f9894061b27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:55:05.245356 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-27ae1a59-01d4-4cdb-b84a-76901bcd366c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:05.246015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-27ae1a59-01d4-4cdb-b84a-76901bcd366c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:05.249337 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1038/2075] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:55:04 2022] DELETE /identity/v3/projects/ba3d23c9b84749ab82fd6f9894061b27 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:05.254687 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dc666-170b-4243-aee0-331cf5f0a634 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:05.255398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dc666-170b-4243-aee0-331cf5f0a634 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:05.256139 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dc666-170b-4243-aee0-331cf5f0a634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:05.277928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-1b5dc666-170b-4243-aee0-331cf5f0a634 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:05.279688 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-1b5dc666-170b-4243-aee0-331cf5f0a634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:05.413855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1038/2076] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:05.422251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1f7c0-903c-4eac-9156-a852921ab0a6 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:05.423135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1f7c0-903c-4eac-9156-a852921ab0a6 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:05.423556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1f7c0-903c-4eac-9156-a852921ab0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:05.472144 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-94a1f7c0-903c-4eac-9156-a852921ab0a6 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:05.474388 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-94a1f7c0-903c-4eac-9156-a852921ab0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:05.489318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1039/2077] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:05.493811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dc666-170b-4243-aee0-331cf5f0a634 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:05.507794 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dc666-170b-4243-aee0-331cf5f0a634 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:05.530672 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e90db1-c656-4ad5-9d14-5a27097a462d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:05.531667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e90db1-c656-4ad5-9d14-5a27097a462d admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:05.531938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e90db1-c656-4ad5-9d14-5a27097a462d admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:05.532915 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e90db1-c656-4ad5-9d14-5a27097a462d admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:05.534058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e90db1-c656-4ad5-9d14-5a27097a462d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:55:05.534836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e90db1-c656-4ad5-9d14-5a27097a462d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:05.537975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e90db1-c656-4ad5-9d14-5a27097a462d admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:05.561324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1039/2078] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:55:05.565236 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1f7c0-903c-4eac-9156-a852921ab0a6 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:05.577900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1f7c0-903c-4eac-9156-a852921ab0a6 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:05.594879 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9655a-8db8-445e-bd9f-b81799e83824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:05.598192 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9655a-8db8-445e-bd9f-b81799e83824 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:05.602630 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9655a-8db8-445e-bd9f-b81799e83824 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:05.602630 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9655a-8db8-445e-bd9f-b81799e83824 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:05.602630 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9655a-8db8-445e-bd9f-b81799e83824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:05.607200 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9655a-8db8-445e-bd9f-b81799e83824 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:05.657748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1040/2079] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:55:05 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:55:05.662690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e90db1-c656-4ad5-9d14-5a27097a462d admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:05.675212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e90db1-c656-4ad5-9d14-5a27097a462d admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:05.758919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:05.782808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e12c7-0cd2-4687-a069-0257e7bf8e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:05.784421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e12c7-0cd2-4687-a069-0257e7bf8e98 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:05.784710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e12c7-0cd2-4687-a069-0257e7bf8e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:05.784997 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e12c7-0cd2-4687-a069-0257e7bf8e98 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:05.785775 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e12c7-0cd2-4687-a069-0257e7bf8e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:05.797030 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e12c7-0cd2-4687-a069-0257e7bf8e98 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:05.806106 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9655a-8db8-445e-bd9f-b81799e83824 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:05.809130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9bf9655a-8db8-445e-bd9f-b81799e83824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:05.837585 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1040/2080] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:55:05 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:55:05.842754 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e12c7-0cd2-4687-a069-0257e7bf8e98 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:05.863173 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9655a-8db8-445e-bd9f-b81799e83824 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:05.885697 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e12c7-0cd2-4687-a069-0257e7bf8e98 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:05.888165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476bbb1-dc22-4eb6-ac43-0a1b2c82a225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:05.889160 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476bbb1-dc22-4eb6-ac43-0a1b2c82a225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:05.889701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476bbb1-dc22-4eb6-ac43-0a1b2c82a225 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:05.890116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476bbb1-dc22-4eb6-ac43-0a1b2c82a225 admin admin] PATH_INFO: `/v3/projects/7a3199797090475e96e9bd67b0b1c3eb` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:05.891843 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476bbb1-dc22-4eb6-ac43-0a1b2c82a225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a3199797090475e96e9bd67b0b1c3eb)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:05.895059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476bbb1-dc22-4eb6-ac43-0a1b2c82a225 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:05.917172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9276a9-e29c-40df-a603-02035d3b2fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:05.920100 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9276a9-e29c-40df-a603-02035d3b2fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:05.920440 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9276a9-e29c-40df-a603-02035d3b2fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:05.920728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9276a9-e29c-40df-a603-02035d3b2fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:05.921529 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9276a9-e29c-40df-a603-02035d3b2fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:05.924116 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9276a9-e29c-40df-a603-02035d3b2fd1 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:05.959662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1041/2081] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:55:05.964875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9276a9-e29c-40df-a603-02035d3b2fd1 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:05.994698 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9276a9-e29c-40df-a603-02035d3b2fd1 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:06.007599 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a6d06-ba6b-4a9a-8354-5943600e9595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:06.008471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a6d06-ba6b-4a9a-8354-5943600e9595 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:06.008815 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a6d06-ba6b-4a9a-8354-5943600e9595 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:06.009196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a6d06-ba6b-4a9a-8354-5943600e9595 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:06.010020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a6d06-ba6b-4a9a-8354-5943600e9595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:06.011679 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a6d06-ba6b-4a9a-8354-5943600e9595 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:06.051312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5476bbb1-dc22-4eb6-ac43-0a1b2c82a225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a3199797090475e96e9bd67b0b1c3eb', 'request_id': 'req-5476bbb1-dc22-4eb6-ac43-0a1b2c82a225'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:06.055297 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1042/2082] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:55:06.059536 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a6d06-ba6b-4a9a-8354-5943600e9595 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:06.062330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5476bbb1-dc22-4eb6-ac43-0a1b2c82a225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a3199797090475e96e9bd67b0b1c3eb', 'request_id': 'req-5476bbb1-dc22-4eb6-ac43-0a1b2c82a225'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:06.070865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5476bbb1-dc22-4eb6-ac43-0a1b2c82a225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a3199797090475e96e9bd67b0b1c3eb', 'request_id': 'req-5476bbb1-dc22-4eb6-ac43-0a1b2c82a225'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:06.074240 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a6d06-ba6b-4a9a-8354-5943600e9595 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:06.089468 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5476bbb1-dc22-4eb6-ac43-0a1b2c82a225 admin admin] The token cache is being invalidate because project 7a3199797090475e96e9bd67b0b1c3eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:55:06.090205 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5476bbb1-dc22-4eb6-ac43-0a1b2c82a225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:06.091606 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5476bbb1-dc22-4eb6-ac43-0a1b2c82a225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:06.093775 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1041/2083] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:55:05 2022] DELETE /identity/v3/projects/7a3199797090475e96e9bd67b0b1c3eb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:06.097889 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476bbb1-dc22-4eb6-ac43-0a1b2c82a225 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:06.099305 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-5476bbb1-dc22-4eb6-ac43-0a1b2c82a225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:06.142210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794723b3-9b18-496b-970e-69475c76c958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:06.143133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794723b3-9b18-496b-970e-69475c76c958 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:06.143423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794723b3-9b18-496b-970e-69475c76c958 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:06.143704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794723b3-9b18-496b-970e-69475c76c958 admin admin] PATH_INFO: `/v3/projects/4acd23ff437149cdaeb608ac15a8e079/users/fe8bda31342a4487a9bec404488555cd/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:06.163138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794723b3-9b18-496b-970e-69475c76c958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4acd23ff437149cdaeb608ac15a8e079, user_id=fe8bda31342a4487a9bec404488555cd, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:06.168170 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794723b3-9b18-496b-970e-69475c76c958 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:06.188138 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476bbb1-dc22-4eb6-ac43-0a1b2c82a225 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:06.190404 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1043/2084] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:55:06 2022] PUT /identity/v3/projects/4acd23ff437149cdaeb608ac15a8e079/users/fe8bda31342a4487a9bec404488555cd/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:55:06.206604 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:06.208237 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189c2f7-cbd4-4f46-b690-94b3823f56c2 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:06.208620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189c2f7-cbd4-4f46-b690-94b3823f56c2 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:06.208791 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189c2f7-cbd4-4f46-b690-94b3823f56c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:06.238057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-5189c2f7-cbd4-4f46-b690-94b3823f56c2 None None] MFA Rules not processed for user `fe8bda31342a4487a9bec404488555cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:06.239140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-5189c2f7-cbd4-4f46-b690-94b3823f56c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:06.279060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11936f-8838-479c-ab8d-3b7884ab48aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:06.280562 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11936f-8838-479c-ab8d-3b7884ab48aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:06.281094 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11936f-8838-479c-ab8d-3b7884ab48aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:06.281717 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11936f-8838-479c-ab8d-3b7884ab48aa admin admin] PATH_INFO: `/v3/users/92adcd3867d44d578b2849ac83e0cf58` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:06.284097 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11936f-8838-479c-ab8d-3b7884ab48aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=92adcd3867d44d578b2849ac83e0cf58)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:06.286768 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11936f-8838-479c-ab8d-3b7884ab48aa admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:06.307366 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1044/2085] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:55:06.311945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189c2f7-cbd4-4f46-b690-94b3823f56c2 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:06.313588 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-5189c2f7-cbd4-4f46-b690-94b3823f56c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:06.327983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189c2f7-cbd4-4f46-b690-94b3823f56c2 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:06.333812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9e397-6ff5-4127-9998-e288c777668d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:06.334557 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9e397-6ff5-4127-9998-e288c777668d admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:06.334914 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9e397-6ff5-4127-9998-e288c777668d admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:06.335285 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9e397-6ff5-4127-9998-e288c777668d admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:06.336054 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9e397-6ff5-4127-9998-e288c777668d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:06.338070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9e397-6ff5-4127-9998-e288c777668d admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:06.362760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5e11936f-8838-479c-ab8d-3b7884ab48aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92adcd3867d44d578b2849ac83e0cf58'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:06.368488 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1045/2086] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:55:06 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:55:06.372921 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9e397-6ff5-4127-9998-e288c777668d admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:06.379578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:06.382544 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5e11936f-8838-479c-ab8d-3b7884ab48aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92adcd3867d44d578b2849ac83e0cf58'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:06.383460 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5e11936f-8838-479c-ab8d-3b7884ab48aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92adcd3867d44d578b2849ac83e0cf58'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:06.384221 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5e11936f-8838-479c-ab8d-3b7884ab48aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92adcd3867d44d578b2849ac83e0cf58'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:06.393558 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5e11936f-8838-479c-ab8d-3b7884ab48aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92adcd3867d44d578b2849ac83e0cf58'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:06.413618 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1042/2087] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:55:06 2022] DELETE /identity/v3/users/92adcd3867d44d578b2849ac83e0cf58 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:55:06.462695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9e397-6ff5-4127-9998-e288c777668d admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:06.535042 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6c812-8777-48c8-aa35-476785777d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:06.535827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6c812-8777-48c8-aa35-476785777d63 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:06.536189 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6c812-8777-48c8-aa35-476785777d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:06.536541 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6c812-8777-48c8-aa35-476785777d63 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:06.537349 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6c812-8777-48c8-aa35-476785777d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:06.539357 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6c812-8777-48c8-aa35-476785777d63 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:06.564811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1046/2088] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:55:06 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:55:06.571151 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11936f-8838-479c-ab8d-3b7884ab48aa admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:06.572710 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-5e11936f-8838-479c-ab8d-3b7884ab48aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:06.586190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11936f-8838-479c-ab8d-3b7884ab48aa admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:06.591770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fbaa6-7808-49e1-bc20-69837ca72dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:06.592522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fbaa6-7808-49e1-bc20-69837ca72dac admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:06.592879 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fbaa6-7808-49e1-bc20-69837ca72dac admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:06.593231 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fbaa6-7808-49e1-bc20-69837ca72dac admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:06.594091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fbaa6-7808-49e1-bc20-69837ca72dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:06.595832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fbaa6-7808-49e1-bc20-69837ca72dac admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:06.607644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1043/2089] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:55:06.614217 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6c812-8777-48c8-aa35-476785777d63 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:06.629373 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6c812-8777-48c8-aa35-476785777d63 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:06.636969 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1932143-e8fe-43b5-8566-2ddd2b20074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:06.637913 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1932143-e8fe-43b5-8566-2ddd2b20074d admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:06.638276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1932143-e8fe-43b5-8566-2ddd2b20074d admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:06.638749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1932143-e8fe-43b5-8566-2ddd2b20074d admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:06.639932 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1932143-e8fe-43b5-8566-2ddd2b20074d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:06.642519 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1932143-e8fe-43b5-8566-2ddd2b20074d admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:06.656179 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1047/2090] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:55:06.661940 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fbaa6-7808-49e1-bc20-69837ca72dac admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:06.685621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fbaa6-7808-49e1-bc20-69837ca72dac admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:06.693414 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967febc-27ce-4ca0-a11c-7846f786807d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:06.694676 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967febc-27ce-4ca0-a11c-7846f786807d admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:06.695052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967febc-27ce-4ca0-a11c-7846f786807d admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:06.695536 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967febc-27ce-4ca0-a11c-7846f786807d admin admin] PATH_INFO: `/v3/projects/a95c691561ec44f39cc933f699a6857f/users/deca10f9cd4944a39c7bb4c6059d08ea/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:06.717588 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967febc-27ce-4ca0-a11c-7846f786807d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a95c691561ec44f39cc933f699a6857f, user_id=deca10f9cd4944a39c7bb4c6059d08ea, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:06.726131 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967febc-27ce-4ca0-a11c-7846f786807d admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:06.759972 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1044/2091] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:55:06 2022] PUT /identity/v3/projects/a95c691561ec44f39cc933f699a6857f/users/deca10f9cd4944a39c7bb4c6059d08ea/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:06.769141 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b2852-ec56-4083-a832-f46903097107 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:06.769456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b2852-ec56-4083-a832-f46903097107 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:06.769746 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b2852-ec56-4083-a832-f46903097107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:06.794110 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967febc-27ce-4ca0-a11c-7846f786807d admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:06.801888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-4967febc-27ce-4ca0-a11c-7846f786807d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:06.806292 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-681b2852-ec56-4083-a832-f46903097107 None None] MFA Rules not processed for user `deca10f9cd4944a39c7bb4c6059d08ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:06.807928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-681b2852-ec56-4083-a832-f46903097107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:06.890682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1048/2092] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:06.897816 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b2852-ec56-4083-a832-f46903097107 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:06.919961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:06.961845 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:06.972242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b2852-ec56-4083-a832-f46903097107 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:06.978577 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37154d-9261-4a7d-9ea2-c12d514e4ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:06.979286 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37154d-9261-4a7d-9ea2-c12d514e4ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:06.979600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37154d-9261-4a7d-9ea2-c12d514e4ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:06.979880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37154d-9261-4a7d-9ea2-c12d514e4ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:06.980657 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37154d-9261-4a7d-9ea2-c12d514e4ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:06.982646 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37154d-9261-4a7d-9ea2-c12d514e4ad2 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:06.983744 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967febc-27ce-4ca0-a11c-7846f786807d admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:06.989882 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2163af3-3bfc-47d2-87f7-78657b15a6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:06.991023 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2163af3-3bfc-47d2-87f7-78657b15a6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:06.991354 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2163af3-3bfc-47d2-87f7-78657b15a6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:06.991809 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2163af3-3bfc-47d2-87f7-78657b15a6aa admin admin] PATH_INFO: `/v3/projects/0731c528d383441588b9be5c5bfa4b4a` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:06.993832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2163af3-3bfc-47d2-87f7-78657b15a6aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0731c528d383441588b9be5c5bfa4b4a)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:06.996464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2163af3-3bfc-47d2-87f7-78657b15a6aa admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:07.013413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1049/2093] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:55:06 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:55:07.024326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37154d-9261-4a7d-9ea2-c12d514e4ad2 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:07.089850 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f2163af3-3bfc-47d2-87f7-78657b15a6aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0731c528d383441588b9be5c5bfa4b4a', 'request_id': 'req-f2163af3-3bfc-47d2-87f7-78657b15a6aa'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:07.106250 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37154d-9261-4a7d-9ea2-c12d514e4ad2 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:07.107804 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f2163af3-3bfc-47d2-87f7-78657b15a6aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0731c528d383441588b9be5c5bfa4b4a', 'request_id': 'req-f2163af3-3bfc-47d2-87f7-78657b15a6aa'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:07.128381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f2163af3-3bfc-47d2-87f7-78657b15a6aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0731c528d383441588b9be5c5bfa4b4a', 'request_id': 'req-f2163af3-3bfc-47d2-87f7-78657b15a6aa'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:07.150939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f2163af3-3bfc-47d2-87f7-78657b15a6aa admin admin] The token cache is being invalidate because project 0731c528d383441588b9be5c5bfa4b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:55:07.152533 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f2163af3-3bfc-47d2-87f7-78657b15a6aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:07.160251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f2163af3-3bfc-47d2-87f7-78657b15a6aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:07.164682 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1045/2094] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:55:06 2022] DELETE /identity/v3/projects/0731c528d383441588b9be5c5bfa4b4a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:07.170807 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c4a09-51ea-46d1-987a-0eb101d068f2 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:07.171144 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c4a09-51ea-46d1-987a-0eb101d068f2 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:07.173708 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c4a09-51ea-46d1-987a-0eb101d068f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:07.181113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cd253-6e45-418d-8f95-8d96a8b3a2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:07.181903 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cd253-6e45-418d-8f95-8d96a8b3a2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:07.182379 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cd253-6e45-418d-8f95-8d96a8b3a2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:07.182726 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cd253-6e45-418d-8f95-8d96a8b3a2b0 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:07.183721 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57cd253-6e45-418d-8f95-8d96a8b3a2b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:07.186569 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57cd253-6e45-418d-8f95-8d96a8b3a2b0 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:07.209122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-222c4a09-51ea-46d1-987a-0eb101d068f2 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:07.210551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-222c4a09-51ea-46d1-987a-0eb101d068f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:07.221309 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1050/2095] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:55:07 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:55:07.226334 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cd253-6e45-418d-8f95-8d96a8b3a2b0 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:07.228604 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e57cd253-6e45-418d-8f95-8d96a8b3a2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:07.247082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1046/2096] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:07.249188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bcbbb-f6c5-46bc-8233-87d204fe4551 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:07.251646 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cd253-6e45-418d-8f95-8d96a8b3a2b0 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:07.252072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bcbbb-f6c5-46bc-8233-87d204fe4551 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:07.252522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bcbbb-f6c5-46bc-8233-87d204fe4551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:07.265737 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76684a-7849-4cb1-8065-d96399050445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:07.267079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76684a-7849-4cb1-8065-d96399050445 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:07.267931 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76684a-7849-4cb1-8065-d96399050445 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:07.268292 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76684a-7849-4cb1-8065-d96399050445 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:07.269137 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76684a-7849-4cb1-8065-d96399050445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:07.275150 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76684a-7849-4cb1-8065-d96399050445 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:07.293404 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-966bcbbb-f6c5-46bc-8233-87d204fe4551 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:07.294798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-966bcbbb-f6c5-46bc-8233-87d204fe4551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:07.299599 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1051/2097] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:55:07.302520 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76684a-7849-4cb1-8065-d96399050445 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:07.322911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1047/2098] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:07.323228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76684a-7849-4cb1-8065-d96399050445 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:07.324607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bcbbb-f6c5-46bc-8233-87d204fe4551 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:07.335495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bcbbb-f6c5-46bc-8233-87d204fe4551 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:07.342224 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5d969-8b90-4c82-9d44-92a84ab13b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:07.343022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5d969-8b90-4c82-9d44-92a84ab13b5c admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:07.343559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5d969-8b90-4c82-9d44-92a84ab13b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:07.343900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5d969-8b90-4c82-9d44-92a84ab13b5c admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:07.344219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be03d3a-4e0b-4691-ac3f-416cee3b95ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:07.344851 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5d969-8b90-4c82-9d44-92a84ab13b5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:55:07.345163 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be03d3a-4e0b-4691-ac3f-416cee3b95ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:07.345384 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5d969-8b90-4c82-9d44-92a84ab13b5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:07.345498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be03d3a-4e0b-4691-ac3f-416cee3b95ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:07.345747 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be03d3a-4e0b-4691-ac3f-416cee3b95ae admin admin] PATH_INFO: `/v3/projects/614ea128e5fd4b15917f670cfc7bec77/users/ea3884a562a847ca89ff48f4e0b54303/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:07.348653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5d969-8b90-4c82-9d44-92a84ab13b5c admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:07.370396 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1048/2099] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:55:07.371818 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5d969-8b90-4c82-9d44-92a84ab13b5c admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:07.376907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be03d3a-4e0b-4691-ac3f-416cee3b95ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=614ea128e5fd4b15917f670cfc7bec77, user_id=ea3884a562a847ca89ff48f4e0b54303, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:07.380500 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be03d3a-4e0b-4691-ac3f-416cee3b95ae admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:07.392787 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5d969-8b90-4c82-9d44-92a84ab13b5c admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:07.398567 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1052/2100] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:55:07 2022] PUT /identity/v3/projects/614ea128e5fd4b15917f670cfc7bec77/users/ea3884a562a847ca89ff48f4e0b54303/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:07.402632 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be03d3a-4e0b-4691-ac3f-416cee3b95ae admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:07.409479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:07.476229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be03d3a-4e0b-4691-ac3f-416cee3b95ae admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:07.483867 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de4fb6-e94b-449b-94df-8888d242eac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:07.485543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de4fb6-e94b-449b-94df-8888d242eac4 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:07.486259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de4fb6-e94b-449b-94df-8888d242eac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:07.487130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de4fb6-e94b-449b-94df-8888d242eac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:07.488614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de4fb6-e94b-449b-94df-8888d242eac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:07.491517 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de4fb6-e94b-449b-94df-8888d242eac4 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:07.500161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f6368-edfa-445d-8ed6-665f0f975740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:07.500994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f6368-edfa-445d-8ed6-665f0f975740 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:07.501589 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f6368-edfa-445d-8ed6-665f0f975740 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:07.501910 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f6368-edfa-445d-8ed6-665f0f975740 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:07.502857 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f6368-edfa-445d-8ed6-665f0f975740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:07.505471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f6368-edfa-445d-8ed6-665f0f975740 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:07.506237 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1053/2101] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:55:07.507109 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de4fb6-e94b-449b-94df-8888d242eac4 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:07.519468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de4fb6-e94b-449b-94df-8888d242eac4 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:07.525001 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8a2f2-f58f-4bb0-8ea4-8c7cf3432770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:07.525938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8a2f2-f58f-4bb0-8ea4-8c7cf3432770 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:07.526224 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8a2f2-f58f-4bb0-8ea4-8c7cf3432770 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:07.526507 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8a2f2-f58f-4bb0-8ea4-8c7cf3432770 admin admin] PATH_INFO: `/v3/projects/614ea128e5fd4b15917f670cfc7bec77/users/ea3884a562a847ca89ff48f4e0b54303/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:07.529098 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8a2f2-f58f-4bb0-8ea4-8c7cf3432770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=614ea128e5fd4b15917f670cfc7bec77, user_id=ea3884a562a847ca89ff48f4e0b54303, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:07.532790 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8a2f2-f58f-4bb0-8ea4-8c7cf3432770 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:07.544696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1054/2102] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:55:07 2022] PUT /identity/v3/projects/614ea128e5fd4b15917f670cfc7bec77/users/ea3884a562a847ca89ff48f4e0b54303/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:07.548992 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1049/2103] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:55:07 2022] POST /identity/v3/projects => generated 363 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:55:07.554441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8a2f2-f58f-4bb0-8ea4-8c7cf3432770 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:07.556198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eafd89-d70a-491c-ad27-5c024726d121 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:07.556486 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eafd89-d70a-491c-ad27-5c024726d121 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:07.556767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eafd89-d70a-491c-ad27-5c024726d121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:07.588300 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-43eafd89-d70a-491c-ad27-5c024726d121 None None] MFA Rules not processed for user `ea3884a562a847ca89ff48f4e0b54303`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:07.589604 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-43eafd89-d70a-491c-ad27-5c024726d121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:07.623995 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:07.668687 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8a2f2-f58f-4bb0-8ea4-8c7cf3432770 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:07.691726 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1050/2104] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:07.703945 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eafd89-d70a-491c-ad27-5c024726d121 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:07.705392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-43eafd89-d70a-491c-ad27-5c024726d121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:07.757525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ea1c1-99e1-49d0-83d8-26fbe529e7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:07.758208 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ea1c1-99e1-49d0-83d8-26fbe529e7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:07.758492 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ea1c1-99e1-49d0-83d8-26fbe529e7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:07.758768 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ea1c1-99e1-49d0-83d8-26fbe529e7e2 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:07.759467 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ea1c1-99e1-49d0-83d8-26fbe529e7e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:07.761638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ea1c1-99e1-49d0-83d8-26fbe529e7e2 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:07.770195 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eafd89-d70a-491c-ad27-5c024726d121 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:07.774445 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc27039-d4db-492e-be7f-ae43ac17016f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:07.775123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc27039-d4db-492e-be7f-ae43ac17016f service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:07.775410 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc27039-d4db-492e-be7f-ae43ac17016f service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:07.775688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc27039-d4db-492e-be7f-ae43ac17016f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:07.777608 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-cbc27039-d4db-492e-be7f-ae43ac17016f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:07.790976 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1055/2105] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:55:07 2022] POST /identity/v3/users => generated 282 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:55:07.795428 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ea1c1-99e1-49d0-83d8-26fbe529e7e2 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:07.807534 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ea1c1-99e1-49d0-83d8-26fbe529e7e2 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:07.813808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52f6f1-d03e-4dfb-b4f8-e482297e1c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:07.814724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52f6f1-d03e-4dfb-b4f8-e482297e1c91 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:07.815437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52f6f1-d03e-4dfb-b4f8-e482297e1c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:07.815867 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52f6f1-d03e-4dfb-b4f8-e482297e1c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:07.816870 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52f6f1-d03e-4dfb-b4f8-e482297e1c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:07.818816 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52f6f1-d03e-4dfb-b4f8-e482297e1c91 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:07.835445 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1056/2106] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:55:07.836926 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52f6f1-d03e-4dfb-b4f8-e482297e1c91 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:07.854279 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52f6f1-d03e-4dfb-b4f8-e482297e1c91 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:07.861237 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5800e36-a468-48f8-90ee-a25b31c6730f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:07.862182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5800e36-a468-48f8-90ee-a25b31c6730f admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:07.869740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc27039-d4db-492e-be7f-ae43ac17016f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:07.871438 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc27039-d4db-492e-be7f-ae43ac17016f service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:07.873576 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5800e36-a468-48f8-90ee-a25b31c6730f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:07.874339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5800e36-a468-48f8-90ee-a25b31c6730f admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:07.876865 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5800e36-a468-48f8-90ee-a25b31c6730f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:07.880447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5800e36-a468-48f8-90ee-a25b31c6730f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:07.897661 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1051/2107] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:55:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:55:07.901907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1057/2108] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:55:07.903145 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc27039-d4db-492e-be7f-ae43ac17016f service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:07.923750 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc27039-d4db-492e-be7f-ae43ac17016f service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:07.930394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8e340-c75c-4c67-816b-7fd963eb5170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:07.931573 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8e340-c75c-4c67-816b-7fd963eb5170 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:07.932035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8e340-c75c-4c67-816b-7fd963eb5170 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:07.932732 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8e340-c75c-4c67-816b-7fd963eb5170 admin admin] PATH_INFO: `/v3/projects/afb53b0d90be4c548c6e03e14d926dd0/users/4df155317d23497aacb23225acd7e64e/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:07.954274 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8e340-c75c-4c67-816b-7fd963eb5170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb53b0d90be4c548c6e03e14d926dd0, user_id=4df155317d23497aacb23225acd7e64e, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:07.957152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8e340-c75c-4c67-816b-7fd963eb5170 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:07.980814 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1052/2109] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:55:07 2022] PUT /identity/v3/projects/afb53b0d90be4c548c6e03e14d926dd0/users/4df155317d23497aacb23225acd7e64e/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:07.991622 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23967b5f-fc7d-4b39-b608-d492067f26aa None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:07.992017 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23967b5f-fc7d-4b39-b608-d492067f26aa None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:07.992304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23967b5f-fc7d-4b39-b608-d492067f26aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:07.999020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:08.022829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-23967b5f-fc7d-4b39-b608-d492067f26aa None None] MFA Rules not processed for user `4df155317d23497aacb23225acd7e64e`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:08.024058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-23967b5f-fc7d-4b39-b608-d492067f26aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:08.119529 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1058/2110] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:07 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:55:08.121047 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8e340-c75c-4c67-816b-7fd963eb5170 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:08.200726 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:08.206080 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8e340-c75c-4c67-816b-7fd963eb5170 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:08.213566 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc04ee4-4212-4ef4-861f-e7e7312a8b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:08.214566 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc04ee4-4212-4ef4-861f-e7e7312a8b1c admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:08.215336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc04ee4-4212-4ef4-861f-e7e7312a8b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:08.215711 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc04ee4-4212-4ef4-861f-e7e7312a8b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:08.222004 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc04ee4-4212-4ef4-861f-e7e7312a8b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:08.224247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc04ee4-4212-4ef4-861f-e7e7312a8b1c admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:08.264471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1053/2111] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:55:08 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:55:08.265843 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23967b5f-fc7d-4b39-b608-d492067f26aa None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:08.281451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23967b5f-fc7d-4b39-b608-d492067f26aa None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:08.365446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d71e0-2d35-4285-9cd0-3dda7cabac37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:08.366627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d71e0-2d35-4285-9cd0-3dda7cabac37 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:08.368942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d71e0-2d35-4285-9cd0-3dda7cabac37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:08.369317 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d71e0-2d35-4285-9cd0-3dda7cabac37 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:08.370176 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d71e0-2d35-4285-9cd0-3dda7cabac37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:08.372061 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d71e0-2d35-4285-9cd0-3dda7cabac37 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:08.397319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1059/2112] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:55:08 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:55:08.400299 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc04ee4-4212-4ef4-861f-e7e7312a8b1c admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:08.413303 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc04ee4-4212-4ef4-861f-e7e7312a8b1c admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:08.419127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee38d9-ae20-4943-adbc-5a94f96d943e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:08.419967 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee38d9-ae20-4943-adbc-5a94f96d943e admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:08.420466 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee38d9-ae20-4943-adbc-5a94f96d943e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:08.420854 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee38d9-ae20-4943-adbc-5a94f96d943e admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:08.421999 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee38d9-ae20-4943-adbc-5a94f96d943e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:08.424553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee38d9-ae20-4943-adbc-5a94f96d943e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:08.436994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1054/2113] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:55:08.440909 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d71e0-2d35-4285-9cd0-3dda7cabac37 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:08.451284 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d71e0-2d35-4285-9cd0-3dda7cabac37 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:08.456874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd03930-5955-4e68-831a-b6af0138a579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:08.457918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd03930-5955-4e68-831a-b6af0138a579 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:08.458284 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd03930-5955-4e68-831a-b6af0138a579 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:08.458661 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd03930-5955-4e68-831a-b6af0138a579 admin admin] PATH_INFO: `/v3/projects/00a6983c18964ffbb66d4c856e868aba/users/02322132918a45888cf48a2b84fb407b/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:08.479069 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd03930-5955-4e68-831a-b6af0138a579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a6983c18964ffbb66d4c856e868aba, user_id=02322132918a45888cf48a2b84fb407b, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:08.483089 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd03930-5955-4e68-831a-b6af0138a579 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:08.499640 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1060/2114] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:55:08 2022] PUT /identity/v3/projects/00a6983c18964ffbb66d4c856e868aba/users/02322132918a45888cf48a2b84fb407b/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:08.503576 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee38d9-ae20-4943-adbc-5a94f96d943e admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:08.514333 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee38d9-ae20-4943-adbc-5a94f96d943e admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:08.585500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42396dd3-b7be-4fb1-bb24-2960b7f9eef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:08.586698 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42396dd3-b7be-4fb1-bb24-2960b7f9eef8 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:08.586998 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42396dd3-b7be-4fb1-bb24-2960b7f9eef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:08.587294 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42396dd3-b7be-4fb1-bb24-2960b7f9eef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:08.588156 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42396dd3-b7be-4fb1-bb24-2960b7f9eef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:08.589813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42396dd3-b7be-4fb1-bb24-2960b7f9eef8 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:08.600808 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1055/2115] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:55:08.605191 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd03930-5955-4e68-831a-b6af0138a579 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:08.616549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd03930-5955-4e68-831a-b6af0138a579 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:08.621780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4f4f9-e840-41a2-b4f4-69c9acb8214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:08.622603 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4f4f9-e840-41a2-b4f4-69c9acb8214c admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:08.622886 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4f4f9-e840-41a2-b4f4-69c9acb8214c admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:08.623191 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4f4f9-e840-41a2-b4f4-69c9acb8214c admin admin] PATH_INFO: `/v3/projects/00a6983c18964ffbb66d4c856e868aba/users/02322132918a45888cf48a2b84fb407b/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:08.625164 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4f4f9-e840-41a2-b4f4-69c9acb8214c admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a6983c18964ffbb66d4c856e868aba, user_id=02322132918a45888cf48a2b84fb407b, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:08.628137 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4f4f9-e840-41a2-b4f4-69c9acb8214c admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:08.639329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1061/2116] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:55:08 2022] PUT /identity/v3/projects/00a6983c18964ffbb66d4c856e868aba/users/02322132918a45888cf48a2b84fb407b/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:08.650913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7299fc0-fa9e-47a2-83a3-a7eefce2d0a9 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:08.651202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7299fc0-fa9e-47a2-83a3-a7eefce2d0a9 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:08.651484 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7299fc0-fa9e-47a2-83a3-a7eefce2d0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:08.686072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-d7299fc0-fa9e-47a2-83a3-a7eefce2d0a9 None None] MFA Rules not processed for user `02322132918a45888cf48a2b84fb407b`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:08.687017 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-d7299fc0-fa9e-47a2-83a3-a7eefce2d0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:08.772954 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1056/2117] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:08 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:55:08.785946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4f4f9-e840-41a2-b4f4-69c9acb8214c admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:08.834960 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:08.848666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4f4f9-e840-41a2-b4f4-69c9acb8214c admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:08.852577 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdd605-aaa9-49ea-a6df-83a4486594db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:08.853334 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdd605-aaa9-49ea-a6df-83a4486594db service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:08.853813 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdd605-aaa9-49ea-a6df-83a4486594db service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:08.854224 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdd605-aaa9-49ea-a6df-83a4486594db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:08.869113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdd605-aaa9-49ea-a6df-83a4486594db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:08.870788 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdd605-aaa9-49ea-a6df-83a4486594db service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:08.887918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1062/2118] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:55:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:55:08.999118 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7299fc0-fa9e-47a2-83a3-a7eefce2d0a9 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:09.009894 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7299fc0-fa9e-47a2-83a3-a7eefce2d0a9 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:09.013889 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88e06c-09d4-4fc2-b6f2-496e91f01753 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:09.014646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88e06c-09d4-4fc2-b6f2-496e91f01753 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:09.015031 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88e06c-09d4-4fc2-b6f2-496e91f01753 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:09.015422 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88e06c-09d4-4fc2-b6f2-496e91f01753 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:09.068695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:09.078475 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88e06c-09d4-4fc2-b6f2-496e91f01753 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:09.080175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88e06c-09d4-4fc2-b6f2-496e91f01753 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:09.090096 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1057/2119] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:55:08 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:55:09.555911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdd605-aaa9-49ea-a6df-83a4486594db service cinder] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:09.557396 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e4cdd605-aaa9-49ea-a6df-83a4486594db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:09.573224 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdd605-aaa9-49ea-a6df-83a4486594db service cinder] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:09.578622 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44d509-72b7-4b4c-a391-634c654b2b9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:09.579393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44d509-72b7-4b4c-a391-634c654b2b9e service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:09.579680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44d509-72b7-4b4c-a391-634c654b2b9e service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:09.579954 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44d509-72b7-4b4c-a391-634c654b2b9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:09.581790 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-cf44d509-72b7-4b4c-a391-634c654b2b9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:09.699067 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44d509-72b7-4b4c-a391-634c654b2b9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:09.700573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44d509-72b7-4b4c-a391-634c654b2b9e service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:09.729118 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1063/2120] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:55:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:55:10.444166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88e06c-09d4-4fc2-b6f2-496e91f01753 service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:10.457213 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88e06c-09d4-4fc2-b6f2-496e91f01753 service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:10.476391 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0dd6d-0954-496e-9ac7-4e9fbd5ae3df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:10.478281 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0dd6d-0954-496e-9ac7-4e9fbd5ae3df service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:10.479437 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0dd6d-0954-496e-9ac7-4e9fbd5ae3df service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:10.480021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0dd6d-0954-496e-9ac7-4e9fbd5ae3df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:10.638932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0dd6d-0954-496e-9ac7-4e9fbd5ae3df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:10.640457 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0dd6d-0954-496e-9ac7-4e9fbd5ae3df service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:10.652282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1058/2121] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:55:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:55:12.027538 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44d509-72b7-4b4c-a391-634c654b2b9e service cinder] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:12.243126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44d509-72b7-4b4c-a391-634c654b2b9e service cinder] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:12.249451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cc380-8bdf-458e-a974-238f4583e4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:12.253105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cc380-8bdf-458e-a974-238f4583e4e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:12.253562 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cc380-8bdf-458e-a974-238f4583e4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:12.253684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cc380-8bdf-458e-a974-238f4583e4e5 admin admin] PATH_INFO: `/v3/users/4df155317d23497aacb23225acd7e64e` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:12.261392 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cc380-8bdf-458e-a974-238f4583e4e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4df155317d23497aacb23225acd7e64e)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:12.263514 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cc380-8bdf-458e-a974-238f4583e4e5 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:12.332622 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-bc4cc380-8bdf-458e-a974-238f4583e4e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4df155317d23497aacb23225acd7e64e'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:12.333951 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-bc4cc380-8bdf-458e-a974-238f4583e4e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4df155317d23497aacb23225acd7e64e'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:12.334936 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-bc4cc380-8bdf-458e-a974-238f4583e4e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4df155317d23497aacb23225acd7e64e'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:12.340871 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:12.350108 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-bc4cc380-8bdf-458e-a974-238f4583e4e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4df155317d23497aacb23225acd7e64e'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:12.362737 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-bc4cc380-8bdf-458e-a974-238f4583e4e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4df155317d23497aacb23225acd7e64e'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:12.395370 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1064/2122] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:55:12 2022] DELETE /identity/v3/users/4df155317d23497aacb23225acd7e64e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:12.398420 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d6f0c-c079-4aea-95e2-a7335340b87f None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:12.399101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d6f0c-c079-4aea-95e2-a7335340b87f None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:12.399392 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d6f0c-c079-4aea-95e2-a7335340b87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:12.449851 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a30d6f0c-c079-4aea-95e2-a7335340b87f None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:12.450996 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a30d6f0c-c079-4aea-95e2-a7335340b87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:12.510770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1059/2123] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:55:12.521081 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cc380-8bdf-458e-a974-238f4583e4e5 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:12.522639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-bc4cc380-8bdf-458e-a974-238f4583e4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:12.639420 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cc380-8bdf-458e-a974-238f4583e4e5 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:12.643856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4250143-3618-4b81-a930-62d17d517414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:12.644535 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4250143-3618-4b81-a930-62d17d517414 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:12.644816 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4250143-3618-4b81-a930-62d17d517414 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:12.645094 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4250143-3618-4b81-a930-62d17d517414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:12.654343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4250143-3618-4b81-a930-62d17d517414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:12.655758 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4250143-3618-4b81-a930-62d17d517414 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:12.666558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1065/2124] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:55:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:55:12.993317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d6f0c-c079-4aea-95e2-a7335340b87f None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:12.994940 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a30d6f0c-c079-4aea-95e2-a7335340b87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:13.009723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d6f0c-c079-4aea-95e2-a7335340b87f None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:13.016203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a7581-545a-4606-a3c0-852058969562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:13.017231 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a7581-545a-4606-a3c0-852058969562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:13.017636 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a7581-545a-4606-a3c0-852058969562 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:13.017981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a7581-545a-4606-a3c0-852058969562 admin admin] PATH_INFO: `/v3/projects/afb53b0d90be4c548c6e03e14d926dd0` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:13.019334 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a7581-545a-4606-a3c0-852058969562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afb53b0d90be4c548c6e03e14d926dd0)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:13.021473 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a7581-545a-4606-a3c0-852058969562 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:13.086111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:13.103914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6a0a7581-545a-4606-a3c0-852058969562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb53b0d90be4c548c6e03e14d926dd0', 'request_id': 'req-6a0a7581-545a-4606-a3c0-852058969562'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:13.111859 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6a0a7581-545a-4606-a3c0-852058969562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb53b0d90be4c548c6e03e14d926dd0', 'request_id': 'req-6a0a7581-545a-4606-a3c0-852058969562'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:13.120089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6a0a7581-545a-4606-a3c0-852058969562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb53b0d90be4c548c6e03e14d926dd0', 'request_id': 'req-6a0a7581-545a-4606-a3c0-852058969562'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:13.139097 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6a0a7581-545a-4606-a3c0-852058969562 admin admin] The token cache is being invalidate because project afb53b0d90be4c548c6e03e14d926dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:55:13.139684 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6a0a7581-545a-4606-a3c0-852058969562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:13.140191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6a0a7581-545a-4606-a3c0-852058969562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:13.145193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1060/2125] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:55:12 2022] DELETE /identity/v3/projects/afb53b0d90be4c548c6e03e14d926dd0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:13.145982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4250143-3618-4b81-a930-62d17d517414 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:13.157716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4250143-3618-4b81-a930-62d17d517414 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:13.235858 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167831a6-ff58-4cff-95ad-f2e3a36a6795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:13.237377 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167831a6-ff58-4cff-95ad-f2e3a36a6795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:13.237842 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167831a6-ff58-4cff-95ad-f2e3a36a6795 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:13.238576 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167831a6-ff58-4cff-95ad-f2e3a36a6795 admin admin] PATH_INFO: `/v3/users/02322132918a45888cf48a2b84fb407b` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:13.240667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167831a6-ff58-4cff-95ad-f2e3a36a6795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02322132918a45888cf48a2b84fb407b)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:13.243963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167831a6-ff58-4cff-95ad-f2e3a36a6795 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:13.331969 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:13.348979 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-167831a6-ff58-4cff-95ad-f2e3a36a6795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02322132918a45888cf48a2b84fb407b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:13.350007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-167831a6-ff58-4cff-95ad-f2e3a36a6795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02322132918a45888cf48a2b84fb407b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:13.350699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-167831a6-ff58-4cff-95ad-f2e3a36a6795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02322132918a45888cf48a2b84fb407b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:13.364839 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-167831a6-ff58-4cff-95ad-f2e3a36a6795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02322132918a45888cf48a2b84fb407b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:13.375065 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-167831a6-ff58-4cff-95ad-f2e3a36a6795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02322132918a45888cf48a2b84fb407b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:13.401040 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1066/2126] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:55:13 2022] DELETE /identity/v3/users/02322132918a45888cf48a2b84fb407b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:55:13.838436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a7581-545a-4606-a3c0-852058969562 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:13.843509 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6a0a7581-545a-4606-a3c0-852058969562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:13.863449 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a7581-545a-4606-a3c0-852058969562 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:13.983121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233ba51-af23-4634-abee-8c41513158aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:13.984195 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233ba51-af23-4634-abee-8c41513158aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:13.985422 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233ba51-af23-4634-abee-8c41513158aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:13.985807 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233ba51-af23-4634-abee-8c41513158aa admin admin] PATH_INFO: `/v3/projects/00a6983c18964ffbb66d4c856e868aba` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:13.987223 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233ba51-af23-4634-abee-8c41513158aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=00a6983c18964ffbb66d4c856e868aba)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:13.989654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233ba51-af23-4634-abee-8c41513158aa admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:14.042342 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-3233ba51-af23-4634-abee-8c41513158aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00a6983c18964ffbb66d4c856e868aba', 'request_id': 'req-3233ba51-af23-4634-abee-8c41513158aa'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:14.049859 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-3233ba51-af23-4634-abee-8c41513158aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00a6983c18964ffbb66d4c856e868aba', 'request_id': 'req-3233ba51-af23-4634-abee-8c41513158aa'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:14.058464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-3233ba51-af23-4634-abee-8c41513158aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00a6983c18964ffbb66d4c856e868aba', 'request_id': 'req-3233ba51-af23-4634-abee-8c41513158aa'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:14.073617 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-3233ba51-af23-4634-abee-8c41513158aa admin admin] The token cache is being invalidate because project 00a6983c18964ffbb66d4c856e868aba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:55:14.074095 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-3233ba51-af23-4634-abee-8c41513158aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:14.074872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-3233ba51-af23-4634-abee-8c41513158aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:14.076902 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1061/2127] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:55:13 2022] DELETE /identity/v3/projects/00a6983c18964ffbb66d4c856e868aba => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:14.083616 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd04bae-1207-4772-9791-b5c7ebdbe7e4 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:14.084085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd04bae-1207-4772-9791-b5c7ebdbe7e4 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:14.084472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd04bae-1207-4772-9791-b5c7ebdbe7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:14.129888 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-5bd04bae-1207-4772-9791-b5c7ebdbe7e4 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:14.131289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-5bd04bae-1207-4772-9791-b5c7ebdbe7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:14.201300 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1067/2128] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:14.209029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de3fc9-7eb2-460a-a11c-afa0eba27995 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:14.209436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de3fc9-7eb2-460a-a11c-afa0eba27995 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:14.209791 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de3fc9-7eb2-460a-a11c-afa0eba27995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:14.229711 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-d3de3fc9-7eb2-460a-a11c-afa0eba27995 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:14.231053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-d3de3fc9-7eb2-460a-a11c-afa0eba27995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:14.240311 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1062/2129] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:14.244432 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd04bae-1207-4772-9791-b5c7ebdbe7e4 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:14.256936 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd04bae-1207-4772-9791-b5c7ebdbe7e4 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:14.262584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4061ef-a73b-4fc0-8895-9ac536d565f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:14.263312 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4061ef-a73b-4fc0-8895-9ac536d565f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:14.263904 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4061ef-a73b-4fc0-8895-9ac536d565f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:14.264273 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4061ef-a73b-4fc0-8895-9ac536d565f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:14.265193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4061ef-a73b-4fc0-8895-9ac536d565f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:55:14.265854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4061ef-a73b-4fc0-8895-9ac536d565f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:14.267655 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4061ef-a73b-4fc0-8895-9ac536d565f8 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:14.281922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1068/2130] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:55:14.286256 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de3fc9-7eb2-460a-a11c-afa0eba27995 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:14.295818 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de3fc9-7eb2-460a-a11c-afa0eba27995 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:14.305719 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42006c52-9ca8-4a1a-96d8-3ef93132746d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:14.306458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42006c52-9ca8-4a1a-96d8-3ef93132746d admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:14.306698 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42006c52-9ca8-4a1a-96d8-3ef93132746d admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:14.306980 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42006c52-9ca8-4a1a-96d8-3ef93132746d admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:14.307680 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42006c52-9ca8-4a1a-96d8-3ef93132746d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:14.309769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42006c52-9ca8-4a1a-96d8-3ef93132746d admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:14.341973 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1063/2131] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:55:14 2022] POST /identity/v3/projects => generated 361 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:55:14.343647 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4061ef-a73b-4fc0-8895-9ac536d565f8 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:14.355790 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4061ef-a73b-4fc0-8895-9ac536d565f8 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:14.424440 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4766e3d-198e-4ee1-8a37-6a61572f1082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:14.425242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4766e3d-198e-4ee1-8a37-6a61572f1082 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:14.425795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4766e3d-198e-4ee1-8a37-6a61572f1082 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:14.426141 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4766e3d-198e-4ee1-8a37-6a61572f1082 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:14.427029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4766e3d-198e-4ee1-8a37-6a61572f1082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:14.429044 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4766e3d-198e-4ee1-8a37-6a61572f1082 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:14.451861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1069/2132] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:55:14 2022] POST /identity/v3/users => generated 281 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:55:14.455873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42006c52-9ca8-4a1a-96d8-3ef93132746d admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:14.466804 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42006c52-9ca8-4a1a-96d8-3ef93132746d admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:14.472320 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a29a5-7742-4c62-aa6a-8bf9897778a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:14.473001 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a29a5-7742-4c62-aa6a-8bf9897778a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:14.473198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a29a5-7742-4c62-aa6a-8bf9897778a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:14.473535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a29a5-7742-4c62-aa6a-8bf9897778a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:14.474285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a29a5-7742-4c62-aa6a-8bf9897778a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:14.475951 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a29a5-7742-4c62-aa6a-8bf9897778a7 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:14.491029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1064/2133] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:55:14.492286 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4766e3d-198e-4ee1-8a37-6a61572f1082 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:14.503134 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4766e3d-198e-4ee1-8a37-6a61572f1082 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:14.508067 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6544e-1c49-416e-814e-ab8a317db606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:14.508724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6544e-1c49-416e-814e-ab8a317db606 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:14.509007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6544e-1c49-416e-814e-ab8a317db606 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:14.509306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6544e-1c49-416e-814e-ab8a317db606 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:14.510055 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6544e-1c49-416e-814e-ab8a317db606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:14.511666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6544e-1c49-416e-814e-ab8a317db606 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:14.523392 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1070/2134] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:55:14.527957 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a29a5-7742-4c62-aa6a-8bf9897778a7 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:14.538800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a29a5-7742-4c62-aa6a-8bf9897778a7 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:14.543861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de5f5d-42e7-4bb7-8bd9-69e5fb597254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:14.544780 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de5f5d-42e7-4bb7-8bd9-69e5fb597254 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:14.545086 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de5f5d-42e7-4bb7-8bd9-69e5fb597254 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:14.545402 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de5f5d-42e7-4bb7-8bd9-69e5fb597254 admin admin] PATH_INFO: `/v3/projects/919c8f3b16804005901f51acc05c216a/users/b9495fc854cf449c98a4fedbaac069a9/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:14.548724 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:14.562665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de5f5d-42e7-4bb7-8bd9-69e5fb597254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=919c8f3b16804005901f51acc05c216a, user_id=b9495fc854cf449c98a4fedbaac069a9, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:14.565342 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de5f5d-42e7-4bb7-8bd9-69e5fb597254 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:14.581070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1065/2135] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:55:14 2022] PUT /identity/v3/projects/919c8f3b16804005901f51acc05c216a/users/b9495fc854cf449c98a4fedbaac069a9/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:14.592044 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de40bb-d7c7-4065-851f-8d8555a9793b None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:14.592497 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de40bb-d7c7-4065-851f-8d8555a9793b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:14.592943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de40bb-d7c7-4065-851f-8d8555a9793b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:14.608884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:14.628734 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-45de40bb-d7c7-4065-851f-8d8555a9793b None None] MFA Rules not processed for user `b9495fc854cf449c98a4fedbaac069a9`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:14.630392 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-45de40bb-d7c7-4065-851f-8d8555a9793b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:14.762546 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1071/2136] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:14.800044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de5f5d-42e7-4bb7-8bd9-69e5fb597254 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:14.802722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-54de5f5d-42e7-4bb7-8bd9-69e5fb597254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:14.903189 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de5f5d-42e7-4bb7-8bd9-69e5fb597254 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:14.907968 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa1749-750d-4402-92cd-fa78970d1057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:14.908254 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa1749-750d-4402-92cd-fa78970d1057 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:14.908554 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa1749-750d-4402-92cd-fa78970d1057 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:14.908842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa1749-750d-4402-92cd-fa78970d1057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:14.919387 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa1749-750d-4402-92cd-fa78970d1057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:14.923959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa1749-750d-4402-92cd-fa78970d1057 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:14.935926 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1066/2137] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:55:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:55:14.951482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de40bb-d7c7-4065-851f-8d8555a9793b None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:15.046874 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa1749-750d-4402-92cd-fa78970d1057 service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:15.048898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-50fa1749-750d-4402-92cd-fa78970d1057 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:15.050689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de40bb-d7c7-4065-851f-8d8555a9793b None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:15.060531 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873f36a-6898-4e21-9ac9-f4a66102031a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:15.061601 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873f36a-6898-4e21-9ac9-f4a66102031a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:15.061888 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873f36a-6898-4e21-9ac9-f4a66102031a admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:15.062193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873f36a-6898-4e21-9ac9-f4a66102031a admin admin] PATH_INFO: `/v3/users/b9495fc854cf449c98a4fedbaac069a9` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:15.063555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873f36a-6898-4e21-9ac9-f4a66102031a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9495fc854cf449c98a4fedbaac069a9)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:15.065596 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873f36a-6898-4e21-9ac9-f4a66102031a admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:15.070283 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa1749-750d-4402-92cd-fa78970d1057 service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:15.076284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cc870-70be-4e88-bd2e-df73ada48b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:15.077738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cc870-70be-4e88-bd2e-df73ada48b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:15.078627 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cc870-70be-4e88-bd2e-df73ada48b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:15.078627 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cc870-70be-4e88-bd2e-df73ada48b94 admin admin] PATH_INFO: `/v3/users/fe8bda31342a4487a9bec404488555cd` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:15.080514 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870cc870-70be-4e88-bd2e-df73ada48b94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe8bda31342a4487a9bec404488555cd)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:15.083054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870cc870-70be-4e88-bd2e-df73ada48b94 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:15.143078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8873f36a-6898-4e21-9ac9-f4a66102031a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9495fc854cf449c98a4fedbaac069a9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:15.143849 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8873f36a-6898-4e21-9ac9-f4a66102031a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9495fc854cf449c98a4fedbaac069a9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:15.144652 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8873f36a-6898-4e21-9ac9-f4a66102031a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9495fc854cf449c98a4fedbaac069a9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:15.154117 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-870cc870-70be-4e88-bd2e-df73ada48b94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe8bda31342a4487a9bec404488555cd'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:15.155242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8873f36a-6898-4e21-9ac9-f4a66102031a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9495fc854cf449c98a4fedbaac069a9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:15.165472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8873f36a-6898-4e21-9ac9-f4a66102031a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9495fc854cf449c98a4fedbaac069a9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:15.170187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-870cc870-70be-4e88-bd2e-df73ada48b94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe8bda31342a4487a9bec404488555cd'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:15.171029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-870cc870-70be-4e88-bd2e-df73ada48b94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe8bda31342a4487a9bec404488555cd'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:15.171913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-870cc870-70be-4e88-bd2e-df73ada48b94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe8bda31342a4487a9bec404488555cd'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:15.185491 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-870cc870-70be-4e88-bd2e-df73ada48b94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe8bda31342a4487a9bec404488555cd'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:15.193662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1072/2138] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:55:14 2022] DELETE /identity/v3/users/b9495fc854cf449c98a4fedbaac069a9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:15.195115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdae49-1713-4be3-ba8d-199809519872 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:15.195565 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdae49-1713-4be3-ba8d-199809519872 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:15.195944 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdae49-1713-4be3-ba8d-199809519872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:15.211524 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1067/2139] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:55:15 2022] DELETE /identity/v3/users/fe8bda31342a4487a9bec404488555cd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:15.216020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-48cdae49-1713-4be3-ba8d-199809519872 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:15.216626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698414ec-3822-4850-9222-81ef7dca42f9 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:15.216626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698414ec-3822-4850-9222-81ef7dca42f9 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:15.216626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698414ec-3822-4850-9222-81ef7dca42f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:15.217427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-48cdae49-1713-4be3-ba8d-199809519872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:15.229198 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:15.242343 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-698414ec-3822-4850-9222-81ef7dca42f9 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:15.243609 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-698414ec-3822-4850-9222-81ef7dca42f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:15.303554 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:15.317348 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1068/2140] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:15.320754 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1073/2141] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:15.331181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698414ec-3822-4850-9222-81ef7dca42f9 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:15.331527 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdae49-1713-4be3-ba8d-199809519872 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:15.333108 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-698414ec-3822-4850-9222-81ef7dca42f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:15.333680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-48cdae49-1713-4be3-ba8d-199809519872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:15.405589 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdae49-1713-4be3-ba8d-199809519872 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:15.410180 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb970e8-2371-40a1-b1e8-5609839d9901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:15.410882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb970e8-2371-40a1-b1e8-5609839d9901 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:15.411457 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb970e8-2371-40a1-b1e8-5609839d9901 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:15.411689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb970e8-2371-40a1-b1e8-5609839d9901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:15.424284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698414ec-3822-4850-9222-81ef7dca42f9 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:15.426263 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb970e8-2371-40a1-b1e8-5609839d9901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:15.428081 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb970e8-2371-40a1-b1e8-5609839d9901 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:15.433544 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57829e73-dd4b-48d2-a6e2-c714cd07e77a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:15.436644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57829e73-dd4b-48d2-a6e2-c714cd07e77a service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:15.436892 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57829e73-dd4b-48d2-a6e2-c714cd07e77a service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:15.437548 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57829e73-dd4b-48d2-a6e2-c714cd07e77a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:15.442013 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1074/2142] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:55:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:55:15.450338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57829e73-dd4b-48d2-a6e2-c714cd07e77a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:15.452354 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57829e73-dd4b-48d2-a6e2-c714cd07e77a service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:15.464716 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1069/2143] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:55:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:55:15.867005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb970e8-2371-40a1-b1e8-5609839d9901 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:15.868765 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-beb970e8-2371-40a1-b1e8-5609839d9901 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:15.917429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb970e8-2371-40a1-b1e8-5609839d9901 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:15.933629 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77d71e-be56-4601-a905-08de534dd34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:15.936312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57829e73-dd4b-48d2-a6e2-c714cd07e77a service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:15.937846 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77d71e-be56-4601-a905-08de534dd34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:15.938257 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77d71e-be56-4601-a905-08de534dd34c admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:15.938414 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77d71e-be56-4601-a905-08de534dd34c admin admin] PATH_INFO: `/v3/projects/919c8f3b16804005901f51acc05c216a` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:15.939254 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-57829e73-dd4b-48d2-a6e2-c714cd07e77a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:15.941855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77d71e-be56-4601-a905-08de534dd34c admin admin] RBAC: Authorizing `identity:delete_project(project_id=919c8f3b16804005901f51acc05c216a)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:15.948610 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77d71e-be56-4601-a905-08de534dd34c admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:15.965884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57829e73-dd4b-48d2-a6e2-c714cd07e77a service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:15.974360 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0e14d-1fbd-488a-9d5f-2d3180e51ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:15.975490 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0e14d-1fbd-488a-9d5f-2d3180e51ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:15.976016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0e14d-1fbd-488a-9d5f-2d3180e51ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:15.976348 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0e14d-1fbd-488a-9d5f-2d3180e51ffd admin admin] PATH_INFO: `/v3/projects/4acd23ff437149cdaeb608ac15a8e079` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:15.978592 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0e14d-1fbd-488a-9d5f-2d3180e51ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4acd23ff437149cdaeb608ac15a8e079)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:15.981598 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0e14d-1fbd-488a-9d5f-2d3180e51ffd admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:16.050581 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-1b77d71e-be56-4601-a905-08de534dd34c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919c8f3b16804005901f51acc05c216a', 'request_id': 'req-1b77d71e-be56-4601-a905-08de534dd34c'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:16.061176 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-1b77d71e-be56-4601-a905-08de534dd34c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919c8f3b16804005901f51acc05c216a', 'request_id': 'req-1b77d71e-be56-4601-a905-08de534dd34c'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:16.063664 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-75b0e14d-1fbd-488a-9d5f-2d3180e51ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4acd23ff437149cdaeb608ac15a8e079', 'request_id': 'req-75b0e14d-1fbd-488a-9d5f-2d3180e51ffd'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:16.071959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-75b0e14d-1fbd-488a-9d5f-2d3180e51ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4acd23ff437149cdaeb608ac15a8e079', 'request_id': 'req-75b0e14d-1fbd-488a-9d5f-2d3180e51ffd'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:16.082723 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-1b77d71e-be56-4601-a905-08de534dd34c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919c8f3b16804005901f51acc05c216a', 'request_id': 'req-1b77d71e-be56-4601-a905-08de534dd34c'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:16.084017 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-75b0e14d-1fbd-488a-9d5f-2d3180e51ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4acd23ff437149cdaeb608ac15a8e079', 'request_id': 'req-75b0e14d-1fbd-488a-9d5f-2d3180e51ffd'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:16.107168 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-1b77d71e-be56-4601-a905-08de534dd34c admin admin] The token cache is being invalidate because project 919c8f3b16804005901f51acc05c216a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:55:16.108628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-75b0e14d-1fbd-488a-9d5f-2d3180e51ffd admin admin] The token cache is being invalidate because project 4acd23ff437149cdaeb608ac15a8e079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:55:16.108936 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-75b0e14d-1fbd-488a-9d5f-2d3180e51ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:16.109654 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-1b77d71e-be56-4601-a905-08de534dd34c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:16.110292 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-75b0e14d-1fbd-488a-9d5f-2d3180e51ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:16.110866 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-1b77d71e-be56-4601-a905-08de534dd34c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:16.118189 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1070/2144] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:55:15 2022] DELETE /identity/v3/projects/4acd23ff437149cdaeb608ac15a8e079 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:16.118370 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1075/2145] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:55:15 2022] DELETE /identity/v3/projects/919c8f3b16804005901f51acc05c216a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:16.118495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0e14d-1fbd-488a-9d5f-2d3180e51ffd admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:16.118495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-75b0e14d-1fbd-488a-9d5f-2d3180e51ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:16.121083 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6872955-e761-417a-a06f-7daf816c0805 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:16.121413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6872955-e761-417a-a06f-7daf816c0805 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:16.121693 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6872955-e761-417a-a06f-7daf816c0805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:16.166377 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-a6872955-e761-417a-a06f-7daf816c0805 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:16.167616 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-a6872955-e761-417a-a06f-7daf816c0805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:16.223037 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:16.228547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0e14d-1fbd-488a-9d5f-2d3180e51ffd admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:16.238204 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2f042-033a-4eca-b631-eef45890450e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:16.239366 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2f042-033a-4eca-b631-eef45890450e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:16.239805 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2f042-033a-4eca-b631-eef45890450e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:16.240237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2f042-033a-4eca-b631-eef45890450e admin admin] PATH_INFO: `/v3/users/deca10f9cd4944a39c7bb4c6059d08ea` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:16.242994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2f042-033a-4eca-b631-eef45890450e admin admin] RBAC: Authorizing `identity:delete_user(user_id=deca10f9cd4944a39c7bb4c6059d08ea)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:16.247552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2f042-033a-4eca-b631-eef45890450e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:16.295713 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1076/2146] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:16.298252 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9a86a-c927-4d4e-8dcd-04bdaf98fb3c None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:16.298749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9a86a-c927-4d4e-8dcd-04bdaf98fb3c None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:16.299186 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9a86a-c927-4d4e-8dcd-04bdaf98fb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:16.306562 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:16.323828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-a7b9a86a-c927-4d4e-8dcd-04bdaf98fb3c None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:16.326027 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-a7b9a86a-c927-4d4e-8dcd-04bdaf98fb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:16.345773 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-afe2f042-033a-4eca-b631-eef45890450e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deca10f9cd4944a39c7bb4c6059d08ea'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:16.352807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1077/2147] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:16.354065 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9a86a-c927-4d4e-8dcd-04bdaf98fb3c None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:16.365738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-afe2f042-033a-4eca-b631-eef45890450e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deca10f9cd4944a39c7bb4c6059d08ea'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:16.366428 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-afe2f042-033a-4eca-b631-eef45890450e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deca10f9cd4944a39c7bb4c6059d08ea'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:16.367141 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-afe2f042-033a-4eca-b631-eef45890450e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deca10f9cd4944a39c7bb4c6059d08ea'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:16.377960 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9a86a-c927-4d4e-8dcd-04bdaf98fb3c None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:16.378817 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-afe2f042-033a-4eca-b631-eef45890450e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deca10f9cd4944a39c7bb4c6059d08ea'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:16.384827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a143c-4480-40da-ae8f-4038efa18977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:16.385741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a143c-4480-40da-ae8f-4038efa18977 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:16.386142 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a143c-4480-40da-ae8f-4038efa18977 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:16.386591 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a143c-4480-40da-ae8f-4038efa18977 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:16.387417 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a143c-4480-40da-ae8f-4038efa18977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:55:16.387822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a143c-4480-40da-ae8f-4038efa18977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:16.390147 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a143c-4480-40da-ae8f-4038efa18977 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:16.396594 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1071/2148] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:55:16 2022] DELETE /identity/v3/users/deca10f9cd4944a39c7bb4c6059d08ea => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:16.408055 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1078/2149] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:55:16.409633 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2f042-033a-4eca-b631-eef45890450e admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:16.416058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-afe2f042-033a-4eca-b631-eef45890450e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:16.500735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2f042-033a-4eca-b631-eef45890450e admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:16.508455 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369223dc-0d79-42c1-9224-952fa1f7bdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:16.509396 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369223dc-0d79-42c1-9224-952fa1f7bdab admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:16.509780 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369223dc-0d79-42c1-9224-952fa1f7bdab admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:16.509970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369223dc-0d79-42c1-9224-952fa1f7bdab admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:16.511020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369223dc-0d79-42c1-9224-952fa1f7bdab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:16.514193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369223dc-0d79-42c1-9224-952fa1f7bdab admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:16.559003 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1072/2150] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:55:16 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:55:16.560705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a143c-4480-40da-ae8f-4038efa18977 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:16.576884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a143c-4480-40da-ae8f-4038efa18977 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:16.752780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6d808-1a98-48b1-be6c-fd274d5b0368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:16.757069 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6d808-1a98-48b1-be6c-fd274d5b0368 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:16.758283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6d808-1a98-48b1-be6c-fd274d5b0368 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:16.761453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6d808-1a98-48b1-be6c-fd274d5b0368 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:16.761783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6d808-1a98-48b1-be6c-fd274d5b0368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:16.776314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6d808-1a98-48b1-be6c-fd274d5b0368 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:16.839822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369223dc-0d79-42c1-9224-952fa1f7bdab admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:16.842579 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-369223dc-0d79-42c1-9224-952fa1f7bdab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:16.849676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1079/2151] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:55:16 2022] POST /identity/v3/users => generated 289 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:55:16.852884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6d808-1a98-48b1-be6c-fd274d5b0368 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:16.864886 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369223dc-0d79-42c1-9224-952fa1f7bdab admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:16.902323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c94c5-6552-4561-884c-d51db7d1a89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:16.902323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c94c5-6552-4561-884c-d51db7d1a89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:16.902323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c94c5-6552-4561-884c-d51db7d1a89e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:16.902323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c94c5-6552-4561-884c-d51db7d1a89e admin admin] PATH_INFO: `/v3/projects/a95c691561ec44f39cc933f699a6857f` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:16.903283 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c94c5-6552-4561-884c-d51db7d1a89e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a95c691561ec44f39cc933f699a6857f)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:16.907071 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6d808-1a98-48b1-be6c-fd274d5b0368 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:16.911034 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c94c5-6552-4561-884c-d51db7d1a89e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:16.914570 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f5f3e-ada3-4493-996b-2b55ae5c5b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:16.915555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f5f3e-ada3-4493-996b-2b55ae5c5b44 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:16.915933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f5f3e-ada3-4493-996b-2b55ae5c5b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:16.916280 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f5f3e-ada3-4493-996b-2b55ae5c5b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:16.917091 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f5f3e-ada3-4493-996b-2b55ae5c5b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:16.919218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f5f3e-ada3-4493-996b-2b55ae5c5b44 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:16.943844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1080/2152] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:55:16.948122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f5f3e-ada3-4493-996b-2b55ae5c5b44 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:16.966502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f5f3e-ada3-4493-996b-2b55ae5c5b44 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:16.973813 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215ef74-0de4-49e1-8696-1195dea3fd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:16.975539 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215ef74-0de4-49e1-8696-1195dea3fd71 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:16.975539 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215ef74-0de4-49e1-8696-1195dea3fd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:16.976013 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215ef74-0de4-49e1-8696-1195dea3fd71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:16.977698 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215ef74-0de4-49e1-8696-1195dea3fd71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:16.980006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215ef74-0de4-49e1-8696-1195dea3fd71 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:17.008945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1081/2153] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:55:17.009142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-039c94c5-6552-4561-884c-d51db7d1a89e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a95c691561ec44f39cc933f699a6857f', 'request_id': 'req-039c94c5-6552-4561-884c-d51db7d1a89e'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:17.011739 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215ef74-0de4-49e1-8696-1195dea3fd71 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:17.017596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-039c94c5-6552-4561-884c-d51db7d1a89e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a95c691561ec44f39cc933f699a6857f', 'request_id': 'req-039c94c5-6552-4561-884c-d51db7d1a89e'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:17.023729 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-039c94c5-6552-4561-884c-d51db7d1a89e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a95c691561ec44f39cc933f699a6857f', 'request_id': 'req-039c94c5-6552-4561-884c-d51db7d1a89e'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:17.036626 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215ef74-0de4-49e1-8696-1195dea3fd71 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:17.046775 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-039c94c5-6552-4561-884c-d51db7d1a89e admin admin] The token cache is being invalidate because project a95c691561ec44f39cc933f699a6857f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:55:17.047835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-039c94c5-6552-4561-884c-d51db7d1a89e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:17.048536 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-039c94c5-6552-4561-884c-d51db7d1a89e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:17.050411 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1073/2154] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:55:16 2022] DELETE /identity/v3/projects/a95c691561ec44f39cc933f699a6857f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:55:17.054045 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c94c5-6552-4561-884c-d51db7d1a89e admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:17.055536 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-039c94c5-6552-4561-884c-d51db7d1a89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:17.070421 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:17.106127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec9975-d61f-4473-acd5-01954c34a05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:17.107044 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec9975-d61f-4473-acd5-01954c34a05b admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:17.107438 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec9975-d61f-4473-acd5-01954c34a05b admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:17.107805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec9975-d61f-4473-acd5-01954c34a05b admin admin] PATH_INFO: `/v3/projects/32d7ee1883fb4d86893781156289d354/users/a6a75145fbe24974b18ef11a94414983/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:17.129619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec9975-d61f-4473-acd5-01954c34a05b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d7ee1883fb4d86893781156289d354, user_id=a6a75145fbe24974b18ef11a94414983, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:17.132449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec9975-d61f-4473-acd5-01954c34a05b admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:17.142808 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c94c5-6552-4561-884c-d51db7d1a89e admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:17.160773 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1082/2155] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:55:17 2022] PUT /identity/v3/projects/32d7ee1883fb4d86893781156289d354/users/a6a75145fbe24974b18ef11a94414983/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:17.162499 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c983f-8ac5-4985-a82e-76df9dbcdd20 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:17.162788 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c983f-8ac5-4985-a82e-76df9dbcdd20 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:17.163068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c983f-8ac5-4985-a82e-76df9dbcdd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:17.190573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:17.194160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-048c983f-8ac5-4985-a82e-76df9dbcdd20 None None] MFA Rules not processed for user `a6a75145fbe24974b18ef11a94414983`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:17.196350 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-048c983f-8ac5-4985-a82e-76df9dbcdd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:17.207930 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94974df9-df3f-4509-9249-5508f066d414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:17.208882 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94974df9-df3f-4509-9249-5508f066d414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:17.209234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94974df9-df3f-4509-9249-5508f066d414 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:17.209711 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94974df9-df3f-4509-9249-5508f066d414 admin admin] PATH_INFO: `/v3/users/ea3884a562a847ca89ff48f4e0b54303` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:17.211188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94974df9-df3f-4509-9249-5508f066d414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea3884a562a847ca89ff48f4e0b54303)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:17.213189 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94974df9-df3f-4509-9249-5508f066d414 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:17.272984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-94974df9-df3f-4509-9249-5508f066d414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea3884a562a847ca89ff48f4e0b54303'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:17.281308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1083/2156] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:17.289794 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c983f-8ac5-4985-a82e-76df9dbcdd20 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:17.291749 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-94974df9-df3f-4509-9249-5508f066d414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea3884a562a847ca89ff48f4e0b54303'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:17.292468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-048c983f-8ac5-4985-a82e-76df9dbcdd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:17.292658 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-94974df9-df3f-4509-9249-5508f066d414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea3884a562a847ca89ff48f4e0b54303'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:17.293567 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-94974df9-df3f-4509-9249-5508f066d414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea3884a562a847ca89ff48f4e0b54303'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:17.304833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-94974df9-df3f-4509-9249-5508f066d414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea3884a562a847ca89ff48f4e0b54303'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:17.319598 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1074/2157] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:55:17 2022] DELETE /identity/v3/users/ea3884a562a847ca89ff48f4e0b54303 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:17.372871 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c983f-8ac5-4985-a82e-76df9dbcdd20 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:17.464233 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f2f32-648e-465c-b4f1-e846b54fffdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:17.464914 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f2f32-648e-465c-b4f1-e846b54fffdc service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:17.465200 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f2f32-648e-465c-b4f1-e846b54fffdc service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:17.465504 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f2f32-648e-465c-b4f1-e846b54fffdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:17.467556 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e89f2f32-648e-465c-b4f1-e846b54fffdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:17.594519 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f2f32-648e-465c-b4f1-e846b54fffdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:17.596166 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f2f32-648e-465c-b4f1-e846b54fffdc service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:17.607442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1084/2158] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:55:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:55:17.755691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94974df9-df3f-4509-9249-5508f066d414 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:17.756692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-94974df9-df3f-4509-9249-5508f066d414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:17.827785 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:17.862103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94974df9-df3f-4509-9249-5508f066d414 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:17.866875 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aea079-2328-46d1-8177-ad175f6e510b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:17.867733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aea079-2328-46d1-8177-ad175f6e510b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:17.868138 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aea079-2328-46d1-8177-ad175f6e510b admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:17.868417 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aea079-2328-46d1-8177-ad175f6e510b admin admin] PATH_INFO: `/v3/projects/614ea128e5fd4b15917f670cfc7bec77` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:17.869670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aea079-2328-46d1-8177-ad175f6e510b admin admin] RBAC: Authorizing `identity:delete_project(project_id=614ea128e5fd4b15917f670cfc7bec77)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:17.871592 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aea079-2328-46d1-8177-ad175f6e510b admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:17.956614 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b4aea079-2328-46d1-8177-ad175f6e510b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '614ea128e5fd4b15917f670cfc7bec77', 'request_id': 'req-b4aea079-2328-46d1-8177-ad175f6e510b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:17.970030 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b4aea079-2328-46d1-8177-ad175f6e510b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '614ea128e5fd4b15917f670cfc7bec77', 'request_id': 'req-b4aea079-2328-46d1-8177-ad175f6e510b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:17.977000 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b4aea079-2328-46d1-8177-ad175f6e510b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '614ea128e5fd4b15917f670cfc7bec77', 'request_id': 'req-b4aea079-2328-46d1-8177-ad175f6e510b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:17.996343 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b4aea079-2328-46d1-8177-ad175f6e510b admin admin] The token cache is being invalidate because project 614ea128e5fd4b15917f670cfc7bec77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:55:17.999641 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b4aea079-2328-46d1-8177-ad175f6e510b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:18.001372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b4aea079-2328-46d1-8177-ad175f6e510b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:18.005121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1075/2159] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:55:17 2022] DELETE /identity/v3/projects/614ea128e5fd4b15917f670cfc7bec77 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:18.010240 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871efd4-fe0c-48da-bfcf-a5463a374f69 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:18.010899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871efd4-fe0c-48da-bfcf-a5463a374f69 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:18.011393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871efd4-fe0c-48da-bfcf-a5463a374f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:18.046760 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-4871efd4-fe0c-48da-bfcf-a5463a374f69 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:18.048762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-4871efd4-fe0c-48da-bfcf-a5463a374f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:18.060020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:18.144165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1085/2160] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:18.154285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1a004-8c87-4ca0-b8cf-ae1263182644 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:18.155638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1a004-8c87-4ca0-b8cf-ae1263182644 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:18.155935 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1a004-8c87-4ca0-b8cf-ae1263182644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:18.188764 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-b4e1a004-8c87-4ca0-b8cf-ae1263182644 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:18.191241 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-b4e1a004-8c87-4ca0-b8cf-ae1263182644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:18.202641 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1076/2161] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:18.207116 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871efd4-fe0c-48da-bfcf-a5463a374f69 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:18.220884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871efd4-fe0c-48da-bfcf-a5463a374f69 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:18.226393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df7fb5-2034-4a93-86bb-bc91897e713d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:18.226763 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df7fb5-2034-4a93-86bb-bc91897e713d admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:18.227149 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df7fb5-2034-4a93-86bb-bc91897e713d admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:18.227537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df7fb5-2034-4a93-86bb-bc91897e713d admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:18.229987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df7fb5-2034-4a93-86bb-bc91897e713d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:55:18.229987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df7fb5-2034-4a93-86bb-bc91897e713d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:18.230495 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df7fb5-2034-4a93-86bb-bc91897e713d admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:18.267894 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1086/2162] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:55:18.271834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1a004-8c87-4ca0-b8cf-ae1263182644 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:18.283370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1a004-8c87-4ca0-b8cf-ae1263182644 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:18.289034 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd0fc6-0162-4f20-881d-c95cebb884c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:18.289749 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd0fc6-0162-4f20-881d-c95cebb884c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:18.290041 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd0fc6-0162-4f20-881d-c95cebb884c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:18.290292 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd0fc6-0162-4f20-881d-c95cebb884c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:18.290992 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd0fc6-0162-4f20-881d-c95cebb884c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:18.292906 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd0fc6-0162-4f20-881d-c95cebb884c8 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:18.349546 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1077/2163] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:55:18 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:55:18.353166 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df7fb5-2034-4a93-86bb-bc91897e713d admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:18.401539 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df7fb5-2034-4a93-86bb-bc91897e713d admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:18.480680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4c7a7-8612-4fdc-ab3f-c45f4f0f5d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:18.481414 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4c7a7-8612-4fdc-ab3f-c45f4f0f5d6e admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:18.481719 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4c7a7-8612-4fdc-ab3f-c45f4f0f5d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:18.482181 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4c7a7-8612-4fdc-ab3f-c45f4f0f5d6e admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:18.482984 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4c7a7-8612-4fdc-ab3f-c45f4f0f5d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:18.485532 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4c7a7-8612-4fdc-ab3f-c45f4f0f5d6e admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:18.512414 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1087/2164] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:55:18 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:55:18.516281 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd0fc6-0162-4f20-881d-c95cebb884c8 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:18.536268 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd0fc6-0162-4f20-881d-c95cebb884c8 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:18.546020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc018bf-7f44-46ae-abb9-e8b369756ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:18.547679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc018bf-7f44-46ae-abb9-e8b369756ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:18.548135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc018bf-7f44-46ae-abb9-e8b369756ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:18.548683 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc018bf-7f44-46ae-abb9-e8b369756ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:18.549928 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc018bf-7f44-46ae-abb9-e8b369756ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:18.552310 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc018bf-7f44-46ae-abb9-e8b369756ef6 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:18.568765 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1078/2165] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:55:18.572911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4c7a7-8612-4fdc-ab3f-c45f4f0f5d6e admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:18.594809 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4c7a7-8612-4fdc-ab3f-c45f4f0f5d6e admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:18.601386 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd07be6-161a-4b5a-a5dd-182af610b065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:18.602465 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd07be6-161a-4b5a-a5dd-182af610b065 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:18.602835 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd07be6-161a-4b5a-a5dd-182af610b065 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:18.603563 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd07be6-161a-4b5a-a5dd-182af610b065 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:18.604563 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd07be6-161a-4b5a-a5dd-182af610b065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:18.607218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd07be6-161a-4b5a-a5dd-182af610b065 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:18.623847 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1088/2166] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:55:18.631042 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc018bf-7f44-46ae-abb9-e8b369756ef6 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:18.644328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc018bf-7f44-46ae-abb9-e8b369756ef6 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:18.650711 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859c94e-0f2f-4bfd-98d5-732ca351dbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:18.651923 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859c94e-0f2f-4bfd-98d5-732ca351dbdc admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:18.652282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859c94e-0f2f-4bfd-98d5-732ca351dbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:18.652782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859c94e-0f2f-4bfd-98d5-732ca351dbdc admin admin] PATH_INFO: `/v3/projects/2bd78950fc374976ae50ee0fa86ed4b4/users/3f9a0d1d59e745038c4c17124a62ba95/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:18.681514 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859c94e-0f2f-4bfd-98d5-732ca351dbdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd78950fc374976ae50ee0fa86ed4b4, user_id=3f9a0d1d59e745038c4c17124a62ba95, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:18.684878 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859c94e-0f2f-4bfd-98d5-732ca351dbdc admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:18.712116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1079/2167] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:55:18 2022] PUT /identity/v3/projects/2bd78950fc374976ae50ee0fa86ed4b4/users/3f9a0d1d59e745038c4c17124a62ba95/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:18.723878 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab700f6e-58cc-4d3b-a1e5-79c6a07f7f53 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:18.724540 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab700f6e-58cc-4d3b-a1e5-79c6a07f7f53 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:18.724785 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab700f6e-58cc-4d3b-a1e5-79c6a07f7f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:18.768614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-ab700f6e-58cc-4d3b-a1e5-79c6a07f7f53 None None] MFA Rules not processed for user `3f9a0d1d59e745038c4c17124a62ba95`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:18.770562 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ab700f6e-58cc-4d3b-a1e5-79c6a07f7f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:18.886711 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1089/2168] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:18.901435 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859c94e-0f2f-4bfd-98d5-732ca351dbdc admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:18.904164 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c859c94e-0f2f-4bfd-98d5-732ca351dbdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:18.977693 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859c94e-0f2f-4bfd-98d5-732ca351dbdc admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:18.983529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589cf06-b4e2-4d51-92a7-be54cc713a7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:18.985204 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589cf06-b4e2-4d51-92a7-be54cc713a7e service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:18.985981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589cf06-b4e2-4d51-92a7-be54cc713a7e service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:18.986297 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589cf06-b4e2-4d51-92a7-be54cc713a7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:18.997261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589cf06-b4e2-4d51-92a7-be54cc713a7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:18.999162 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589cf06-b4e2-4d51-92a7-be54cc713a7e service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:19.012318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1080/2169] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:55:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:55:21.726197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab700f6e-58cc-4d3b-a1e5-79c6a07f7f53 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:21.749700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:21.810746 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab700f6e-58cc-4d3b-a1e5-79c6a07f7f53 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:21.820771 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f5a99-414b-420c-980f-e9cf6a7cb53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:21.820771 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f5a99-414b-420c-980f-e9cf6a7cb53f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:21.820771 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f5a99-414b-420c-980f-e9cf6a7cb53f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:21.820771 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f5a99-414b-420c-980f-e9cf6a7cb53f admin admin] PATH_INFO: `/v3/users/3f9a0d1d59e745038c4c17124a62ba95` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:21.831652 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f5a99-414b-420c-980f-e9cf6a7cb53f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f9a0d1d59e745038c4c17124a62ba95)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:21.833241 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f5a99-414b-420c-980f-e9cf6a7cb53f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:21.971324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5c4f5a99-414b-420c-980f-e9cf6a7cb53f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f9a0d1d59e745038c4c17124a62ba95'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:21.972267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5c4f5a99-414b-420c-980f-e9cf6a7cb53f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f9a0d1d59e745038c4c17124a62ba95'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:21.973234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5c4f5a99-414b-420c-980f-e9cf6a7cb53f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f9a0d1d59e745038c4c17124a62ba95'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:21.986061 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5c4f5a99-414b-420c-980f-e9cf6a7cb53f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f9a0d1d59e745038c4c17124a62ba95'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:22.009848 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5c4f5a99-414b-420c-980f-e9cf6a7cb53f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f9a0d1d59e745038c4c17124a62ba95'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:22.031551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1090/2170] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:55:21 2022] DELETE /identity/v3/users/3f9a0d1d59e745038c4c17124a62ba95 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:22.036167 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beec26-e37e-4544-97f3-cb5f86fb14fb None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:22.036709 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beec26-e37e-4544-97f3-cb5f86fb14fb None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:22.036709 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beec26-e37e-4544-97f3-cb5f86fb14fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:22.097235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-43beec26-e37e-4544-97f3-cb5f86fb14fb None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:22.099700 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-43beec26-e37e-4544-97f3-cb5f86fb14fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:22.104199 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:22.185240 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1081/2171] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:22.192456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f5a99-414b-420c-980f-e9cf6a7cb53f admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:22.194156 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-5c4f5a99-414b-420c-980f-e9cf6a7cb53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:22.260543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f5a99-414b-420c-980f-e9cf6a7cb53f admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:22.264706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d05a1-69ce-435c-bbba-a5f8ed6dc440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:22.265415 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d05a1-69ce-435c-bbba-a5f8ed6dc440 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:22.265715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d05a1-69ce-435c-bbba-a5f8ed6dc440 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:22.266015 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d05a1-69ce-435c-bbba-a5f8ed6dc440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:22.277682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d05a1-69ce-435c-bbba-a5f8ed6dc440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:22.279195 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d05a1-69ce-435c-bbba-a5f8ed6dc440 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:22.289863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1091/2172] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:55:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:55:22.570677 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43beec26-e37e-4544-97f3-cb5f86fb14fb None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:22.572024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-43beec26-e37e-4544-97f3-cb5f86fb14fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:22.598171 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43beec26-e37e-4544-97f3-cb5f86fb14fb None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:22.606780 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26615198-36d5-4b68-baa3-7861c6426520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:22.607613 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26615198-36d5-4b68-baa3-7861c6426520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:22.608140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26615198-36d5-4b68-baa3-7861c6426520 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:22.608140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26615198-36d5-4b68-baa3-7861c6426520 admin admin] PATH_INFO: `/v3/projects/2bd78950fc374976ae50ee0fa86ed4b4` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:22.609378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26615198-36d5-4b68-baa3-7861c6426520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bd78950fc374976ae50ee0fa86ed4b4)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:22.611434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26615198-36d5-4b68-baa3-7861c6426520 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:22.662363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-26615198-36d5-4b68-baa3-7861c6426520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd78950fc374976ae50ee0fa86ed4b4', 'request_id': 'req-26615198-36d5-4b68-baa3-7861c6426520'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:22.668588 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-26615198-36d5-4b68-baa3-7861c6426520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd78950fc374976ae50ee0fa86ed4b4', 'request_id': 'req-26615198-36d5-4b68-baa3-7861c6426520'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:22.680647 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-26615198-36d5-4b68-baa3-7861c6426520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd78950fc374976ae50ee0fa86ed4b4', 'request_id': 'req-26615198-36d5-4b68-baa3-7861c6426520'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:22.694833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-26615198-36d5-4b68-baa3-7861c6426520 admin admin] The token cache is being invalidate because project 2bd78950fc374976ae50ee0fa86ed4b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:55:22.695207 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-26615198-36d5-4b68-baa3-7861c6426520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:22.695843 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-26615198-36d5-4b68-baa3-7861c6426520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:22.697461 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1082/2173] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:55:22 2022] DELETE /identity/v3/projects/2bd78950fc374976ae50ee0fa86ed4b4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:22.702408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0478daa-fcfe-46b2-b1de-1a51be7b2640 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:22.702711 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0478daa-fcfe-46b2-b1de-1a51be7b2640 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:22.703016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0478daa-fcfe-46b2-b1de-1a51be7b2640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:22.721390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-f0478daa-fcfe-46b2-b1de-1a51be7b2640 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:22.722931 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-f0478daa-fcfe-46b2-b1de-1a51be7b2640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:22.751942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:22.791431 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1092/2174] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:22.798991 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a2fb8-5c29-483d-9b26-c0b9ba864064 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:22.799438 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a2fb8-5c29-483d-9b26-c0b9ba864064 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:22.799558 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a2fb8-5c29-483d-9b26-c0b9ba864064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:22.819918 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-f65a2fb8-5c29-483d-9b26-c0b9ba864064 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:22.821226 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f65a2fb8-5c29-483d-9b26-c0b9ba864064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:22.830740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1083/2175] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:22.835174 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0478daa-fcfe-46b2-b1de-1a51be7b2640 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:22.846876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0478daa-fcfe-46b2-b1de-1a51be7b2640 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:22.851941 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ee40a-5f98-4ed9-8386-fe86627113e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:22.852592 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ee40a-5f98-4ed9-8386-fe86627113e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:22.853185 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ee40a-5f98-4ed9-8386-fe86627113e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:22.853397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ee40a-5f98-4ed9-8386-fe86627113e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:22.854360 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ee40a-5f98-4ed9-8386-fe86627113e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:55:22.854592 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ee40a-5f98-4ed9-8386-fe86627113e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:22.856353 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ee40a-5f98-4ed9-8386-fe86627113e2 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:22.872881 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1093/2176] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:55:22.873961 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a2fb8-5c29-483d-9b26-c0b9ba864064 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:22.884408 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a2fb8-5c29-483d-9b26-c0b9ba864064 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:22.889568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2d17e-7c37-4afc-a0ba-c7ea2bf613f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:22.890228 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2d17e-7c37-4afc-a0ba-c7ea2bf613f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:22.890510 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2d17e-7c37-4afc-a0ba-c7ea2bf613f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:22.890786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2d17e-7c37-4afc-a0ba-c7ea2bf613f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:22.891520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2d17e-7c37-4afc-a0ba-c7ea2bf613f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:22.893457 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2d17e-7c37-4afc-a0ba-c7ea2bf613f8 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:22.919399 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1084/2177] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:55:22 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:55:22.924373 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ee40a-5f98-4ed9-8386-fe86627113e2 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:22.934474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ee40a-5f98-4ed9-8386-fe86627113e2 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:22.994136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201a53a-40bc-46c2-ba2c-1dc6b2fd31de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:22.994827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201a53a-40bc-46c2-ba2c-1dc6b2fd31de admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:22.995127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201a53a-40bc-46c2-ba2c-1dc6b2fd31de admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:22.995404 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201a53a-40bc-46c2-ba2c-1dc6b2fd31de admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:22.996111 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201a53a-40bc-46c2-ba2c-1dc6b2fd31de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:22.998108 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201a53a-40bc-46c2-ba2c-1dc6b2fd31de admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:23.019211 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1094/2178] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:55:22 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:55:23.023313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2d17e-7c37-4afc-a0ba-c7ea2bf613f8 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:23.034805 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2d17e-7c37-4afc-a0ba-c7ea2bf613f8 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:23.039582 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b495fa2-aee9-4e52-b931-80492bb60243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:23.040245 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b495fa2-aee9-4e52-b931-80492bb60243 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:23.040532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b495fa2-aee9-4e52-b931-80492bb60243 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:23.040813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b495fa2-aee9-4e52-b931-80492bb60243 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:23.041590 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b495fa2-aee9-4e52-b931-80492bb60243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:23.043199 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b495fa2-aee9-4e52-b931-80492bb60243 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:23.058039 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1085/2179] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:55:23.058948 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201a53a-40bc-46c2-ba2c-1dc6b2fd31de admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:23.070458 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201a53a-40bc-46c2-ba2c-1dc6b2fd31de admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:23.075208 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875d729-3131-4b5f-8ad2-55b64ea00f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:23.075952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875d729-3131-4b5f-8ad2-55b64ea00f1c admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:23.076233 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875d729-3131-4b5f-8ad2-55b64ea00f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:23.076692 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875d729-3131-4b5f-8ad2-55b64ea00f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:23.077247 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875d729-3131-4b5f-8ad2-55b64ea00f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:23.078959 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875d729-3131-4b5f-8ad2-55b64ea00f1c admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:23.094648 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1095/2180] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:55:23.098821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b495fa2-aee9-4e52-b931-80492bb60243 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:23.130090 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b495fa2-aee9-4e52-b931-80492bb60243 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:23.139113 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993c406-59a4-46a7-96d4-b6e12bb4fb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:23.140259 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993c406-59a4-46a7-96d4-b6e12bb4fb7e admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:23.140547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993c406-59a4-46a7-96d4-b6e12bb4fb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:23.140818 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993c406-59a4-46a7-96d4-b6e12bb4fb7e admin admin] PATH_INFO: `/v3/projects/1699e15952f54da083f9295949548e61/users/b314cb0e905a456f8ff04aa89fe9b7ad/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:23.176211 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993c406-59a4-46a7-96d4-b6e12bb4fb7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1699e15952f54da083f9295949548e61, user_id=b314cb0e905a456f8ff04aa89fe9b7ad, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:23.179052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993c406-59a4-46a7-96d4-b6e12bb4fb7e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:23.228698 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1086/2181] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:55:23 2022] PUT /identity/v3/projects/1699e15952f54da083f9295949548e61/users/b314cb0e905a456f8ff04aa89fe9b7ad/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:23.233944 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949ea55-94b3-461e-806c-b0b7d503593a None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:23.234558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949ea55-94b3-461e-806c-b0b7d503593a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:23.235732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949ea55-94b3-461e-806c-b0b7d503593a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:23.271583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-d949ea55-94b3-461e-806c-b0b7d503593a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:23.272914 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d949ea55-94b3-461e-806c-b0b7d503593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:23.378593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1096/2182] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:55:23.391086 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993c406-59a4-46a7-96d4-b6e12bb4fb7e admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:23.393511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-3993c406-59a4-46a7-96d4-b6e12bb4fb7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:23.433508 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:23.464132 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993c406-59a4-46a7-96d4-b6e12bb4fb7e admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:23.469940 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e78a19-54f8-477d-89b2-df81e2befc55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:23.470811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e78a19-54f8-477d-89b2-df81e2befc55 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:23.471131 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e78a19-54f8-477d-89b2-df81e2befc55 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:23.471411 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e78a19-54f8-477d-89b2-df81e2befc55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:23.482072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e78a19-54f8-477d-89b2-df81e2befc55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:23.483862 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e78a19-54f8-477d-89b2-df81e2befc55 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:23.494774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1087/2183] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:55:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:55:24.086034 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379dbc2-aa4f-4bf0-b622-de2e3ea9ffce None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:24.086606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379dbc2-aa4f-4bf0-b622-de2e3ea9ffce None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:24.086606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379dbc2-aa4f-4bf0-b622-de2e3ea9ffce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:24.114447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-3379dbc2-aa4f-4bf0-b622-de2e3ea9ffce None None] MFA Rules not processed for user `b314cb0e905a456f8ff04aa89fe9b7ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:24.115665 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-3379dbc2-aa4f-4bf0-b622-de2e3ea9ffce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:24.145582 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:24.190740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1097/2184] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:24.204938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e78a19-54f8-477d-89b2-df81e2befc55 service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:24.206684 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-73e78a19-54f8-477d-89b2-df81e2befc55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:24.283116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e78a19-54f8-477d-89b2-df81e2befc55 service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:24.287119 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68161da6-d323-4d49-be5a-076e388cabf5 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:24.287465 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68161da6-d323-4d49-be5a-076e388cabf5 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:24.287753 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68161da6-d323-4d49-be5a-076e388cabf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:24.288441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0d288-4f12-4cc1-a365-1c40b486967f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:24.289637 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0d288-4f12-4cc1-a365-1c40b486967f service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:24.289997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0d288-4f12-4cc1-a365-1c40b486967f service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:24.290347 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0d288-4f12-4cc1-a365-1c40b486967f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:24.301445 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0d288-4f12-4cc1-a365-1c40b486967f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:24.303002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0d288-4f12-4cc1-a365-1c40b486967f service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:24.313645 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1088/2185] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:55:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:55:24.317917 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-68161da6-d323-4d49-be5a-076e388cabf5 None None] MFA Rules not processed for user `135410329e56486c8ccb65b1f2d87aca`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:24.319112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-68161da6-d323-4d49-be5a-076e388cabf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:24.395017 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1098/2186] 10.222.0.45 () {58 vars in 967 bytes} [Thu May 26 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:55:24.408341 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0d288-4f12-4cc1-a365-1c40b486967f service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:24.409925 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-81b0d288-4f12-4cc1-a365-1c40b486967f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:24.520476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0d288-4f12-4cc1-a365-1c40b486967f service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:24.533153 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d41b5e-4937-4a3d-a610-ab26f3831bf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e517dc43cc6d401e820c65ad4c941386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:24.533153 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d41b5e-4937-4a3d-a610-ab26f3831bf9 service swift] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:24.533153 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d41b5e-4937-4a3d-a610-ab26f3831bf9 service swift] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:24.533153 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d41b5e-4937-4a3d-a610-ab26f3831bf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:24.545904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d41b5e-4937-4a3d-a610-ab26f3831bf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:24.548414 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d41b5e-4937-4a3d-a610-ab26f3831bf9 service swift] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:24.558007 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1089/2187] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 13:55:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 13:55:25.744330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579ec97-7cea-49bb-9f7c-8242664f6019 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:25.745051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579ec97-7cea-49bb-9f7c-8242664f6019 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:25.745051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579ec97-7cea-49bb-9f7c-8242664f6019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:25.764310 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-0579ec97-7cea-49bb-9f7c-8242664f6019 None None] MFA Rules not processed for user `b314cb0e905a456f8ff04aa89fe9b7ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:25.765551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0579ec97-7cea-49bb-9f7c-8242664f6019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:25.772369 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1099/2188] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:26.607212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d41b5e-4937-4a3d-a610-ab26f3831bf9 service swift] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:26.608752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c6d41b5e-4937-4a3d-a610-ab26f3831bf9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:26.623323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d41b5e-4937-4a3d-a610-ab26f3831bf9 service swift] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:26.632849 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c638c61-c711-4df0-bfc0-9697644bffad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:26.633759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c638c61-c711-4df0-bfc0-9697644bffad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:26.634086 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c638c61-c711-4df0-bfc0-9697644bffad admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:26.634319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c638c61-c711-4df0-bfc0-9697644bffad admin admin] PATH_INFO: `/v3/users/30176875bbd349a6b3f8dc69c278a774` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:26.635939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c638c61-c711-4df0-bfc0-9697644bffad admin admin] RBAC: Authorizing `identity:delete_user(user_id=30176875bbd349a6b3f8dc69c278a774)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:26.638177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c638c61-c711-4df0-bfc0-9697644bffad admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:26.694652 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5c638c61-c711-4df0-bfc0-9697644bffad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30176875bbd349a6b3f8dc69c278a774'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:26.707398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:26.715518 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5c638c61-c711-4df0-bfc0-9697644bffad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30176875bbd349a6b3f8dc69c278a774'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:26.718137 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5c638c61-c711-4df0-bfc0-9697644bffad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30176875bbd349a6b3f8dc69c278a774'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:26.718888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5c638c61-c711-4df0-bfc0-9697644bffad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30176875bbd349a6b3f8dc69c278a774'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:26.728149 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5c638c61-c711-4df0-bfc0-9697644bffad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30176875bbd349a6b3f8dc69c278a774'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:26.742687 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1090/2189] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:55:26 2022] DELETE /identity/v3/users/30176875bbd349a6b3f8dc69c278a774 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:26.950953 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579ec97-7cea-49bb-9f7c-8242664f6019 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:26.963003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579ec97-7cea-49bb-9f7c-8242664f6019 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:27.030581 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628a4c0-d082-442c-9374-f0ca1f427af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:27.031978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628a4c0-d082-442c-9374-f0ca1f427af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:27.032261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628a4c0-d082-442c-9374-f0ca1f427af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:27.032541 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628a4c0-d082-442c-9374-f0ca1f427af6 admin admin] PATH_INFO: `/v3/projects/ccb7305abb3d4383a117d36babaa4194` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:27.033762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628a4c0-d082-442c-9374-f0ca1f427af6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb7305abb3d4383a117d36babaa4194)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:27.035652 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628a4c0-d082-442c-9374-f0ca1f427af6 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:27.084225 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-1628a4c0-d082-442c-9374-f0ca1f427af6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb7305abb3d4383a117d36babaa4194', 'request_id': 'req-1628a4c0-d082-442c-9374-f0ca1f427af6'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:27.090367 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-1628a4c0-d082-442c-9374-f0ca1f427af6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb7305abb3d4383a117d36babaa4194', 'request_id': 'req-1628a4c0-d082-442c-9374-f0ca1f427af6'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:27.094197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:27.099482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-1628a4c0-d082-442c-9374-f0ca1f427af6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb7305abb3d4383a117d36babaa4194', 'request_id': 'req-1628a4c0-d082-442c-9374-f0ca1f427af6'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:27.110874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-1628a4c0-d082-442c-9374-f0ca1f427af6 admin admin] The token cache is being invalidate because project ccb7305abb3d4383a117d36babaa4194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:55:27.111166 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-1628a4c0-d082-442c-9374-f0ca1f427af6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:27.111807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-1628a4c0-d082-442c-9374-f0ca1f427af6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:27.113448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1100/2190] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:55:26 2022] DELETE /identity/v3/projects/ccb7305abb3d4383a117d36babaa4194 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:27.118405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59eea1-0eaf-42b8-956a-668a09e88667 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:27.118691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59eea1-0eaf-42b8-956a-668a09e88667 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:27.118969 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59eea1-0eaf-42b8-956a-668a09e88667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:27.152041 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-3a59eea1-0eaf-42b8-956a-668a09e88667 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:27.153263 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-3a59eea1-0eaf-42b8-956a-668a09e88667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:27.219888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1091/2191] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:27.227447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc983935-5b69-4c7f-b405-50b60d540aa1 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:27.227741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc983935-5b69-4c7f-b405-50b60d540aa1 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:27.228063 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc983935-5b69-4c7f-b405-50b60d540aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:27.253192 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-bc983935-5b69-4c7f-b405-50b60d540aa1 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:27.254468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-bc983935-5b69-4c7f-b405-50b60d540aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:27.262303 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1101/2192] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:55:27.266556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59eea1-0eaf-42b8-956a-668a09e88667 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:27.276448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59eea1-0eaf-42b8-956a-668a09e88667 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:27.281007 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b2b8c-942e-4aa7-8a71-cb716408d972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:27.281710 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b2b8c-942e-4aa7-8a71-cb716408d972 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:27.281990 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b2b8c-942e-4aa7-8a71-cb716408d972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:27.282264 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b2b8c-942e-4aa7-8a71-cb716408d972 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:27.283171 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b2b8c-942e-4aa7-8a71-cb716408d972 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:55:27.283526 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b2b8c-942e-4aa7-8a71-cb716408d972 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:27.285193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b2b8c-942e-4aa7-8a71-cb716408d972 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:27.304245 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1092/2193] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:55:27.305718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc983935-5b69-4c7f-b405-50b60d540aa1 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:27.315342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc983935-5b69-4c7f-b405-50b60d540aa1 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:27.320212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741638f3-b736-4e9a-8bf8-41370094a03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:27.320911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741638f3-b736-4e9a-8bf8-41370094a03a admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:27.321194 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741638f3-b736-4e9a-8bf8-41370094a03a admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:27.321648 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741638f3-b736-4e9a-8bf8-41370094a03a admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:27.322420 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741638f3-b736-4e9a-8bf8-41370094a03a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:27.324438 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741638f3-b736-4e9a-8bf8-41370094a03a admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:27.352997 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1102/2194] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:55:27 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:55:27.357645 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b2b8c-942e-4aa7-8a71-cb716408d972 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:27.368147 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b2b8c-942e-4aa7-8a71-cb716408d972 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:27.429237 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc23bc-e8bf-4356-ad12-f2f32a3e405c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:27.429991 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc23bc-e8bf-4356-ad12-f2f32a3e405c admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:27.430273 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc23bc-e8bf-4356-ad12-f2f32a3e405c admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:27.430551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc23bc-e8bf-4356-ad12-f2f32a3e405c admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:27.431233 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc23bc-e8bf-4356-ad12-f2f32a3e405c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:27.433596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc23bc-e8bf-4356-ad12-f2f32a3e405c admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:27.452413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1093/2195] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:55:27 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:55:27.457283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741638f3-b736-4e9a-8bf8-41370094a03a admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:27.467807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741638f3-b736-4e9a-8bf8-41370094a03a admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:27.473059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1039e-9e40-4bfc-8ddf-505c19682e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:27.473746 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1039e-9e40-4bfc-8ddf-505c19682e83 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:27.474065 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1039e-9e40-4bfc-8ddf-505c19682e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:27.474333 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1039e-9e40-4bfc-8ddf-505c19682e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:27.475057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1039e-9e40-4bfc-8ddf-505c19682e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:27.476628 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1039e-9e40-4bfc-8ddf-505c19682e83 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:27.486896 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1103/2196] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:55:27.490783 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc23bc-e8bf-4356-ad12-f2f32a3e405c admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:27.501219 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc23bc-e8bf-4356-ad12-f2f32a3e405c admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:27.505834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475b828-6a4e-4ba3-9ccb-de5e32fa18ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:27.506512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475b828-6a4e-4ba3-9ccb-de5e32fa18ce admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:27.506798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475b828-6a4e-4ba3-9ccb-de5e32fa18ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:27.507399 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475b828-6a4e-4ba3-9ccb-de5e32fa18ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:27.508121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475b828-6a4e-4ba3-9ccb-de5e32fa18ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:27.509741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475b828-6a4e-4ba3-9ccb-de5e32fa18ce admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:27.519959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1094/2197] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:55:27.523972 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1039e-9e40-4bfc-8ddf-505c19682e83 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:27.534493 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1039e-9e40-4bfc-8ddf-505c19682e83 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:27.539505 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8a42a-5baa-4dec-aa0f-504a83f6846b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:27.540340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8a42a-5baa-4dec-aa0f-504a83f6846b admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:27.540624 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8a42a-5baa-4dec-aa0f-504a83f6846b admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:27.540902 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8a42a-5baa-4dec-aa0f-504a83f6846b admin admin] PATH_INFO: `/v3/projects/3b173e277cd1498fbee9f65b3686a724/users/c7d17f468ae7456b91d4d2cb1b2d848b/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:27.557154 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8a42a-5baa-4dec-aa0f-504a83f6846b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b173e277cd1498fbee9f65b3686a724, user_id=c7d17f468ae7456b91d4d2cb1b2d848b, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:27.559801 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8a42a-5baa-4dec-aa0f-504a83f6846b admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:27.572319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1104/2198] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:55:27 2022] PUT /identity/v3/projects/3b173e277cd1498fbee9f65b3686a724/users/c7d17f468ae7456b91d4d2cb1b2d848b/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:27.583319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b97b8c-0148-4aa5-993c-cd295b8ed06d None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:27.583605 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b97b8c-0148-4aa5-993c-cd295b8ed06d None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:27.583885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b97b8c-0148-4aa5-993c-cd295b8ed06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:27.616043 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-40b97b8c-0148-4aa5-993c-cd295b8ed06d None None] MFA Rules not processed for user `c7d17f468ae7456b91d4d2cb1b2d848b`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:27.617446 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-40b97b8c-0148-4aa5-993c-cd295b8ed06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:27.644889 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:27.711881 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1095/2199] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:27.724550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8a42a-5baa-4dec-aa0f-504a83f6846b admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:27.726421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-a0b8a42a-5baa-4dec-aa0f-504a83f6846b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:27.797981 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8a42a-5baa-4dec-aa0f-504a83f6846b admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:27.802418 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cb8bf-913c-43a4-a3cf-953f1d739b54 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3039ec7e613464c8a71f4440dfe8bc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:27.803654 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cb8bf-913c-43a4-a3cf-953f1d739b54 service glance] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:27.803946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cb8bf-913c-43a4-a3cf-953f1d739b54 service glance] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:27.804229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cb8bf-913c-43a4-a3cf-953f1d739b54 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:27.815063 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cb8bf-913c-43a4-a3cf-953f1d739b54 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:27.816360 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cb8bf-913c-43a4-a3cf-953f1d739b54 service glance] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:27.832902 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1105/2200] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:55:27 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:55:29.808731 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b97b8c-0148-4aa5-993c-cd295b8ed06d None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:29.810305 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-40b97b8c-0148-4aa5-993c-cd295b8ed06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:29.878210 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b97b8c-0148-4aa5-993c-cd295b8ed06d None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:29.882765 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033892e-a529-4eb6-ba2f-4a118492087e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:29.883659 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033892e-a529-4eb6-ba2f-4a118492087e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:29.883937 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033892e-a529-4eb6-ba2f-4a118492087e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:29.884215 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033892e-a529-4eb6-ba2f-4a118492087e admin admin] PATH_INFO: `/v3/users/a6a75145fbe24974b18ef11a94414983` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:29.885437 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033892e-a529-4eb6-ba2f-4a118492087e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a75145fbe24974b18ef11a94414983)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:29.887535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033892e-a529-4eb6-ba2f-4a118492087e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:29.948108 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-a033892e-a529-4eb6-ba2f-4a118492087e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a75145fbe24974b18ef11a94414983'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:29.966461 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-a033892e-a529-4eb6-ba2f-4a118492087e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a75145fbe24974b18ef11a94414983'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:29.967277 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-a033892e-a529-4eb6-ba2f-4a118492087e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a75145fbe24974b18ef11a94414983'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:29.967941 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-a033892e-a529-4eb6-ba2f-4a118492087e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a75145fbe24974b18ef11a94414983'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:29.979170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-a033892e-a529-4eb6-ba2f-4a118492087e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a75145fbe24974b18ef11a94414983'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:29.994519 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1096/2201] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:55:29 2022] DELETE /identity/v3/users/a6a75145fbe24974b18ef11a94414983 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:29.998972 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fb144-3acc-4e31-93c0-9b0430934dfe None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:29.999467 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fb144-3acc-4e31-93c0-9b0430934dfe None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:29.999570 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fb144-3acc-4e31-93c0-9b0430934dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:30.019841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-bd9fb144-3acc-4e31-93c0-9b0430934dfe None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:30.021082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-bd9fb144-3acc-4e31-93c0-9b0430934dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:30.093741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1106/2202] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:55:30.105502 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033892e-a529-4eb6-ba2f-4a118492087e admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:30.107121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a033892e-a529-4eb6-ba2f-4a118492087e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:30.160443 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:30.174351 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033892e-a529-4eb6-ba2f-4a118492087e admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:30.180914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06679e97-9fa5-4fdf-8d70-bd6e1f5324f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:30.181625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06679e97-9fa5-4fdf-8d70-bd6e1f5324f7 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:30.181912 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06679e97-9fa5-4fdf-8d70-bd6e1f5324f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:30.182191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06679e97-9fa5-4fdf-8d70-bd6e1f5324f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:30.194541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06679e97-9fa5-4fdf-8d70-bd6e1f5324f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:30.196043 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06679e97-9fa5-4fdf-8d70-bd6e1f5324f7 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:30.207362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1097/2203] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:55:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:55:30.538634 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fb144-3acc-4e31-93c0-9b0430934dfe None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:55:30.540247 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-bd9fb144-3acc-4e31-93c0-9b0430934dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:30.554168 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fb144-3acc-4e31-93c0-9b0430934dfe None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:55:30.558990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb3f8a-cafb-41da-8b25-ff5cdfe70665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:55:30.559863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb3f8a-cafb-41da-8b25-ff5cdfe70665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:30.560145 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb3f8a-cafb-41da-8b25-ff5cdfe70665 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:30.560423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb3f8a-cafb-41da-8b25-ff5cdfe70665 admin admin] PATH_INFO: `/v3/projects/32d7ee1883fb4d86893781156289d354` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:30.561633 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb3f8a-cafb-41da-8b25-ff5cdfe70665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d7ee1883fb4d86893781156289d354)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:55:30.564115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb3f8a-cafb-41da-8b25-ff5cdfe70665 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:55:30.588580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:30.614973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ccdb3f8a-cafb-41da-8b25-ff5cdfe70665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d7ee1883fb4d86893781156289d354', 'request_id': 'req-ccdb3f8a-cafb-41da-8b25-ff5cdfe70665'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:30.621071 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ccdb3f8a-cafb-41da-8b25-ff5cdfe70665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d7ee1883fb4d86893781156289d354', 'request_id': 'req-ccdb3f8a-cafb-41da-8b25-ff5cdfe70665'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:30.628952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ccdb3f8a-cafb-41da-8b25-ff5cdfe70665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d7ee1883fb4d86893781156289d354', 'request_id': 'req-ccdb3f8a-cafb-41da-8b25-ff5cdfe70665'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:30.639713 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ccdb3f8a-cafb-41da-8b25-ff5cdfe70665 admin admin] The token cache is being invalidate because project 32d7ee1883fb4d86893781156289d354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:55:30.640045 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ccdb3f8a-cafb-41da-8b25-ff5cdfe70665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:30.640691 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ccdb3f8a-cafb-41da-8b25-ff5cdfe70665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:55:30.642328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1107/2204] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:55:30 2022] DELETE /identity/v3/projects/32d7ee1883fb4d86893781156289d354 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:55:40.201784 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=7 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:40.636663 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:59.186521 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55686ce-9309-470c-8e4c-177100775447 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:55:59.186970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55686ce-9309-470c-8e4c-177100775447 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:55:59.187091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55686ce-9309-470c-8e4c-177100775447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:55:59.204500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-d55686ce-9309-470c-8e4c-177100775447 None None] MFA Rules not processed for user `81f42e71a4d24250874f31f4e8269e04`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:55:59.205728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-d55686ce-9309-470c-8e4c-177100775447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:55:59.261100 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1098/2205] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:55:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:56:01.276207 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb3f8a-cafb-41da-8b25-ff5cdfe70665 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:01.277736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ccdb3f8a-cafb-41da-8b25-ff5cdfe70665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:01.353426 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb3f8a-cafb-41da-8b25-ff5cdfe70665 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:01.361317 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f973f3d-dfba-464d-8b8d-4bde16f7576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:01.362213 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f973f3d-dfba-464d-8b8d-4bde16f7576d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:01.362501 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f973f3d-dfba-464d-8b8d-4bde16f7576d admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:01.362780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f973f3d-dfba-464d-8b8d-4bde16f7576d admin admin] PATH_INFO: `/v3/users/c7d17f468ae7456b91d4d2cb1b2d848b` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:01.363990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f973f3d-dfba-464d-8b8d-4bde16f7576d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7d17f468ae7456b91d4d2cb1b2d848b)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:01.368748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f973f3d-dfba-464d-8b8d-4bde16f7576d admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:01.417729 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8f973f3d-dfba-464d-8b8d-4bde16f7576d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d17f468ae7456b91d4d2cb1b2d848b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:01.418463 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8f973f3d-dfba-464d-8b8d-4bde16f7576d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d17f468ae7456b91d4d2cb1b2d848b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:01.419175 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8f973f3d-dfba-464d-8b8d-4bde16f7576d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d17f468ae7456b91d4d2cb1b2d848b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:01.430303 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8f973f3d-dfba-464d-8b8d-4bde16f7576d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d17f468ae7456b91d4d2cb1b2d848b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:01.439330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8f973f3d-dfba-464d-8b8d-4bde16f7576d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d17f468ae7456b91d4d2cb1b2d848b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:01.458949 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1108/2206] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:56:01 2022] DELETE /identity/v3/users/c7d17f468ae7456b91d4d2cb1b2d848b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:56:01.463822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7855648-3929-44bf-bde5-4050e189aaad None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:01.464306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7855648-3929-44bf-bde5-4050e189aaad None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:01.464445 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7855648-3929-44bf-bde5-4050e189aaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:01.485145 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-d7855648-3929-44bf-bde5-4050e189aaad None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:01.486547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-d7855648-3929-44bf-bde5-4050e189aaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:01.546965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1099/2207] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:56:01.557182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f973f3d-dfba-464d-8b8d-4bde16f7576d admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:01.558672 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8f973f3d-dfba-464d-8b8d-4bde16f7576d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:01.615914 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f973f3d-dfba-464d-8b8d-4bde16f7576d admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:01.619601 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f4000-c28c-4788-a1e2-4e822259686d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:01.620240 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f4000-c28c-4788-a1e2-4e822259686d service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:01.620528 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f4000-c28c-4788-a1e2-4e822259686d service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:01.620811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f4000-c28c-4788-a1e2-4e822259686d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:01.630063 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f4000-c28c-4788-a1e2-4e822259686d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:01.631507 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f4000-c28c-4788-a1e2-4e822259686d service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:01.641078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1109/2208] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:56:02.318301 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7855648-3929-44bf-bde5-4050e189aaad None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:02.321966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-d7855648-3929-44bf-bde5-4050e189aaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:02.343141 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7855648-3929-44bf-bde5-4050e189aaad None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:02.349151 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e711fba-85b0-414d-851f-7a6b4eadf1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:02.350229 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e711fba-85b0-414d-851f-7a6b4eadf1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:02.350510 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e711fba-85b0-414d-851f-7a6b4eadf1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:02.350924 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e711fba-85b0-414d-851f-7a6b4eadf1e4 admin admin] PATH_INFO: `/v3/projects/3b173e277cd1498fbee9f65b3686a724` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:02.352140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e711fba-85b0-414d-851f-7a6b4eadf1e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b173e277cd1498fbee9f65b3686a724)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:02.354191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e711fba-85b0-414d-851f-7a6b4eadf1e4 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:02.406001 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-0e711fba-85b0-414d-851f-7a6b4eadf1e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b173e277cd1498fbee9f65b3686a724', 'request_id': 'req-0e711fba-85b0-414d-851f-7a6b4eadf1e4'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:02.412852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-0e711fba-85b0-414d-851f-7a6b4eadf1e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b173e277cd1498fbee9f65b3686a724', 'request_id': 'req-0e711fba-85b0-414d-851f-7a6b4eadf1e4'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:02.419214 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-0e711fba-85b0-414d-851f-7a6b4eadf1e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b173e277cd1498fbee9f65b3686a724', 'request_id': 'req-0e711fba-85b0-414d-851f-7a6b4eadf1e4'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:02.435367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-0e711fba-85b0-414d-851f-7a6b4eadf1e4 admin admin] The token cache is being invalidate because project 3b173e277cd1498fbee9f65b3686a724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:56:02.435832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-0e711fba-85b0-414d-851f-7a6b4eadf1e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:02.436487 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-0e711fba-85b0-414d-851f-7a6b4eadf1e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:02.441667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1100/2209] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:56:02 2022] DELETE /identity/v3/projects/3b173e277cd1498fbee9f65b3686a724 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:56:02.444045 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3047-6e2e-4b7c-ac4a-01fa8f31921b None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:02.444634 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3047-6e2e-4b7c-ac4a-01fa8f31921b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:02.444634 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3047-6e2e-4b7c-ac4a-01fa8f31921b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:02.475076 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-a2aa3047-6e2e-4b7c-ac4a-01fa8f31921b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:02.476298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-a2aa3047-6e2e-4b7c-ac4a-01fa8f31921b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:02.501693 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:02.555737 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1110/2210] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:56:02.563823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1207e26-50fe-4ade-8a3d-a5f01274eceb None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:02.564330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1207e26-50fe-4ade-8a3d-a5f01274eceb None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:02.564408 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1207e26-50fe-4ade-8a3d-a5f01274eceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:02.584827 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-b1207e26-50fe-4ade-8a3d-a5f01274eceb None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:02.586026 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-b1207e26-50fe-4ade-8a3d-a5f01274eceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:02.601624 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa3047-6e2e-4b7c-ac4a-01fa8f31921b None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:02.607591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1101/2211] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:56:02.613788 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa3047-6e2e-4b7c-ac4a-01fa8f31921b None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:02.620714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d23be4-793c-45a0-a7a6-a17470b959e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:02.622089 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d23be4-793c-45a0-a7a6-a17470b959e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:02.622559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d23be4-793c-45a0-a7a6-a17470b959e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:02.622994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d23be4-793c-45a0-a7a6-a17470b959e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:02.623895 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d23be4-793c-45a0-a7a6-a17470b959e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:56:02.624371 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d23be4-793c-45a0-a7a6-a17470b959e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:02.626441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d23be4-793c-45a0-a7a6-a17470b959e0 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:02.643089 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1111/2212] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:56:02.648432 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1207e26-50fe-4ade-8a3d-a5f01274eceb None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:02.657991 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1207e26-50fe-4ade-8a3d-a5f01274eceb None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:02.670069 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d48f7-3d29-4df2-b0e4-346c53673af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:02.670749 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d48f7-3d29-4df2-b0e4-346c53673af8 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:02.671030 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d48f7-3d29-4df2-b0e4-346c53673af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:02.671461 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d48f7-3d29-4df2-b0e4-346c53673af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:02.672159 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d48f7-3d29-4df2-b0e4-346c53673af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:02.674267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d48f7-3d29-4df2-b0e4-346c53673af8 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:02.697201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:02.708810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1102/2213] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:56:02 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:56:02.710581 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d23be4-793c-45a0-a7a6-a17470b959e0 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:02.720835 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d23be4-793c-45a0-a7a6-a17470b959e0 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:02.793238 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c38614-d57b-4b6f-95e2-9524f2424997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:02.794011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c38614-d57b-4b6f-95e2-9524f2424997 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:02.794227 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c38614-d57b-4b6f-95e2-9524f2424997 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:02.794503 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c38614-d57b-4b6f-95e2-9524f2424997 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:02.795190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c38614-d57b-4b6f-95e2-9524f2424997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:02.797097 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c38614-d57b-4b6f-95e2-9524f2424997 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:02.820328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1112/2214] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:56:02 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:56:02.821517 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d48f7-3d29-4df2-b0e4-346c53673af8 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:02.831609 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d48f7-3d29-4df2-b0e4-346c53673af8 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:02.837003 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebb317-8e31-4792-a0cc-b03c29de091f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:02.837699 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebb317-8e31-4792-a0cc-b03c29de091f admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:02.837986 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebb317-8e31-4792-a0cc-b03c29de091f admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:02.838262 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebb317-8e31-4792-a0cc-b03c29de091f admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:02.838987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebb317-8e31-4792-a0cc-b03c29de091f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:02.840596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebb317-8e31-4792-a0cc-b03c29de091f admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:02.851104 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1103/2215] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:56:02.855354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c38614-d57b-4b6f-95e2-9524f2424997 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:02.868124 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c38614-d57b-4b6f-95e2-9524f2424997 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:02.873993 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ebbea-c8fa-4209-ae3f-3d131da1cd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:02.875420 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ebbea-c8fa-4209-ae3f-3d131da1cd4e admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:02.875897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ebbea-c8fa-4209-ae3f-3d131da1cd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:02.876202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ebbea-c8fa-4209-ae3f-3d131da1cd4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:02.877363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ebbea-c8fa-4209-ae3f-3d131da1cd4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:02.879153 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ebbea-c8fa-4209-ae3f-3d131da1cd4e admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:02.891988 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1113/2216] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:56:02.896173 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebb317-8e31-4792-a0cc-b03c29de091f admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:02.906675 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebb317-8e31-4792-a0cc-b03c29de091f admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:02.911586 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff738c44-5cae-440c-82cd-fc9b495844ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:02.912577 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff738c44-5cae-440c-82cd-fc9b495844ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:02.912928 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff738c44-5cae-440c-82cd-fc9b495844ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:02.913396 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff738c44-5cae-440c-82cd-fc9b495844ae admin admin] PATH_INFO: `/v3/projects/954e864e9bcc413d93c42a7622044393/users/39104dbf81154a878b61f10f0f121e1e/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:02.928958 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff738c44-5cae-440c-82cd-fc9b495844ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=954e864e9bcc413d93c42a7622044393, user_id=39104dbf81154a878b61f10f0f121e1e, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:02.931706 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff738c44-5cae-440c-82cd-fc9b495844ae admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:02.945595 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1104/2217] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:56:02 2022] PUT /identity/v3/projects/954e864e9bcc413d93c42a7622044393/users/39104dbf81154a878b61f10f0f121e1e/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:56:02.957380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd644e8-6af4-4a75-9e29-fcdcc29d4096 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:02.957872 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd644e8-6af4-4a75-9e29-fcdcc29d4096 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:02.958161 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd644e8-6af4-4a75-9e29-fcdcc29d4096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:02.988232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-4cd644e8-6af4-4a75-9e29-fcdcc29d4096 None None] MFA Rules not processed for user `39104dbf81154a878b61f10f0f121e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:02.990922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-4cd644e8-6af4-4a75-9e29-fcdcc29d4096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:03.109659 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1114/2218] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:56:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:56:03.121797 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff738c44-5cae-440c-82cd-fc9b495844ae admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:03.128244 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ff738c44-5cae-440c-82cd-fc9b495844ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:03.281975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff738c44-5cae-440c-82cd-fc9b495844ae admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:03.288098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b07195-6294-4f29-81d3-576fa4c53765 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:03.288766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b07195-6294-4f29-81d3-576fa4c53765 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:03.289045 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b07195-6294-4f29-81d3-576fa4c53765 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:03.289360 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b07195-6294-4f29-81d3-576fa4c53765 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:03.308752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b07195-6294-4f29-81d3-576fa4c53765 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:03.311283 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b07195-6294-4f29-81d3-576fa4c53765 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:03.325361 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1105/2219] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:56:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:56:06.089201 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d8497-0e83-4f3c-8ceb-2c6caba7c257 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:06.089745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d8497-0e83-4f3c-8ceb-2c6caba7c257 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:06.089847 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d8497-0e83-4f3c-8ceb-2c6caba7c257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:06.107249 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-d12d8497-0e83-4f3c-8ceb-2c6caba7c257 None None] MFA Rules not processed for user `000330dc3f1a4b38b58686ee37b3b78c`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:06.108431 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d12d8497-0e83-4f3c-8ceb-2c6caba7c257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:06.121262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:06.164822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1115/2220] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:56:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:56:11.671937 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5460b-fba4-4e99-a6d9-3135b6383cbb None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:11.672460 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5460b-fba4-4e99-a6d9-3135b6383cbb None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:11.672582 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5460b-fba4-4e99-a6d9-3135b6383cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:11.690634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-13d5460b-fba4-4e99-a6d9-3135b6383cbb None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:11.691834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-13d5460b-fba4-4e99-a6d9-3135b6383cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:11.749855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1106/2221] 10.222.0.55 () {58 vars in 1016 bytes} [Thu May 26 13:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:56:11.770710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d8497-0e83-4f3c-8ceb-2c6caba7c257 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:11.772702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d12d8497-0e83-4f3c-8ceb-2c6caba7c257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:11.900716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d8497-0e83-4f3c-8ceb-2c6caba7c257 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:11.909912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87941fc-a196-497e-973a-148ee2051bb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:11.910701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87941fc-a196-497e-973a-148ee2051bb0 service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:11.911048 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87941fc-a196-497e-973a-148ee2051bb0 service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:11.911392 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87941fc-a196-497e-973a-148ee2051bb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:11.921511 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87941fc-a196-497e-973a-148ee2051bb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:11.924370 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87941fc-a196-497e-973a-148ee2051bb0 service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:11.935440 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1116/2222] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:56:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:56:14.063942 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5460b-fba4-4e99-a6d9-3135b6383cbb None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:14.073819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5460b-fba4-4e99-a6d9-3135b6383cbb None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:14.078404 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048e3ec-ae37-4ae1-9a92-926b9fe05107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:14.079260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048e3ec-ae37-4ae1-9a92-926b9fe05107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:14.079544 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048e3ec-ae37-4ae1-9a92-926b9fe05107 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:14.079820 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048e3ec-ae37-4ae1-9a92-926b9fe05107 admin admin] PATH_INFO: `/v3/users/39104dbf81154a878b61f10f0f121e1e` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:14.081044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048e3ec-ae37-4ae1-9a92-926b9fe05107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39104dbf81154a878b61f10f0f121e1e)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:14.083002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048e3ec-ae37-4ae1-9a92-926b9fe05107 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:14.127702 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:14.130381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-d048e3ec-ae37-4ae1-9a92-926b9fe05107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39104dbf81154a878b61f10f0f121e1e'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:14.143300 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-d048e3ec-ae37-4ae1-9a92-926b9fe05107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39104dbf81154a878b61f10f0f121e1e'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:14.143962 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-d048e3ec-ae37-4ae1-9a92-926b9fe05107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39104dbf81154a878b61f10f0f121e1e'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:14.144558 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-d048e3ec-ae37-4ae1-9a92-926b9fe05107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39104dbf81154a878b61f10f0f121e1e'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:14.151890 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-d048e3ec-ae37-4ae1-9a92-926b9fe05107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39104dbf81154a878b61f10f0f121e1e'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:14.164341 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1107/2223] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:56:14 2022] DELETE /identity/v3/users/39104dbf81154a878b61f10f0f121e1e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:56:14.168810 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd1364-2af2-4953-b0c1-df3f72c9808f None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:14.169321 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd1364-2af2-4953-b0c1-df3f72c9808f None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:14.169430 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd1364-2af2-4953-b0c1-df3f72c9808f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:14.187706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-44bd1364-2af2-4953-b0c1-df3f72c9808f None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:14.188959 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-44bd1364-2af2-4953-b0c1-df3f72c9808f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:14.265903 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1117/2224] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:56:14.272250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048e3ec-ae37-4ae1-9a92-926b9fe05107 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:14.276016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-d048e3ec-ae37-4ae1-9a92-926b9fe05107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:14.347373 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048e3ec-ae37-4ae1-9a92-926b9fe05107 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:14.351885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b143f-5e02-4e95-abb3-2a5c2a487162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:14.352638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b143f-5e02-4e95-abb3-2a5c2a487162 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:14.352963 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b143f-5e02-4e95-abb3-2a5c2a487162 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:14.353485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b143f-5e02-4e95-abb3-2a5c2a487162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:14.366388 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b143f-5e02-4e95-abb3-2a5c2a487162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:14.367906 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b143f-5e02-4e95-abb3-2a5c2a487162 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:14.378724 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1108/2225] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:56:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:56:14.780322 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd1364-2af2-4953-b0c1-df3f72c9808f None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:14.781897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-44bd1364-2af2-4953-b0c1-df3f72c9808f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:14.794797 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd1364-2af2-4953-b0c1-df3f72c9808f None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:14.799652 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c53aad-fa98-412d-b314-f6e256713de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:14.800521 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c53aad-fa98-412d-b314-f6e256713de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:14.800809 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c53aad-fa98-412d-b314-f6e256713de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:14.801092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c53aad-fa98-412d-b314-f6e256713de5 admin admin] PATH_INFO: `/v3/projects/954e864e9bcc413d93c42a7622044393` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:14.802377 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c53aad-fa98-412d-b314-f6e256713de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=954e864e9bcc413d93c42a7622044393)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:14.804282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c53aad-fa98-412d-b314-f6e256713de5 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:14.826038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:14.851701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-17c53aad-fa98-412d-b314-f6e256713de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954e864e9bcc413d93c42a7622044393', 'request_id': 'req-17c53aad-fa98-412d-b314-f6e256713de5'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:14.857712 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-17c53aad-fa98-412d-b314-f6e256713de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954e864e9bcc413d93c42a7622044393', 'request_id': 'req-17c53aad-fa98-412d-b314-f6e256713de5'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:14.865432 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-17c53aad-fa98-412d-b314-f6e256713de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954e864e9bcc413d93c42a7622044393', 'request_id': 'req-17c53aad-fa98-412d-b314-f6e256713de5'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:14.877249 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-17c53aad-fa98-412d-b314-f6e256713de5 admin admin] The token cache is being invalidate because project 954e864e9bcc413d93c42a7622044393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:56:14.877581 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-17c53aad-fa98-412d-b314-f6e256713de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:14.878340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-17c53aad-fa98-412d-b314-f6e256713de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:56:14.880101 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1118/2226] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:56:14 2022] DELETE /identity/v3/projects/954e864e9bcc413d93c42a7622044393 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:56:14.885441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c3c25-9c29-414c-86cc-a43f842a8d51 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:14.885733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c3c25-9c29-414c-86cc-a43f842a8d51 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:14.886007 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c3c25-9c29-414c-86cc-a43f842a8d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:14.903817 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-394c3c25-9c29-414c-86cc-a43f842a8d51 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:14.904997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-394c3c25-9c29-414c-86cc-a43f842a8d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:14.963876 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1109/2227] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:56:14.971631 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121b3b6-b248-4b96-8684-24217b7f8ee1 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:14.971922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121b3b6-b248-4b96-8684-24217b7f8ee1 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:14.972204 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121b3b6-b248-4b96-8684-24217b7f8ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:14.990583 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-7121b3b6-b248-4b96-8684-24217b7f8ee1 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:14.991795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7121b3b6-b248-4b96-8684-24217b7f8ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:15.000267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1119/2228] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:56:15.004306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c3c25-9c29-414c-86cc-a43f842a8d51 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:15.014697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c3c25-9c29-414c-86cc-a43f842a8d51 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:15.019291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fd448-ad67-4f1e-bf97-4b1ebc5a3067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:15.019944 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fd448-ad67-4f1e-bf97-4b1ebc5a3067 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:15.020231 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fd448-ad67-4f1e-bf97-4b1ebc5a3067 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:15.020503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fd448-ad67-4f1e-bf97-4b1ebc5a3067 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:15.021855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fd448-ad67-4f1e-bf97-4b1ebc5a3067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:56:15.022188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fd448-ad67-4f1e-bf97-4b1ebc5a3067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:15.023968 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fd448-ad67-4f1e-bf97-4b1ebc5a3067 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:15.035895 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1110/2229] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:56:15.040537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121b3b6-b248-4b96-8684-24217b7f8ee1 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:15.049702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121b3b6-b248-4b96-8684-24217b7f8ee1 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:15.054922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490f99f-331f-43ac-a6f3-3c58eb402f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:15.055576 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490f99f-331f-43ac-a6f3-3c58eb402f9a admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:15.055859 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490f99f-331f-43ac-a6f3-3c58eb402f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:15.056138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490f99f-331f-43ac-a6f3-3c58eb402f9a admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:15.056859 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490f99f-331f-43ac-a6f3-3c58eb402f9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:15.058815 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490f99f-331f-43ac-a6f3-3c58eb402f9a admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:15.086982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1120/2230] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:56:15 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:56:15.094560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fd448-ad67-4f1e-bf97-4b1ebc5a3067 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:15.109611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fd448-ad67-4f1e-bf97-4b1ebc5a3067 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:15.184720 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:15.204730 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f52997-5b39-4610-a403-c02d5529cb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:15.205154 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f52997-5b39-4610-a403-c02d5529cb89 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:15.205474 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f52997-5b39-4610-a403-c02d5529cb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:15.205753 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f52997-5b39-4610-a403-c02d5529cb89 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:15.206565 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f52997-5b39-4610-a403-c02d5529cb89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:15.209141 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f52997-5b39-4610-a403-c02d5529cb89 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:15.232924 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1111/2231] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:56:15 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:56:15.236908 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490f99f-331f-43ac-a6f3-3c58eb402f9a admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:15.247984 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490f99f-331f-43ac-a6f3-3c58eb402f9a admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:15.253116 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e40a1f-b17e-4796-9f6d-ce4365a8c044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:15.254110 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e40a1f-b17e-4796-9f6d-ce4365a8c044 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:15.254422 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e40a1f-b17e-4796-9f6d-ce4365a8c044 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:15.254834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e40a1f-b17e-4796-9f6d-ce4365a8c044 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:15.256326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e40a1f-b17e-4796-9f6d-ce4365a8c044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:15.258308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e40a1f-b17e-4796-9f6d-ce4365a8c044 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:15.270638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1121/2232] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:56:15.275078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f52997-5b39-4610-a403-c02d5529cb89 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:15.289152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f52997-5b39-4610-a403-c02d5529cb89 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:15.294086 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32665339-b627-45be-87b1-1a8ce75ff82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:15.294927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32665339-b627-45be-87b1-1a8ce75ff82b admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:15.295472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32665339-b627-45be-87b1-1a8ce75ff82b admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:15.295472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32665339-b627-45be-87b1-1a8ce75ff82b admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:15.296781 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32665339-b627-45be-87b1-1a8ce75ff82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:15.298645 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32665339-b627-45be-87b1-1a8ce75ff82b admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:15.310135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1112/2233] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:56:15.314763 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e40a1f-b17e-4796-9f6d-ce4365a8c044 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:15.325840 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e40a1f-b17e-4796-9f6d-ce4365a8c044 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:15.333886 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09751ac9-6f8b-478a-a1fb-3efcf580938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:15.334703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09751ac9-6f8b-478a-a1fb-3efcf580938e admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:15.335367 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09751ac9-6f8b-478a-a1fb-3efcf580938e admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:15.335367 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09751ac9-6f8b-478a-a1fb-3efcf580938e admin admin] PATH_INFO: `/v3/projects/adfb0764f7554085978fbab9b2374a72/users/4205d2fd122c490199731f136d81d9d0/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:15.351956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09751ac9-6f8b-478a-a1fb-3efcf580938e admin admin] RBAC: Authorizing `identity:create_grant(project_id=adfb0764f7554085978fbab9b2374a72, user_id=4205d2fd122c490199731f136d81d9d0, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:15.354641 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09751ac9-6f8b-478a-a1fb-3efcf580938e admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:15.368233 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1122/2234] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:56:15 2022] PUT /identity/v3/projects/adfb0764f7554085978fbab9b2374a72/users/4205d2fd122c490199731f136d81d9d0/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:56:15.378699 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3036d85-b91e-456f-9abf-3827937649e6 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:15.378997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3036d85-b91e-456f-9abf-3827937649e6 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:15.379288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3036d85-b91e-456f-9abf-3827937649e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:15.410502 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-e3036d85-b91e-456f-9abf-3827937649e6 None None] MFA Rules not processed for user `4205d2fd122c490199731f136d81d9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:15.412722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e3036d85-b91e-456f-9abf-3827937649e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:15.477912 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1113/2235] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:56:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:56:15.488395 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09751ac9-6f8b-478a-a1fb-3efcf580938e admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:15.490807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-09751ac9-6f8b-478a-a1fb-3efcf580938e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:15.547801 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09751ac9-6f8b-478a-a1fb-3efcf580938e admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:15.552018 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4952aa-4224-4299-aba3-bcb5e43ffd4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:15.552748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4952aa-4224-4299-aba3-bcb5e43ffd4a service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:15.553092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4952aa-4224-4299-aba3-bcb5e43ffd4a service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:15.553845 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4952aa-4224-4299-aba3-bcb5e43ffd4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:15.563908 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4952aa-4224-4299-aba3-bcb5e43ffd4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:15.565387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4952aa-4224-4299-aba3-bcb5e43ffd4a service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:15.576267 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1123/2236] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:56:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:56:16.797422 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d4637-1a64-44cf-a472-2e665604afb8 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:16.797949 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d4637-1a64-44cf-a472-2e665604afb8 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:16.797949 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d4637-1a64-44cf-a472-2e665604afb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:16.817647 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-e45d4637-1a64-44cf-a472-2e665604afb8 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:16.818862 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e45d4637-1a64-44cf-a472-2e665604afb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:16.888275 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1114/2237] 10.222.0.55 () {58 vars in 1016 bytes} [Thu May 26 13:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:56:17.018266 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4952aa-4224-4299-aba3-bcb5e43ffd4a service cinder] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:17.020299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-9b4952aa-4224-4299-aba3-bcb5e43ffd4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:17.020832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e8c9f-daf8-48c1-b1ae-7635bf2ee5ed None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:17.021128 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e8c9f-daf8-48c1-b1ae-7635bf2ee5ed None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:17.021545 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e8c9f-daf8-48c1-b1ae-7635bf2ee5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:17.041532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-033e8c9f-daf8-48c1-b1ae-7635bf2ee5ed None None] MFA Rules not processed for user `4205d2fd122c490199731f136d81d9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:17.042753 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-033e8c9f-daf8-48c1-b1ae-7635bf2ee5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:17.062067 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1115/2238] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:56:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:56:17.074089 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:17.104860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4952aa-4224-4299-aba3-bcb5e43ffd4a service cinder] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:17.110642 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d80d45-d674-4190-993b-7b71885b998b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:17.111286 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d80d45-d674-4190-993b-7b71885b998b service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:17.111566 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d80d45-d674-4190-993b-7b71885b998b service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:17.111841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d80d45-d674-4190-993b-7b71885b998b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:17.120198 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d80d45-d674-4190-993b-7b71885b998b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:17.121808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d80d45-d674-4190-993b-7b71885b998b service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:17.132058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1124/2239] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:56:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:56:22.143055 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e15da-299f-4d83-a28f-565395fa634f None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:22.143550 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e15da-299f-4d83-a28f-565395fa634f None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:22.143663 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e15da-299f-4d83-a28f-565395fa634f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:22.161634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-176e15da-299f-4d83-a28f-565395fa634f None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:22.162818 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-176e15da-299f-4d83-a28f-565395fa634f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:22.171250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1116/2240] 10.222.0.55 () {58 vars in 1016 bytes} [Thu May 26 13:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:56:22.198042 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d80d45-d674-4190-993b-7b71885b998b service nova] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:22.209209 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d80d45-d674-4190-993b-7b71885b998b service nova] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:22.216329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db48b3d-12c3-4263-8c17-1a5738435cad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:22.216980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db48b3d-12c3-4263-8c17-1a5738435cad service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:22.217297 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db48b3d-12c3-4263-8c17-1a5738435cad service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:22.217580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db48b3d-12c3-4263-8c17-1a5738435cad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:22.227483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db48b3d-12c3-4263-8c17-1a5738435cad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:22.229107 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db48b3d-12c3-4263-8c17-1a5738435cad service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:22.239402 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1125/2241] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:56:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:56:27.284725 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d81b6-40e0-4f9a-a486-6586d3efed1b None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:27.285294 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d81b6-40e0-4f9a-a486-6586d3efed1b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:27.285397 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d81b6-40e0-4f9a-a486-6586d3efed1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:27.311797 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-6a2d81b6-40e0-4f9a-a486-6586d3efed1b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:27.313090 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6a2d81b6-40e0-4f9a-a486-6586d3efed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:27.325978 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1117/2242] 10.222.0.55 () {58 vars in 1016 bytes} [Thu May 26 13:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:56:27.384996 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db48b3d-12c3-4263-8c17-1a5738435cad service nova] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:27.386376 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7db48b3d-12c3-4263-8c17-1a5738435cad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:27.404491 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db48b3d-12c3-4263-8c17-1a5738435cad service nova] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:27.412725 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157cadb-942b-4f57-9683-a0c7ec699abf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:27.413457 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157cadb-942b-4f57-9683-a0c7ec699abf service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:27.414139 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157cadb-942b-4f57-9683-a0c7ec699abf service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:27.414572 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157cadb-942b-4f57-9683-a0c7ec699abf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:27.425511 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157cadb-942b-4f57-9683-a0c7ec699abf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:27.427677 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157cadb-942b-4f57-9683-a0c7ec699abf service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:27.440047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1126/2243] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:56:33.163429 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec790939-48a7-4f7f-893e-88ecd4fab8ca None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:33.163916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec790939-48a7-4f7f-893e-88ecd4fab8ca None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:33.164163 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec790939-48a7-4f7f-893e-88ecd4fab8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:33.215764 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-ec790939-48a7-4f7f-893e-88ecd4fab8ca None None] MFA Rules not processed for user `135410329e56486c8ccb65b1f2d87aca`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:33.216967 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ec790939-48a7-4f7f-893e-88ecd4fab8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:33.228001 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:33.286390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1118/2244] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 13:56:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:56:33.335047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157cadb-942b-4f57-9683-a0c7ec699abf service nova] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:33.336594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-f157cadb-942b-4f57-9683-a0c7ec699abf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:33.434606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157cadb-942b-4f57-9683-a0c7ec699abf service nova] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:33.439798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd682e33-f209-4f2c-b361-7d243750ee37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e517dc43cc6d401e820c65ad4c941386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:33.440536 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd682e33-f209-4f2c-b361-7d243750ee37 service swift] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:33.440938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd682e33-f209-4f2c-b361-7d243750ee37 service swift] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:33.441180 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd682e33-f209-4f2c-b361-7d243750ee37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:33.449924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd682e33-f209-4f2c-b361-7d243750ee37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:33.451498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd682e33-f209-4f2c-b361-7d243750ee37 service swift] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:33.459556 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1127/2245] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 13:56:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 13:56:33.544493 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e1ee1-688d-41da-9371-4f1fd62f4f61 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:33.544842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e1ee1-688d-41da-9371-4f1fd62f4f61 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:33.545130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e1ee1-688d-41da-9371-4f1fd62f4f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:33.566295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-744e1ee1-688d-41da-9371-4f1fd62f4f61 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:33.567517 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-744e1ee1-688d-41da-9371-4f1fd62f4f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:33.576790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1119/2246] 10.222.0.55 () {58 vars in 1016 bytes} [Thu May 26 13:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:56:33.608909 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd682e33-f209-4f2c-b361-7d243750ee37 service swift] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:33.622508 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd682e33-f209-4f2c-b361-7d243750ee37 service swift] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:33.628479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a03407-9bb9-4fe5-9ace-e33ea88bd548 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:33.629128 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03407-9bb9-4fe5-9ace-e33ea88bd548 service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:33.629455 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03407-9bb9-4fe5-9ace-e33ea88bd548 service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:33.629743 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03407-9bb9-4fe5-9ace-e33ea88bd548 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:33.641848 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a03407-9bb9-4fe5-9ace-e33ea88bd548 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:33.643478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a03407-9bb9-4fe5-9ace-e33ea88bd548 service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:33.655553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1128/2247] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:56:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:56:37.872450 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e1ee1-688d-41da-9371-4f1fd62f4f61 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:37.874549 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-744e1ee1-688d-41da-9371-4f1fd62f4f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:38.080022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e1ee1-688d-41da-9371-4f1fd62f4f61 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:38.091381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9542e6b-0eb0-427b-8103-07ce54cb1211 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0db68b7fda4da29eb13689f3fd7b5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:38.092058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9542e6b-0eb0-427b-8103-07ce54cb1211 service placement] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:38.092349 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9542e6b-0eb0-427b-8103-07ce54cb1211 service placement] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:38.092631 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9542e6b-0eb0-427b-8103-07ce54cb1211 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:38.094630 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-d9542e6b-0eb0-427b-8103-07ce54cb1211 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:38.117427 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9542e6b-0eb0-427b-8103-07ce54cb1211 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:38.121777 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9542e6b-0eb0-427b-8103-07ce54cb1211 service placement] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:38.152149 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1120/2248] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:56:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:56:39.881322 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060f8c9-0766-45f1-88d9-add1949d4a71 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:39.881981 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060f8c9-0766-45f1-88d9-add1949d4a71 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:39.881981 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060f8c9-0766-45f1-88d9-add1949d4a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:39.904004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-8060f8c9-0766-45f1-88d9-add1949d4a71 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:39.905595 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8060f8c9-0766-45f1-88d9-add1949d4a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:39.916070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1129/2249] 10.222.0.55 () {58 vars in 1016 bytes} [Thu May 26 13:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:56:39.939968 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9542e6b-0eb0-427b-8103-07ce54cb1211 service placement] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:39.953817 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9542e6b-0eb0-427b-8103-07ce54cb1211 service placement] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:39.959822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2ce69-394e-4e0a-9d96-414797efe40d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:39.960541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2ce69-394e-4e0a-9d96-414797efe40d service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:39.960900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2ce69-394e-4e0a-9d96-414797efe40d service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:39.961254 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2ce69-394e-4e0a-9d96-414797efe40d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:39.970620 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2ce69-394e-4e0a-9d96-414797efe40d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:39.972339 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2ce69-394e-4e0a-9d96-414797efe40d service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:39.985674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1121/2250] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:56:49.897676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=76 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:49.978012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=72 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:59.013213 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17893985-35b2-4195-8096-bef733349c93 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:59.013738 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17893985-35b2-4195-8096-bef733349c93 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:59.013937 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17893985-35b2-4195-8096-bef733349c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:59.037496 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-17893985-35b2-4195-8096-bef733349c93 None None] MFA Rules not processed for user `135410329e56486c8ccb65b1f2d87aca`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:59.038706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-17893985-35b2-4195-8096-bef733349c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:59.046251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1130/2251] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 13:56:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:56:59.059805 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2ce69-394e-4e0a-9d96-414797efe40d service nova] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:59.071253 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2ce69-394e-4e0a-9d96-414797efe40d service nova] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:59.076279 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569175aa-4762-40de-a8d3-7f2806e63e8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e517dc43cc6d401e820c65ad4c941386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:59.077001 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569175aa-4762-40de-a8d3-7f2806e63e8e service swift] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:59.077451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569175aa-4762-40de-a8d3-7f2806e63e8e service swift] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:59.077760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569175aa-4762-40de-a8d3-7f2806e63e8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:59.086483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569175aa-4762-40de-a8d3-7f2806e63e8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:59.088105 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569175aa-4762-40de-a8d3-7f2806e63e8e service swift] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:59.096405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1122/2252] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 13:56:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 13:56:59.214681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491399a7-e0c3-4d9d-ac71-41dfcdde5aff None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:59.214979 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491399a7-e0c3-4d9d-ac71-41dfcdde5aff None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:59.215264 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491399a7-e0c3-4d9d-ac71-41dfcdde5aff None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:59.216704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1131/2253] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 13:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 13:56:59.223744 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda59cc1-8386-4fb1-878b-a3cc0e84158a None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:59.224143 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda59cc1-8386-4fb1-878b-a3cc0e84158a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:59.225072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda59cc1-8386-4fb1-878b-a3cc0e84158a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:59.310282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-dda59cc1-8386-4fb1-878b-a3cc0e84158a None None] MFA Rules not processed for user `1994043a81bb454297c208839794a479`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:59.313317 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-dda59cc1-8386-4fb1-878b-a3cc0e84158a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:59.324976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1123/2254] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 13:56:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:56:59.344949 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491399a7-e0c3-4d9d-ac71-41dfcdde5aff None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:59.347031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-491399a7-e0c3-4d9d-ac71-41dfcdde5aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:59.448510 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491399a7-e0c3-4d9d-ac71-41dfcdde5aff None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:59.452914 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f8ee9-1054-4cba-a411-3368fc8f6098 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3039ec7e613464c8a71f4440dfe8bc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:59.453740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f8ee9-1054-4cba-a411-3368fc8f6098 service glance] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:59.454095 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f8ee9-1054-4cba-a411-3368fc8f6098 service glance] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:59.454462 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f8ee9-1054-4cba-a411-3368fc8f6098 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:59.467181 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f8ee9-1054-4cba-a411-3368fc8f6098 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:59.468868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f8ee9-1054-4cba-a411-3368fc8f6098 service glance] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:59.481833 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1132/2255] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:56:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:56:59.551502 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf1710-723b-48cc-9962-da47c6baf8de None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:59.552007 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf1710-723b-48cc-9962-da47c6baf8de None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:59.552318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf1710-723b-48cc-9962-da47c6baf8de None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:59.554343 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1124/2256] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 13:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:56:59.559231 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2fef7-4369-4be4-8802-1ebd844020bf None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:59.559526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2fef7-4369-4be4-8802-1ebd844020bf None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:59.559829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2fef7-4369-4be4-8802-1ebd844020bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:59.580756 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-55d2fef7-4369-4be4-8802-1ebd844020bf None None] MFA Rules not processed for user `45105360300a4cae802fdbda91b9d5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:59.582019 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-55d2fef7-4369-4be4-8802-1ebd844020bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:59.637782 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1133/2257] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 13:56:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:56:59.649641 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf1710-723b-48cc-9962-da47c6baf8de None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:59.651483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-87cf1710-723b-48cc-9962-da47c6baf8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:59.665343 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf1710-723b-48cc-9962-da47c6baf8de None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:59.669035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce483f-dc43-4e4f-8118-dff9c38a44b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:59.669698 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce483f-dc43-4e4f-8118-dff9c38a44b7 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:59.669987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce483f-dc43-4e4f-8118-dff9c38a44b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:59.670326 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce483f-dc43-4e4f-8118-dff9c38a44b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:59.672132 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1139b-2817-4193-b589-e42df082b584 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:59.672428 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1139b-2817-4193-b589-e42df082b584 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:59.672708 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1139b-2817-4193-b589-e42df082b584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:59.682114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce483f-dc43-4e4f-8118-dff9c38a44b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:59.683620 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce483f-dc43-4e4f-8118-dff9c38a44b7 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:59.692717 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1125/2258] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:56:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:56:59.692968 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-9be1139b-2817-4193-b589-e42df082b584 None None] MFA Rules not processed for user `135410329e56486c8ccb65b1f2d87aca`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:59.694337 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-9be1139b-2817-4193-b589-e42df082b584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:59.701456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1134/2259] 10.222.0.45 () {58 vars in 967 bytes} [Thu May 26 13:56:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:56:59.713820 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce483f-dc43-4e4f-8118-dff9c38a44b7 service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:59.726294 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce483f-dc43-4e4f-8118-dff9c38a44b7 service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:59.732211 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97e0a6-6146-46c4-b12a-80009e23bb23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e517dc43cc6d401e820c65ad4c941386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:59.732859 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97e0a6-6146-46c4-b12a-80009e23bb23 service swift] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:59.733147 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97e0a6-6146-46c4-b12a-80009e23bb23 service swift] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:59.733634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97e0a6-6146-46c4-b12a-80009e23bb23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:59.743052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97e0a6-6146-46c4-b12a-80009e23bb23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:59.744950 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97e0a6-6146-46c4-b12a-80009e23bb23 service swift] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:59.754125 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1126/2260] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 13:56:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 13:56:59.777320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2c0d1-8c3c-4ae0-aa06-2331dff466dd None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:59.777639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2c0d1-8c3c-4ae0-aa06-2331dff466dd None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:59.777923 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2c0d1-8c3c-4ae0-aa06-2331dff466dd None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:59.779299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1135/2261] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 13:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 13:56:59.785553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a8a76-0a56-4b8c-b29a-5e3e1d4efc6c None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:59.785995 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a8a76-0a56-4b8c-b29a-5e3e1d4efc6c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:59.786275 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a8a76-0a56-4b8c-b29a-5e3e1d4efc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:59.806588 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-0e0a8a76-0a56-4b8c-b29a-5e3e1d4efc6c None None] MFA Rules not processed for user `1994043a81bb454297c208839794a479`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:59.807932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-0e0a8a76-0a56-4b8c-b29a-5e3e1d4efc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:59.819691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1127/2262] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 13:56:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:56:59.830771 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2c0d1-8c3c-4ae0-aa06-2331dff466dd None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:56:59.842773 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2c0d1-8c3c-4ae0-aa06-2331dff466dd None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:56:59.846531 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b4a22-a29c-449a-a1cd-da35f9dea2e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:56:59.847166 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b4a22-a29c-449a-a1cd-da35f9dea2e8 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:59.847454 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b4a22-a29c-449a-a1cd-da35f9dea2e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:59.847733 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b4a22-a29c-449a-a1cd-da35f9dea2e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:59.861469 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b4a22-a29c-449a-a1cd-da35f9dea2e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:56:59.861469 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b4a22-a29c-449a-a1cd-da35f9dea2e8 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:56:59.871736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1136/2263] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:56:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:56:59.964438 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5cee-aaae-46f6-ab0f-aeaa5ebdd105 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:56:59.964810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5cee-aaae-46f6-ab0f-aeaa5ebdd105 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:56:59.965099 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5cee-aaae-46f6-ab0f-aeaa5ebdd105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:56:59.986309 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-5bde5cee-aaae-46f6-ab0f-aeaa5ebdd105 None None] MFA Rules not processed for user `135410329e56486c8ccb65b1f2d87aca`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:56:59.987581 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-5bde5cee-aaae-46f6-ab0f-aeaa5ebdd105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:56:59.995381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1128/2264] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 13:56:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:57:00.010876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b4a22-a29c-449a-a1cd-da35f9dea2e8 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:00.023431 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b4a22-a29c-449a-a1cd-da35f9dea2e8 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:00.029005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8a9b9-5ea7-4cfe-ba47-2d9b12dc1e30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e517dc43cc6d401e820c65ad4c941386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:00.029690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8a9b9-5ea7-4cfe-ba47-2d9b12dc1e30 service swift] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:00.029987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8a9b9-5ea7-4cfe-ba47-2d9b12dc1e30 service swift] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:00.030247 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8a9b9-5ea7-4cfe-ba47-2d9b12dc1e30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:00.047858 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8a9b9-5ea7-4cfe-ba47-2d9b12dc1e30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:00.049485 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8a9b9-5ea7-4cfe-ba47-2d9b12dc1e30 service swift] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:00.058635 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1137/2265] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 13:57:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 13:57:00.412966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d240a-8530-43e0-9aef-7439d40da629 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:00.413489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d240a-8530-43e0-9aef-7439d40da629 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:00.413584 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d240a-8530-43e0-9aef-7439d40da629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:00.450177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-280d240a-8530-43e0-9aef-7439d40da629 None None] MFA Rules not processed for user `135410329e56486c8ccb65b1f2d87aca`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:00.451335 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-280d240a-8530-43e0-9aef-7439d40da629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:00.470188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1129/2266] 10.222.0.45 () {58 vars in 967 bytes} [Thu May 26 13:57:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:57:00.483605 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8a9b9-5ea7-4cfe-ba47-2d9b12dc1e30 service swift] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:00.499243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8a9b9-5ea7-4cfe-ba47-2d9b12dc1e30 service swift] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:00.512799 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5570f26-6429-4bb6-a514-c11fce860c66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e517dc43cc6d401e820c65ad4c941386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:00.513968 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5570f26-6429-4bb6-a514-c11fce860c66 service swift] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:00.514604 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5570f26-6429-4bb6-a514-c11fce860c66 service swift] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:00.515779 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5570f26-6429-4bb6-a514-c11fce860c66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:00.532379 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5570f26-6429-4bb6-a514-c11fce860c66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:00.535055 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5570f26-6429-4bb6-a514-c11fce860c66 service swift] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:00.558834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1138/2267] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 13:57:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 13:57:02.336596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afda930-2875-4ee2-bd93-a379f023c2be None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:02.337066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afda930-2875-4ee2-bd93-a379f023c2be None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:02.337183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afda930-2875-4ee2-bd93-a379f023c2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:02.354382 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-1afda930-2875-4ee2-bd93-a379f023c2be None None] MFA Rules not processed for user `135410329e56486c8ccb65b1f2d87aca`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:02.355556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1afda930-2875-4ee2-bd93-a379f023c2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:02.362557 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1130/2268] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 13:57:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:57:02.375222 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5570f26-6429-4bb6-a514-c11fce860c66 service swift] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:02.386434 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5570f26-6429-4bb6-a514-c11fce860c66 service swift] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:02.391623 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac313f-255c-4dfe-8d13-ef460ce35b9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e517dc43cc6d401e820c65ad4c941386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:02.392257 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac313f-255c-4dfe-8d13-ef460ce35b9e service swift] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:02.392543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac313f-255c-4dfe-8d13-ef460ce35b9e service swift] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:02.392826 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac313f-255c-4dfe-8d13-ef460ce35b9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:02.401081 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac313f-255c-4dfe-8d13-ef460ce35b9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:02.402686 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac313f-255c-4dfe-8d13-ef460ce35b9e service swift] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:02.410886 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1139/2269] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 13:57:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 13:57:02.658683 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afda930-2875-4ee2-bd93-a379f023c2be None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:02.675113 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afda930-2875-4ee2-bd93-a379f023c2be None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:02.686638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14230b3e-3555-4058-bfe0-d500ba2c0875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:02.687614 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14230b3e-3555-4058-bfe0-d500ba2c0875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:02.688018 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14230b3e-3555-4058-bfe0-d500ba2c0875 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:02.688529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14230b3e-3555-4058-bfe0-d500ba2c0875 admin admin] PATH_INFO: `/v3/users/4205d2fd122c490199731f136d81d9d0` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:02.689987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14230b3e-3555-4058-bfe0-d500ba2c0875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4205d2fd122c490199731f136d81d9d0)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:02.693567 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14230b3e-3555-4058-bfe0-d500ba2c0875 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:02.755264 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-14230b3e-3555-4058-bfe0-d500ba2c0875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4205d2fd122c490199731f136d81d9d0'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:02.768479 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-14230b3e-3555-4058-bfe0-d500ba2c0875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4205d2fd122c490199731f136d81d9d0'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:02.769552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-14230b3e-3555-4058-bfe0-d500ba2c0875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4205d2fd122c490199731f136d81d9d0'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:02.770384 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-14230b3e-3555-4058-bfe0-d500ba2c0875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4205d2fd122c490199731f136d81d9d0'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:02.781553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-14230b3e-3555-4058-bfe0-d500ba2c0875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4205d2fd122c490199731f136d81d9d0'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:02.803193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1131/2270] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:57:02 2022] DELETE /identity/v3/users/4205d2fd122c490199731f136d81d9d0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:57:02.807402 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce5d1f-55ac-4c4e-bf03-ef7b600a520d None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:02.808021 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce5d1f-55ac-4c4e-bf03-ef7b600a520d None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:02.808517 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce5d1f-55ac-4c4e-bf03-ef7b600a520d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:02.827796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-cbce5d1f-55ac-4c4e-bf03-ef7b600a520d None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:02.829097 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-cbce5d1f-55ac-4c4e-bf03-ef7b600a520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:02.865389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:02.929689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1140/2271] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:57:02.940396 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14230b3e-3555-4058-bfe0-d500ba2c0875 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:02.941845 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-14230b3e-3555-4058-bfe0-d500ba2c0875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:03.014393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:03.028672 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14230b3e-3555-4058-bfe0-d500ba2c0875 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:03.034609 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efee111-71be-4f54-8761-8c10dbb1f6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:03.035954 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efee111-71be-4f54-8761-8c10dbb1f6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:03.036422 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efee111-71be-4f54-8761-8c10dbb1f6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:03.036958 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efee111-71be-4f54-8761-8c10dbb1f6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:03.052833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efee111-71be-4f54-8761-8c10dbb1f6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:03.054531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efee111-71be-4f54-8761-8c10dbb1f6e6 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:03.075137 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1132/2272] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:57:03.292782 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce5d1f-55ac-4c4e-bf03-ef7b600a520d None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:03.294770 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-cbce5d1f-55ac-4c4e-bf03-ef7b600a520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:03.308105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce5d1f-55ac-4c4e-bf03-ef7b600a520d None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:03.314507 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04ff6f-ccc5-4196-818a-69978caf42dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:03.315924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04ff6f-ccc5-4196-818a-69978caf42dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:03.317368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04ff6f-ccc5-4196-818a-69978caf42dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:03.317807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04ff6f-ccc5-4196-818a-69978caf42dc admin admin] PATH_INFO: `/v3/projects/adfb0764f7554085978fbab9b2374a72` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:03.319804 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04ff6f-ccc5-4196-818a-69978caf42dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=adfb0764f7554085978fbab9b2374a72)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:03.322294 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04ff6f-ccc5-4196-818a-69978caf42dc admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:03.398287 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3e04ff6f-ccc5-4196-818a-69978caf42dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adfb0764f7554085978fbab9b2374a72', 'request_id': 'req-3e04ff6f-ccc5-4196-818a-69978caf42dc'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:03.406426 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3e04ff6f-ccc5-4196-818a-69978caf42dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adfb0764f7554085978fbab9b2374a72', 'request_id': 'req-3e04ff6f-ccc5-4196-818a-69978caf42dc'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:03.414309 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3e04ff6f-ccc5-4196-818a-69978caf42dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adfb0764f7554085978fbab9b2374a72', 'request_id': 'req-3e04ff6f-ccc5-4196-818a-69978caf42dc'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:03.425070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3e04ff6f-ccc5-4196-818a-69978caf42dc admin admin] The token cache is being invalidate because project adfb0764f7554085978fbab9b2374a72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:57:03.425399 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3e04ff6f-ccc5-4196-818a-69978caf42dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:03.426017 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3e04ff6f-ccc5-4196-818a-69978caf42dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:03.427630 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1141/2273] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:57:03 2022] DELETE /identity/v3/projects/adfb0764f7554085978fbab9b2374a72 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:57:03.432576 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aaf70-f608-4b92-8259-9dbbc81a4e10 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:03.433040 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aaf70-f608-4b92-8259-9dbbc81a4e10 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:03.433134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aaf70-f608-4b92-8259-9dbbc81a4e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:03.451774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-ab0aaf70-f608-4b92-8259-9dbbc81a4e10 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:03.453006 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ab0aaf70-f608-4b92-8259-9dbbc81a4e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:03.524931 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1133/2274] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:57:03.532997 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74952d-c749-40ad-bf42-9d4f5c7730a5 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:03.533414 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74952d-c749-40ad-bf42-9d4f5c7730a5 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:03.533697 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74952d-c749-40ad-bf42-9d4f5c7730a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:03.556544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-3a74952d-c749-40ad-bf42-9d4f5c7730a5 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:03.557705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-3a74952d-c749-40ad-bf42-9d4f5c7730a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:03.565847 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1142/2275] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:57:03.570930 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0aaf70-f608-4b92-8259-9dbbc81a4e10 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:03.580783 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0aaf70-f608-4b92-8259-9dbbc81a4e10 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:03.586298 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf723e0-af4c-4f60-b628-306b97601586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:03.586969 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf723e0-af4c-4f60-b628-306b97601586 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:03.587257 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf723e0-af4c-4f60-b628-306b97601586 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:03.587536 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf723e0-af4c-4f60-b628-306b97601586 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:03.588260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf723e0-af4c-4f60-b628-306b97601586 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:57:03.588570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf723e0-af4c-4f60-b628-306b97601586 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:03.594242 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf723e0-af4c-4f60-b628-306b97601586 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:03.608769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1134/2276] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:57:03.613432 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74952d-c749-40ad-bf42-9d4f5c7730a5 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:03.623713 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74952d-c749-40ad-bf42-9d4f5c7730a5 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:03.629311 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f9e2e-8d1d-4813-b9c1-99eb35d0e4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:03.630058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f9e2e-8d1d-4813-b9c1-99eb35d0e4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:03.630958 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f9e2e-8d1d-4813-b9c1-99eb35d0e4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:03.631301 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f9e2e-8d1d-4813-b9c1-99eb35d0e4c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:03.632072 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f9e2e-8d1d-4813-b9c1-99eb35d0e4c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:03.634091 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f9e2e-8d1d-4813-b9c1-99eb35d0e4c6 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:03.661248 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1143/2277] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:57:03 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:57:03.664815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf723e0-af4c-4f60-b628-306b97601586 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:03.675933 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf723e0-af4c-4f60-b628-306b97601586 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:03.740253 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7a1e2-6560-436e-bad4-342f1eedec05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:03.740934 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7a1e2-6560-436e-bad4-342f1eedec05 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:03.741214 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7a1e2-6560-436e-bad4-342f1eedec05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:03.741551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7a1e2-6560-436e-bad4-342f1eedec05 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:03.742241 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7a1e2-6560-436e-bad4-342f1eedec05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:03.744154 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7a1e2-6560-436e-bad4-342f1eedec05 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:03.765451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1135/2278] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:57:03 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:57:03.770195 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f9e2e-8d1d-4813-b9c1-99eb35d0e4c6 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:03.782350 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f9e2e-8d1d-4813-b9c1-99eb35d0e4c6 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:03.787432 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57002bc-ae9b-42f4-8822-74b65531c7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:03.788101 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57002bc-ae9b-42f4-8822-74b65531c7fe admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:03.788381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57002bc-ae9b-42f4-8822-74b65531c7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:03.788653 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57002bc-ae9b-42f4-8822-74b65531c7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:03.789408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57002bc-ae9b-42f4-8822-74b65531c7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:03.791008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57002bc-ae9b-42f4-8822-74b65531c7fe admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:03.803083 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1144/2279] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:57:03.807298 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7a1e2-6560-436e-bad4-342f1eedec05 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:03.817947 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7a1e2-6560-436e-bad4-342f1eedec05 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:03.823248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebee773-c1b8-4b18-bc91-23e83b73fcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:03.824186 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebee773-c1b8-4b18-bc91-23e83b73fcc9 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:03.824476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebee773-c1b8-4b18-bc91-23e83b73fcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:03.824749 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebee773-c1b8-4b18-bc91-23e83b73fcc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:03.825503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebee773-c1b8-4b18-bc91-23e83b73fcc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:03.827099 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebee773-c1b8-4b18-bc91-23e83b73fcc9 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:03.837693 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1136/2280] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:57:03.841847 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57002bc-ae9b-42f4-8822-74b65531c7fe admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:03.852604 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57002bc-ae9b-42f4-8822-74b65531c7fe admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:03.857547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ed1b3-8438-4774-a839-9c5a4ecfdeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:03.858431 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ed1b3-8438-4774-a839-9c5a4ecfdeec admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:03.858711 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ed1b3-8438-4774-a839-9c5a4ecfdeec admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:03.858982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ed1b3-8438-4774-a839-9c5a4ecfdeec admin admin] PATH_INFO: `/v3/projects/16275a24f30541188675f989e3df3f08/users/65387834d1cb4573a3f414595c6cc18b/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:03.875895 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ed1b3-8438-4774-a839-9c5a4ecfdeec admin admin] RBAC: Authorizing `identity:create_grant(project_id=16275a24f30541188675f989e3df3f08, user_id=65387834d1cb4573a3f414595c6cc18b, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:03.878891 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ed1b3-8438-4774-a839-9c5a4ecfdeec admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:03.893561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1145/2281] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:57:03 2022] PUT /identity/v3/projects/16275a24f30541188675f989e3df3f08/users/65387834d1cb4573a3f414595c6cc18b/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:57:03.903280 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e486f-a639-4ef2-bd63-65a829b436b2 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:03.903574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e486f-a639-4ef2-bd63-65a829b436b2 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:03.903858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e486f-a639-4ef2-bd63-65a829b436b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:03.932116 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-0b6e486f-a639-4ef2-bd63-65a829b436b2 None None] MFA Rules not processed for user `65387834d1cb4573a3f414595c6cc18b`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:03.933450 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-0b6e486f-a639-4ef2-bd63-65a829b436b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:03.983665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:04.011572 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1137/2282] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:57:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:57:04.019516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ed1b3-8438-4774-a839-9c5a4ecfdeec admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:04.021714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-012ed1b3-8438-4774-a839-9c5a4ecfdeec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:04.092188 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:04.111850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ed1b3-8438-4774-a839-9c5a4ecfdeec admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:04.116194 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a979d32-c06a-47f1-83e8-6aa3b85ca8ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:04.116941 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a979d32-c06a-47f1-83e8-6aa3b85ca8ff service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:04.117486 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a979d32-c06a-47f1-83e8-6aa3b85ca8ff service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:04.118443 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a979d32-c06a-47f1-83e8-6aa3b85ca8ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:04.128403 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a979d32-c06a-47f1-83e8-6aa3b85ca8ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:04.130161 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a979d32-c06a-47f1-83e8-6aa3b85ca8ff service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:04.160846 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1146/2283] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:57:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:57:04.184131 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6d7e8-b50a-4865-8bbb-df11f7e3756b None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:04.184425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6d7e8-b50a-4865-8bbb-df11f7e3756b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:04.184711 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6d7e8-b50a-4865-8bbb-df11f7e3756b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:04.205416 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-0cb6d7e8-b50a-4865-8bbb-df11f7e3756b None None] MFA Rules not processed for user `b314cb0e905a456f8ff04aa89fe9b7ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:04.206868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-0cb6d7e8-b50a-4865-8bbb-df11f7e3756b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:04.294294 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1138/2284] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:57:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:57:14.141943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=5 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:14.286604 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=32 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:14.463098 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a979d32-c06a-47f1-83e8-6aa3b85ca8ff service cinder] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:14.524889 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a979d32-c06a-47f1-83e8-6aa3b85ca8ff service cinder] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:14.529540 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aca22f-a17b-4c67-adee-73bf8b620e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:14.530401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aca22f-a17b-4c67-adee-73bf8b620e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:14.530682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aca22f-a17b-4c67-adee-73bf8b620e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:14.530957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aca22f-a17b-4c67-adee-73bf8b620e5b admin admin] PATH_INFO: `/v3/users/65387834d1cb4573a3f414595c6cc18b` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:14.532122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aca22f-a17b-4c67-adee-73bf8b620e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=65387834d1cb4573a3f414595c6cc18b)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:14.534064 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aca22f-a17b-4c67-adee-73bf8b620e5b admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:14.580867 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-20aca22f-a17b-4c67-adee-73bf8b620e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65387834d1cb4573a3f414595c6cc18b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:14.581535 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-20aca22f-a17b-4c67-adee-73bf8b620e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65387834d1cb4573a3f414595c6cc18b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:14.582137 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-20aca22f-a17b-4c67-adee-73bf8b620e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65387834d1cb4573a3f414595c6cc18b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:14.589690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-20aca22f-a17b-4c67-adee-73bf8b620e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65387834d1cb4573a3f414595c6cc18b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:14.596808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-20aca22f-a17b-4c67-adee-73bf8b620e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65387834d1cb4573a3f414595c6cc18b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:14.613683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1147/2285] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:57:14 2022] DELETE /identity/v3/users/65387834d1cb4573a3f414595c6cc18b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:57:14.618102 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9c4ea-a36c-4174-bddd-853b0e7ba309 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:14.618389 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9c4ea-a36c-4174-bddd-853b0e7ba309 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:14.618667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9c4ea-a36c-4174-bddd-853b0e7ba309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:14.637378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-61e9c4ea-a36c-4174-bddd-853b0e7ba309 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:14.638622 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-61e9c4ea-a36c-4174-bddd-853b0e7ba309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:14.698135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1139/2286] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:57:14.707567 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aca22f-a17b-4c67-adee-73bf8b620e5b admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:14.708979 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-20aca22f-a17b-4c67-adee-73bf8b620e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:14.764728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aca22f-a17b-4c67-adee-73bf8b620e5b admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:14.768355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c23c2-1d71-44d9-a049-aac702a3659b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:14.768994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c23c2-1d71-44d9-a049-aac702a3659b service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:14.769290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c23c2-1d71-44d9-a049-aac702a3659b service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:14.769584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c23c2-1d71-44d9-a049-aac702a3659b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:14.778928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c23c2-1d71-44d9-a049-aac702a3659b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:14.780338 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c23c2-1d71-44d9-a049-aac702a3659b service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:14.789640 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1148/2287] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:57:15.065036 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9c4ea-a36c-4174-bddd-853b0e7ba309 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:15.066569 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-61e9c4ea-a36c-4174-bddd-853b0e7ba309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:15.082015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9c4ea-a36c-4174-bddd-853b0e7ba309 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:15.087138 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74204a45-4aaa-435e-a462-3d5ec4ae9333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:15.087993 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74204a45-4aaa-435e-a462-3d5ec4ae9333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:15.088276 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74204a45-4aaa-435e-a462-3d5ec4ae9333 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:15.088553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74204a45-4aaa-435e-a462-3d5ec4ae9333 admin admin] PATH_INFO: `/v3/projects/16275a24f30541188675f989e3df3f08` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:15.090761 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74204a45-4aaa-435e-a462-3d5ec4ae9333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16275a24f30541188675f989e3df3f08)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:15.093235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74204a45-4aaa-435e-a462-3d5ec4ae9333 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:15.144082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-74204a45-4aaa-435e-a462-3d5ec4ae9333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16275a24f30541188675f989e3df3f08', 'request_id': 'req-74204a45-4aaa-435e-a462-3d5ec4ae9333'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:15.150864 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-74204a45-4aaa-435e-a462-3d5ec4ae9333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16275a24f30541188675f989e3df3f08', 'request_id': 'req-74204a45-4aaa-435e-a462-3d5ec4ae9333'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:15.156861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-74204a45-4aaa-435e-a462-3d5ec4ae9333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16275a24f30541188675f989e3df3f08', 'request_id': 'req-74204a45-4aaa-435e-a462-3d5ec4ae9333'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:15.170529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-74204a45-4aaa-435e-a462-3d5ec4ae9333 admin admin] The token cache is being invalidate because project 16275a24f30541188675f989e3df3f08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:57:15.170817 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-74204a45-4aaa-435e-a462-3d5ec4ae9333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:15.171432 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-74204a45-4aaa-435e-a462-3d5ec4ae9333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:57:15.173760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1140/2288] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:57:15 2022] DELETE /identity/v3/projects/16275a24f30541188675f989e3df3f08 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:57:15.178617 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086398b-1199-43a6-928b-685bd1b703cc None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:15.179643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086398b-1199-43a6-928b-685bd1b703cc None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:15.179846 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086398b-1199-43a6-928b-685bd1b703cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:15.198248 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-e086398b-1199-43a6-928b-685bd1b703cc None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:15.199623 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e086398b-1199-43a6-928b-685bd1b703cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:15.216091 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:15.261118 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1149/2289] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:57:15.269226 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f93425-5d56-4e77-9f38-e36ee71d62d6 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:15.269579 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f93425-5d56-4e77-9f38-e36ee71d62d6 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:15.269884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f93425-5d56-4e77-9f38-e36ee71d62d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:15.288068 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-58f93425-5d56-4e77-9f38-e36ee71d62d6 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:15.289829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-58f93425-5d56-4e77-9f38-e36ee71d62d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:15.297963 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1141/2290] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:57:15.302254 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086398b-1199-43a6-928b-685bd1b703cc None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:15.312830 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086398b-1199-43a6-928b-685bd1b703cc None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:15.317526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c03118-fd25-4e3e-b336-15213256f7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:15.318171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c03118-fd25-4e3e-b336-15213256f7be admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:15.318451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c03118-fd25-4e3e-b336-15213256f7be admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:15.318721 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c03118-fd25-4e3e-b336-15213256f7be admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:15.319469 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c03118-fd25-4e3e-b336-15213256f7be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:57:15.319800 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c03118-fd25-4e3e-b336-15213256f7be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:15.321399 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c03118-fd25-4e3e-b336-15213256f7be admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:15.333195 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1150/2291] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:57:15.337389 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f93425-5d56-4e77-9f38-e36ee71d62d6 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:15.346567 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f93425-5d56-4e77-9f38-e36ee71d62d6 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:15.351770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055859b0-e234-4e8b-be08-4042cad4bf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:15.352415 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055859b0-e234-4e8b-be08-4042cad4bf30 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:15.352699 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055859b0-e234-4e8b-be08-4042cad4bf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:15.352975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055859b0-e234-4e8b-be08-4042cad4bf30 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:15.353701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055859b0-e234-4e8b-be08-4042cad4bf30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:15.355597 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055859b0-e234-4e8b-be08-4042cad4bf30 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:15.381173 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1142/2292] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:57:15 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:57:15.385296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c03118-fd25-4e3e-b336-15213256f7be admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:15.395279 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c03118-fd25-4e3e-b336-15213256f7be admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:15.449857 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c505c9-8793-4c8e-b7de-b23cd1d42f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:15.450446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c505c9-8793-4c8e-b7de-b23cd1d42f5f admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:15.450726 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c505c9-8793-4c8e-b7de-b23cd1d42f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:15.451002 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c505c9-8793-4c8e-b7de-b23cd1d42f5f admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:15.451685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c505c9-8793-4c8e-b7de-b23cd1d42f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:15.453611 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c505c9-8793-4c8e-b7de-b23cd1d42f5f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:15.476855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1151/2293] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:57:15 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:57:15.478295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055859b0-e234-4e8b-be08-4042cad4bf30 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:15.488920 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055859b0-e234-4e8b-be08-4042cad4bf30 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:15.494396 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4db2c2-b460-48bd-960d-5d520cd53ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:15.495136 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4db2c2-b460-48bd-960d-5d520cd53ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:15.495379 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4db2c2-b460-48bd-960d-5d520cd53ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:15.495659 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4db2c2-b460-48bd-960d-5d520cd53ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:15.496386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4db2c2-b460-48bd-960d-5d520cd53ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:15.498324 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4db2c2-b460-48bd-960d-5d520cd53ed9 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:15.509577 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1143/2294] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:57:15.513902 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c505c9-8793-4c8e-b7de-b23cd1d42f5f admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:15.524181 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c505c9-8793-4c8e-b7de-b23cd1d42f5f admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:15.528845 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d73af-4cd5-497e-980e-36ff2cae8864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:15.529548 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d73af-4cd5-497e-980e-36ff2cae8864 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:15.529837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d73af-4cd5-497e-980e-36ff2cae8864 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:15.530121 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d73af-4cd5-497e-980e-36ff2cae8864 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:15.530852 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d73af-4cd5-497e-980e-36ff2cae8864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:15.532444 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d73af-4cd5-497e-980e-36ff2cae8864 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:15.550476 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1152/2295] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:57:15.555052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4db2c2-b460-48bd-960d-5d520cd53ed9 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:15.565630 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4db2c2-b460-48bd-960d-5d520cd53ed9 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:15.575312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011f6fb-f712-42d5-b48c-f869b9784dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:15.576258 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011f6fb-f712-42d5-b48c-f869b9784dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:15.576567 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011f6fb-f712-42d5-b48c-f869b9784dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:15.576848 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011f6fb-f712-42d5-b48c-f869b9784dbc admin admin] PATH_INFO: `/v3/projects/cb0e4c2dd9524b988ed784d8825891b5/users/8245056ce35e4e6886590dd7e20a1906/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:15.596853 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011f6fb-f712-42d5-b48c-f869b9784dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb0e4c2dd9524b988ed784d8825891b5, user_id=8245056ce35e4e6886590dd7e20a1906, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:15.599564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011f6fb-f712-42d5-b48c-f869b9784dbc admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:15.614647 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1144/2296] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:57:15 2022] PUT /identity/v3/projects/cb0e4c2dd9524b988ed784d8825891b5/users/8245056ce35e4e6886590dd7e20a1906/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:57:15.620286 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296666c4-17ec-448b-9faf-b006ef8ef0c6 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:15.620573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296666c4-17ec-448b-9faf-b006ef8ef0c6 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:15.620850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296666c4-17ec-448b-9faf-b006ef8ef0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:15.639383 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-296666c4-17ec-448b-9faf-b006ef8ef0c6 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:15.640586 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-296666c4-17ec-448b-9faf-b006ef8ef0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:15.723391 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1153/2297] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:57:15.736250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011f6fb-f712-42d5-b48c-f869b9784dbc admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:15.738035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-7011f6fb-f712-42d5-b48c-f869b9784dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:15.761795 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:15.804433 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011f6fb-f712-42d5-b48c-f869b9784dbc admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:15.808840 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1e5ab-818f-44dd-97e3-17a0e25e7a02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:15.809515 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1e5ab-818f-44dd-97e3-17a0e25e7a02 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:15.809821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1e5ab-818f-44dd-97e3-17a0e25e7a02 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:15.810097 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1e5ab-818f-44dd-97e3-17a0e25e7a02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:15.820564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1e5ab-818f-44dd-97e3-17a0e25e7a02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:15.822185 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1e5ab-818f-44dd-97e3-17a0e25e7a02 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:15.832441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1145/2298] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:57:21.201785 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b9c4c-4910-41bd-9fb9-abf1cb8196c5 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:21.202361 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b9c4c-4910-41bd-9fb9-abf1cb8196c5 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:21.202361 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b9c4c-4910-41bd-9fb9-abf1cb8196c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:21.232043 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-454b9c4c-4910-41bd-9fb9-abf1cb8196c5 None None] MFA Rules not processed for user `8245056ce35e4e6886590dd7e20a1906`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:21.233324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-454b9c4c-4910-41bd-9fb9-abf1cb8196c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:21.250968 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:21.305499 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1154/2299] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:57:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:57:21.306656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1e5ab-818f-44dd-97e3-17a0e25e7a02 service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:21.320490 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1e5ab-818f-44dd-97e3-17a0e25e7a02 service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:21.326371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b4f77-2965-45e9-a1ef-8e30f64ec759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:21.327036 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b4f77-2965-45e9-a1ef-8e30f64ec759 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:21.327323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b4f77-2965-45e9-a1ef-8e30f64ec759 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:21.327604 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b4f77-2965-45e9-a1ef-8e30f64ec759 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:21.328300 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b4f77-2965-45e9-a1ef-8e30f64ec759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:21.330382 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b4f77-2965-45e9-a1ef-8e30f64ec759 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:21.359723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1146/2300] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:57:21 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:57:21.363581 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b9c4c-4910-41bd-9fb9-abf1cb8196c5 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:21.379374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b9c4c-4910-41bd-9fb9-abf1cb8196c5 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:21.440138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6d882-c6c8-4e50-a93c-7e0b84330d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:21.440810 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6d882-c6c8-4e50-a93c-7e0b84330d24 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:21.441094 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6d882-c6c8-4e50-a93c-7e0b84330d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:21.441404 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6d882-c6c8-4e50-a93c-7e0b84330d24 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:21.442098 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6d882-c6c8-4e50-a93c-7e0b84330d24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:21.445207 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6d882-c6c8-4e50-a93c-7e0b84330d24 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:21.465803 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1155/2301] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:57:21 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:57:21.469868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b4f77-2965-45e9-a1ef-8e30f64ec759 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:21.480744 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b4f77-2965-45e9-a1ef-8e30f64ec759 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:21.486181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52832c9-be3b-44af-b8dc-c376d866a71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:21.486905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52832c9-be3b-44af-b8dc-c376d866a71a admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:21.487189 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52832c9-be3b-44af-b8dc-c376d866a71a admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:21.487463 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52832c9-be3b-44af-b8dc-c376d866a71a admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:21.488218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52832c9-be3b-44af-b8dc-c376d866a71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:21.489866 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52832c9-be3b-44af-b8dc-c376d866a71a admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:21.501643 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1147/2302] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:57:21.506168 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6d882-c6c8-4e50-a93c-7e0b84330d24 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:21.516970 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6d882-c6c8-4e50-a93c-7e0b84330d24 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:21.524203 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121cd1d-48b3-42d7-a413-59dbeadc637a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:21.525195 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121cd1d-48b3-42d7-a413-59dbeadc637a admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:21.525516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121cd1d-48b3-42d7-a413-59dbeadc637a admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:21.525793 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121cd1d-48b3-42d7-a413-59dbeadc637a admin admin] PATH_INFO: `/v3/projects/f24e3240fa3c47bc9028bf9d928e065f/users/48eefaeecf6f4e609e73362138691441/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:21.546488 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121cd1d-48b3-42d7-a413-59dbeadc637a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f24e3240fa3c47bc9028bf9d928e065f, user_id=48eefaeecf6f4e609e73362138691441, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:21.549412 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121cd1d-48b3-42d7-a413-59dbeadc637a admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:21.563343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1156/2303] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:57:21 2022] PUT /identity/v3/projects/f24e3240fa3c47bc9028bf9d928e065f/users/48eefaeecf6f4e609e73362138691441/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:57:21.571090 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52832c9-be3b-44af-b8dc-c376d866a71a admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:21.581148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52832c9-be3b-44af-b8dc-c376d866a71a admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:21.636087 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42991a8f-05da-4088-96df-c768bf049898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:21.636670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42991a8f-05da-4088-96df-c768bf049898 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:21.636976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42991a8f-05da-4088-96df-c768bf049898 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:21.637253 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42991a8f-05da-4088-96df-c768bf049898 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:21.638033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42991a8f-05da-4088-96df-c768bf049898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:21.639680 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42991a8f-05da-4088-96df-c768bf049898 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:21.649534 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1148/2304] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:57:21.653657 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121cd1d-48b3-42d7-a413-59dbeadc637a admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:21.663890 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121cd1d-48b3-42d7-a413-59dbeadc637a admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:21.668425 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd6261-314f-4a9d-b09a-e0a0c4c08066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:21.669325 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd6261-314f-4a9d-b09a-e0a0c4c08066 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:21.669611 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd6261-314f-4a9d-b09a-e0a0c4c08066 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:21.669933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd6261-314f-4a9d-b09a-e0a0c4c08066 admin admin] PATH_INFO: `/v3/projects/f24e3240fa3c47bc9028bf9d928e065f/users/48eefaeecf6f4e609e73362138691441/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:21.671848 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd6261-314f-4a9d-b09a-e0a0c4c08066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f24e3240fa3c47bc9028bf9d928e065f, user_id=48eefaeecf6f4e609e73362138691441, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:21.674509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd6261-314f-4a9d-b09a-e0a0c4c08066 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:21.686299 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1157/2305] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:57:21 2022] PUT /identity/v3/projects/f24e3240fa3c47bc9028bf9d928e065f/users/48eefaeecf6f4e609e73362138691441/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:57:22.658763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275c96f-55d7-4415-abca-45a3eb7058e9 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:22.659277 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275c96f-55d7-4415-abca-45a3eb7058e9 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:22.659361 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275c96f-55d7-4415-abca-45a3eb7058e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:22.692696 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-c275c96f-55d7-4415-abca-45a3eb7058e9 None None] MFA Rules not processed for user `135410329e56486c8ccb65b1f2d87aca`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:22.697906 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c275c96f-55d7-4415-abca-45a3eb7058e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:22.797304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1149/2306] 10.222.0.45 () {58 vars in 967 bytes} [Thu May 26 13:57:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:57:22.811562 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd6261-314f-4a9d-b09a-e0a0c4c08066 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:22.814843 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-02dd6261-314f-4a9d-b09a-e0a0c4c08066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:22.916476 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd6261-314f-4a9d-b09a-e0a0c4c08066 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:22.921790 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac478e-83ff-42c1-b282-c92eff713fb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e517dc43cc6d401e820c65ad4c941386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:22.922440 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac478e-83ff-42c1-b282-c92eff713fb8 service swift] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:22.922723 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac478e-83ff-42c1-b282-c92eff713fb8 service swift] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:22.923002 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac478e-83ff-42c1-b282-c92eff713fb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:22.932581 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac478e-83ff-42c1-b282-c92eff713fb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:22.934192 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac478e-83ff-42c1-b282-c92eff713fb8 service swift] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:22.940054 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:22.944016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1158/2307] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 13:57:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 13:57:27.113339 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70d008-ee7d-4e68-a9dc-24b735b27888 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:27.113888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70d008-ee7d-4e68-a9dc-24b735b27888 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:27.114225 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70d008-ee7d-4e68-a9dc-24b735b27888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:27.152541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-7e70d008-ee7d-4e68-a9dc-24b735b27888 None None] MFA Rules not processed for user `48eefaeecf6f4e609e73362138691441`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:27.153967 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-7e70d008-ee7d-4e68-a9dc-24b735b27888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:27.180996 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:27.260355 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1150/2308] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:57:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:57:27.274507 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac478e-83ff-42c1-b282-c92eff713fb8 service swift] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:27.278509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-13ac478e-83ff-42c1-b282-c92eff713fb8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:27.418638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac478e-83ff-42c1-b282-c92eff713fb8 service swift] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:27.425750 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd539f5b-7a89-48e2-ae38-fbce5aabd527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:27.426558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd539f5b-7a89-48e2-ae38-fbce5aabd527 service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:27.426946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd539f5b-7a89-48e2-ae38-fbce5aabd527 service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:27.427324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd539f5b-7a89-48e2-ae38-fbce5aabd527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:27.511696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd539f5b-7a89-48e2-ae38-fbce5aabd527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:27.513505 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd539f5b-7a89-48e2-ae38-fbce5aabd527 service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:27.524713 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1159/2309] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:57:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:57:28.568267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239b2f-32cf-49eb-b2d2-557f3020973f None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:28.569454 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239b2f-32cf-49eb-b2d2-557f3020973f None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:28.569454 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239b2f-32cf-49eb-b2d2-557f3020973f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:28.587865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-16239b2f-32cf-49eb-b2d2-557f3020973f None None] MFA Rules not processed for user `8245056ce35e4e6886590dd7e20a1906`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:28.589060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-16239b2f-32cf-49eb-b2d2-557f3020973f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:28.596070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1151/2310] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:57:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:57:33.721540 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ad553-39e1-4b7b-b9d8-52d0d1a69e70 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:33.722025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ad553-39e1-4b7b-b9d8-52d0d1a69e70 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:33.722143 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ad553-39e1-4b7b-b9d8-52d0d1a69e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:33.740003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-ba3ad553-39e1-4b7b-b9d8-52d0d1a69e70 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:33.741820 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ba3ad553-39e1-4b7b-b9d8-52d0d1a69e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:33.802542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1160/2311] 10.222.0.55 () {58 vars in 1016 bytes} [Thu May 26 13:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:57:33.819965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16239b2f-32cf-49eb-b2d2-557f3020973f None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:33.821387 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-16239b2f-32cf-49eb-b2d2-557f3020973f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:33.837315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16239b2f-32cf-49eb-b2d2-557f3020973f None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:33.842780 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3393c39-7cae-42f5-96e5-9b0245eaabab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:33.843437 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3393c39-7cae-42f5-96e5-9b0245eaabab service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:33.843719 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3393c39-7cae-42f5-96e5-9b0245eaabab service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:33.843994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3393c39-7cae-42f5-96e5-9b0245eaabab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:33.853307 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3393c39-7cae-42f5-96e5-9b0245eaabab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:33.854936 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3393c39-7cae-42f5-96e5-9b0245eaabab service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:33.864219 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1152/2312] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:57:40.113455 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f9e02-f96a-4da7-a305-aada72033e2b None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:40.113950 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f9e02-f96a-4da7-a305-aada72033e2b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:40.114047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f9e02-f96a-4da7-a305-aada72033e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:40.134908 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-eb5f9e02-f96a-4da7-a305-aada72033e2b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:40.136223 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-eb5f9e02-f96a-4da7-a305-aada72033e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:40.144321 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1161/2313] 10.222.0.55 () {58 vars in 1016 bytes} [Thu May 26 13:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:57:40.165632 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3393c39-7cae-42f5-96e5-9b0245eaabab service nova] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:40.180478 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3393c39-7cae-42f5-96e5-9b0245eaabab service nova] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:40.188134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72668b2-6c3c-4efe-b05c-679c2619e97d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:40.188821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72668b2-6c3c-4efe-b05c-679c2619e97d service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:40.189305 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72668b2-6c3c-4efe-b05c-679c2619e97d service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:40.189613 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72668b2-6c3c-4efe-b05c-679c2619e97d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:40.199691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72668b2-6c3c-4efe-b05c-679c2619e97d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:40.201313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72668b2-6c3c-4efe-b05c-679c2619e97d service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:40.212976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1153/2314] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:57:45.439741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7b1a0-cbc3-4473-b997-a4d04aba38fb None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:45.440298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7b1a0-cbc3-4473-b997-a4d04aba38fb None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:45.440596 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7b1a0-cbc3-4473-b997-a4d04aba38fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:45.459412 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-e3b7b1a0-cbc3-4473-b997-a4d04aba38fb None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:45.460608 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e3b7b1a0-cbc3-4473-b997-a4d04aba38fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:45.468465 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1162/2315] 10.222.0.55 () {58 vars in 1016 bytes} [Thu May 26 13:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:57:45.497170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72668b2-6c3c-4efe-b05c-679c2619e97d service nova] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:45.508883 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72668b2-6c3c-4efe-b05c-679c2619e97d service nova] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:45.514399 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd33d13-8140-496d-954a-90fc6dc948d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:45.515037 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd33d13-8140-496d-954a-90fc6dc948d0 service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:45.515325 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd33d13-8140-496d-954a-90fc6dc948d0 service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:45.515602 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd33d13-8140-496d-954a-90fc6dc948d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:45.523955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd33d13-8140-496d-954a-90fc6dc948d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:45.525553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd33d13-8140-496d-954a-90fc6dc948d0 service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:45.534831 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1154/2316] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:57:50.470754 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef5a4c-f235-4111-a7e9-fd30ba5d6bed None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:50.471252 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef5a4c-f235-4111-a7e9-fd30ba5d6bed None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:50.471366 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef5a4c-f235-4111-a7e9-fd30ba5d6bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:50.488920 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-4fef5a4c-f235-4111-a7e9-fd30ba5d6bed None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:50.490134 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-4fef5a4c-f235-4111-a7e9-fd30ba5d6bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:50.498388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1163/2317] 10.222.0.55 () {58 vars in 1016 bytes} [Thu May 26 13:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:57:50.516955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd33d13-8140-496d-954a-90fc6dc948d0 service nova] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:50.528867 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd33d13-8140-496d-954a-90fc6dc948d0 service nova] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:50.534348 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77225a16-0b7e-4cae-9c39-ca2698d8cc99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:50.535051 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77225a16-0b7e-4cae-9c39-ca2698d8cc99 service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:50.535403 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77225a16-0b7e-4cae-9c39-ca2698d8cc99 service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:50.535739 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77225a16-0b7e-4cae-9c39-ca2698d8cc99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:50.544707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77225a16-0b7e-4cae-9c39-ca2698d8cc99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:50.546393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77225a16-0b7e-4cae-9c39-ca2698d8cc99 service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:50.561522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1155/2318] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:57:55.699739 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227842d-bb28-4f6c-975c-1a7b98fcddbf None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:55.700186 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227842d-bb28-4f6c-975c-1a7b98fcddbf None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:55.700280 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227842d-bb28-4f6c-975c-1a7b98fcddbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:55.706593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=93 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:55.719281 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-a227842d-bb28-4f6c-975c-1a7b98fcddbf None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:57:55.720471 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-a227842d-bb28-4f6c-975c-1a7b98fcddbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:57:55.729007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1164/2319] 10.222.0.55 () {58 vars in 1016 bytes} [Thu May 26 13:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:57:55.747839 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77225a16-0b7e-4cae-9c39-ca2698d8cc99 service nova] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:57:55.758757 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77225a16-0b7e-4cae-9c39-ca2698d8cc99 service nova] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:57:55.764092 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655f0e8-d101-47e1-a98b-7fc1a92c39eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:57:55.764715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655f0e8-d101-47e1-a98b-7fc1a92c39eb service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:57:55.765002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655f0e8-d101-47e1-a98b-7fc1a92c39eb service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:57:55.765291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655f0e8-d101-47e1-a98b-7fc1a92c39eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:57:55.773280 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655f0e8-d101-47e1-a98b-7fc1a92c39eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:57:55.774860 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655f0e8-d101-47e1-a98b-7fc1a92c39eb service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:57:55.784173 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1156/2320] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:58:00.225893 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f4682-1dd9-4096-a7d1-d0200744b1ae None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:58:00.226796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f4682-1dd9-4096-a7d1-d0200744b1ae None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:58:00.228705 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f4682-1dd9-4096-a7d1-d0200744b1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:58:00.251712 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-d42f4682-1dd9-4096-a7d1-d0200744b1ae None None] MFA Rules not processed for user `000330dc3f1a4b38b58686ee37b3b78c`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:58:00.253038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d42f4682-1dd9-4096-a7d1-d0200744b1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:58:00.326902 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1165/2321] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:58:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:58:01.356697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6c322-8b4a-41e1-809f-ef2a3852cad6 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:58:01.357176 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6c322-8b4a-41e1-809f-ef2a3852cad6 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:58:01.357300 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6c322-8b4a-41e1-809f-ef2a3852cad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:58:01.364107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=54 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:01.380120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-6eb6c322-8b4a-41e1-809f-ef2a3852cad6 None None] MFA Rules not processed for user `81f42e71a4d24250874f31f4e8269e04`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:58:01.382057 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6eb6c322-8b4a-41e1-809f-ef2a3852cad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:58:01.437118 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1157/2322] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:58:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:58:10.319401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=27 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:11.430359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=24 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:12.426243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f4682-1dd9-4096-a7d1-d0200744b1ae None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:58:12.489527 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f4682-1dd9-4096-a7d1-d0200744b1ae None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:58:12.493778 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b69cc-2a53-4a7a-a45d-0e7bc68ce6a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:58:12.494426 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b69cc-2a53-4a7a-a45d-0e7bc68ce6a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:58:12.494710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b69cc-2a53-4a7a-a45d-0e7bc68ce6a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:58:12.494994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b69cc-2a53-4a7a-a45d-0e7bc68ce6a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:58:12.506365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b69cc-2a53-4a7a-a45d-0e7bc68ce6a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:58:12.508003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b69cc-2a53-4a7a-a45d-0e7bc68ce6a2 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:58:12.521652 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1166/2323] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:58:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:58:22.517054 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=26 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:29.081109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6c322-8b4a-41e1-809f-ef2a3852cad6 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:58:29.082591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6eb6c322-8b4a-41e1-809f-ef2a3852cad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:58:29.096457 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6c322-8b4a-41e1-809f-ef2a3852cad6 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:58:29.101109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e836d9c-5b81-491a-9fbb-852826bc9e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:58:29.101814 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e836d9c-5b81-491a-9fbb-852826bc9e3a service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:58:29.102095 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e836d9c-5b81-491a-9fbb-852826bc9e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:58:29.102371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e836d9c-5b81-491a-9fbb-852826bc9e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:58:29.104889 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6e836d9c-5b81-491a-9fbb-852826bc9e3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:58:29.120035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e836d9c-5b81-491a-9fbb-852826bc9e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:58:29.121867 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e836d9c-5b81-491a-9fbb-852826bc9e3a service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:58:29.140132 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1158/2324] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:58:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:58:29.455004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b69cc-2a53-4a7a-a45d-0e7bc68ce6a2 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:58:29.456528 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-156b69cc-2a53-4a7a-a45d-0e7bc68ce6a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:58:29.471067 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b69cc-2a53-4a7a-a45d-0e7bc68ce6a2 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:58:29.476864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4119773-000b-4ed6-afb9-fe370924e90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:58:29.477776 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4119773-000b-4ed6-afb9-fe370924e90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:58:29.478058 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4119773-000b-4ed6-afb9-fe370924e90e admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:58:29.478332 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4119773-000b-4ed6-afb9-fe370924e90e admin admin] PATH_INFO: `/v3/users/b314cb0e905a456f8ff04aa89fe9b7ad` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:58:29.479550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4119773-000b-4ed6-afb9-fe370924e90e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b314cb0e905a456f8ff04aa89fe9b7ad)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:58:29.481548 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4119773-000b-4ed6-afb9-fe370924e90e admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:58:29.531701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e4119773-000b-4ed6-afb9-fe370924e90e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b314cb0e905a456f8ff04aa89fe9b7ad'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:58:29.532367 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e4119773-000b-4ed6-afb9-fe370924e90e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b314cb0e905a456f8ff04aa89fe9b7ad'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:58:29.532960 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e4119773-000b-4ed6-afb9-fe370924e90e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b314cb0e905a456f8ff04aa89fe9b7ad'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:58:29.541112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e4119773-000b-4ed6-afb9-fe370924e90e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b314cb0e905a456f8ff04aa89fe9b7ad'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:58:29.549570 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e4119773-000b-4ed6-afb9-fe370924e90e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b314cb0e905a456f8ff04aa89fe9b7ad'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:58:29.569351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1167/2325] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:58:29 2022] DELETE /identity/v3/users/b314cb0e905a456f8ff04aa89fe9b7ad => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:58:29.744885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e836d9c-5b81-491a-9fbb-852826bc9e3a service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:58:29.755821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e836d9c-5b81-491a-9fbb-852826bc9e3a service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:58:29.813215 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f7bd4-cd6e-4f2e-897f-22f3535c9228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:58:29.814123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f7bd4-cd6e-4f2e-897f-22f3535c9228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:58:29.814403 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f7bd4-cd6e-4f2e-897f-22f3535c9228 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:58:29.814677 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f7bd4-cd6e-4f2e-897f-22f3535c9228 admin admin] PATH_INFO: `/v3/projects/1699e15952f54da083f9295949548e61` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:58:29.815851 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f7bd4-cd6e-4f2e-897f-22f3535c9228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1699e15952f54da083f9295949548e61)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:58:29.817854 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f7bd4-cd6e-4f2e-897f-22f3535c9228 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:58:29.864390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-1f3f7bd4-cd6e-4f2e-897f-22f3535c9228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1699e15952f54da083f9295949548e61', 'request_id': 'req-1f3f7bd4-cd6e-4f2e-897f-22f3535c9228'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:58:29.870356 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-1f3f7bd4-cd6e-4f2e-897f-22f3535c9228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1699e15952f54da083f9295949548e61', 'request_id': 'req-1f3f7bd4-cd6e-4f2e-897f-22f3535c9228'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:58:29.875984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-1f3f7bd4-cd6e-4f2e-897f-22f3535c9228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1699e15952f54da083f9295949548e61', 'request_id': 'req-1f3f7bd4-cd6e-4f2e-897f-22f3535c9228'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:58:29.888396 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-1f3f7bd4-cd6e-4f2e-897f-22f3535c9228 admin admin] The token cache is being invalidate because project 1699e15952f54da083f9295949548e61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:58:29.888688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-1f3f7bd4-cd6e-4f2e-897f-22f3535c9228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:58:29.889346 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-1f3f7bd4-cd6e-4f2e-897f-22f3535c9228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:58:29.890954 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1159/2326] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:58:29 2022] DELETE /identity/v3/projects/1699e15952f54da083f9295949548e61 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:58:32.414757 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7907c8-140a-4bd9-b21a-3c894d023d80 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:58:32.415260 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7907c8-140a-4bd9-b21a-3c894d023d80 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:58:32.415359 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7907c8-140a-4bd9-b21a-3c894d023d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:58:32.434448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-8d7907c8-140a-4bd9-b21a-3c894d023d80 None None] MFA Rules not processed for user `ff4a8240c1f4495eb3f518a7f1b741bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:58:32.435706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8d7907c8-140a-4bd9-b21a-3c894d023d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:58:32.494054 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1168/2327] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:58:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:58:32.797216 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f7bd4-cd6e-4f2e-897f-22f3535c9228 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:58:32.798739 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1f3f7bd4-cd6e-4f2e-897f-22f3535c9228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:58:32.853648 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f7bd4-cd6e-4f2e-897f-22f3535c9228 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:58:32.857163 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0c88a-ce55-47b2-a36a-465c141cf6c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:58:32.857813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0c88a-ce55-47b2-a36a-465c141cf6c7 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:58:32.858092 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0c88a-ce55-47b2-a36a-465c141cf6c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:58:32.858366 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0c88a-ce55-47b2-a36a-465c141cf6c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:58:32.860046 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e7e0c88a-ce55-47b2-a36a-465c141cf6c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:58:32.869387 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0c88a-ce55-47b2-a36a-465c141cf6c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:58:32.871073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0c88a-ce55-47b2-a36a-465c141cf6c7 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:58:32.878876 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1160/2328] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:58:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:58:33.181133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7907c8-140a-4bd9-b21a-3c894d023d80 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:58:33.182564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8d7907c8-140a-4bd9-b21a-3c894d023d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:58:33.192935 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0c88a-ce55-47b2-a36a-465c141cf6c7 service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:58:33.202720 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0c88a-ce55-47b2-a36a-465c141cf6c7 service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:58:33.206324 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e3bc6-968b-49bd-88e1-2469734a71df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:58:33.206951 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e3bc6-968b-49bd-88e1-2469734a71df service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:58:33.207282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e3bc6-968b-49bd-88e1-2469734a71df service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:58:33.207553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e3bc6-968b-49bd-88e1-2469734a71df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:58:33.209901 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ad8e3bc6-968b-49bd-88e1-2469734a71df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:58:33.227896 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:33.252946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7907c8-140a-4bd9-b21a-3c894d023d80 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:58:33.258575 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e9867-e12c-4612-8e8a-fad9396c384b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0db68b7fda4da29eb13689f3fd7b5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:58:33.259215 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e9867-e12c-4612-8e8a-fad9396c384b service placement] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:58:33.259494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e9867-e12c-4612-8e8a-fad9396c384b service placement] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:58:33.259767 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e9867-e12c-4612-8e8a-fad9396c384b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:58:33.261533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-922e9867-e12c-4612-8e8a-fad9396c384b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:58:33.273025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e9867-e12c-4612-8e8a-fad9396c384b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:58:33.274605 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e9867-e12c-4612-8e8a-fad9396c384b service placement] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:58:33.283473 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e3bc6-968b-49bd-88e1-2469734a71df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:58:33.284292 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1169/2329] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:58:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:58:33.284931 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e3bc6-968b-49bd-88e1-2469734a71df service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:58:33.295906 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1161/2330] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:58:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:58:41.427730 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e9867-e12c-4612-8e8a-fad9396c384b service placement] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:58:41.437328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e9867-e12c-4612-8e8a-fad9396c384b service placement] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:58:41.440854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca34fa-de54-414e-b6b5-a091ddd300d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:58:41.441538 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca34fa-de54-414e-b6b5-a091ddd300d8 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:58:41.441819 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca34fa-de54-414e-b6b5-a091ddd300d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:58:41.442133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca34fa-de54-414e-b6b5-a091ddd300d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:58:41.443882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-fdca34fa-de54-414e-b6b5-a091ddd300d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:58:41.450621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:41.456278 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca34fa-de54-414e-b6b5-a091ddd300d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:58:41.459185 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca34fa-de54-414e-b6b5-a091ddd300d8 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:58:41.474078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1170/2331] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:58:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:58:43.290923 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=25 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:46.561444 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec75b4-f9b4-4f0e-b106-43fb2d05b7f4 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:58:46.562050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec75b4-f9b4-4f0e-b106-43fb2d05b7f4 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:58:46.562050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec75b4-f9b4-4f0e-b106-43fb2d05b7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:58:46.580078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-58ec75b4-f9b4-4f0e-b106-43fb2d05b7f4 None None] MFA Rules not processed for user `63cf85b13c87481095acb4d3a84156cc`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:58:46.581344 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-58ec75b4-f9b4-4f0e-b106-43fb2d05b7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:58:46.636493 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1162/2332] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:58:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:58:51.469877 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:54.119030 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca34fa-de54-414e-b6b5-a091ddd300d8 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:58:54.127800 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca34fa-de54-414e-b6b5-a091ddd300d8 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:58:54.131427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b8385-1bbf-4faf-b91d-a1459fbcca38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:58:54.132060 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b8385-1bbf-4faf-b91d-a1459fbcca38 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:58:54.132344 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b8385-1bbf-4faf-b91d-a1459fbcca38 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:58:54.132621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b8385-1bbf-4faf-b91d-a1459fbcca38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:58:54.134525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d89b8385-1bbf-4faf-b91d-a1459fbcca38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:58:54.145180 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b8385-1bbf-4faf-b91d-a1459fbcca38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:58:54.146614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b8385-1bbf-4faf-b91d-a1459fbcca38 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:58:54.155549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1171/2333] 10.222.0.45 () {60 vars in 1396 bytes} [Thu May 26 13:58:54 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:58:56.629158 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=25 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:04.151382 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=6 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:04.562285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec75b4-f9b4-4f0e-b106-43fb2d05b7f4 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:04.563733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-58ec75b4-f9b4-4f0e-b106-43fb2d05b7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:04.622944 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec75b4-f9b4-4f0e-b106-43fb2d05b7f4 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:04.626468 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e895e-f1ee-4402-8fb4-d56302dd5b93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:04.627107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e895e-f1ee-4402-8fb4-d56302dd5b93 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:04.627393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e895e-f1ee-4402-8fb4-d56302dd5b93 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:04.627666 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e895e-f1ee-4402-8fb4-d56302dd5b93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:04.629915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-0b3e895e-f1ee-4402-8fb4-d56302dd5b93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:04.695674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e895e-f1ee-4402-8fb4-d56302dd5b93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:04.697121 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e895e-f1ee-4402-8fb4-d56302dd5b93 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:04.706168 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1163/2334] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:59:11.500346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b8385-1bbf-4faf-b91d-a1459fbcca38 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:11.502276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d89b8385-1bbf-4faf-b91d-a1459fbcca38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:11.523109 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b8385-1bbf-4faf-b91d-a1459fbcca38 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:11.530689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834545f-4949-4841-a451-41daed7e9547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:11.531495 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834545f-4949-4841-a451-41daed7e9547 service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:11.531785 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834545f-4949-4841-a451-41daed7e9547 service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:11.532185 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834545f-4949-4841-a451-41daed7e9547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:11.535893 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-2834545f-4949-4841-a451-41daed7e9547 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:11.557614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834545f-4949-4841-a451-41daed7e9547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:11.559339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834545f-4949-4841-a451-41daed7e9547 service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:11.573463 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1172/2335] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:59:14.701840 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=48 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:15.305296 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e895e-f1ee-4402-8fb4-d56302dd5b93 service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:15.319231 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e895e-f1ee-4402-8fb4-d56302dd5b93 service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:15.325352 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec07dd-f86e-444c-8168-87b8d5991f52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:15.326016 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec07dd-f86e-444c-8168-87b8d5991f52 service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:15.326308 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec07dd-f86e-444c-8168-87b8d5991f52 service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:15.326592 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec07dd-f86e-444c-8168-87b8d5991f52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:15.328479 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e6ec07dd-f86e-444c-8168-87b8d5991f52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:15.396222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec07dd-f86e-444c-8168-87b8d5991f52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:15.397872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec07dd-f86e-444c-8168-87b8d5991f52 service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:15.407260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1164/2336] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:59:21.570300 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=6 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:23.566274 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834545f-4949-4841-a451-41daed7e9547 service nova] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:23.575475 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834545f-4949-4841-a451-41daed7e9547 service nova] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:23.579092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0de3ac-e9c8-4f69-afbf-ebb7fa0cbf82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:23.579718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0de3ac-e9c8-4f69-afbf-ebb7fa0cbf82 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:23.579999 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0de3ac-e9c8-4f69-afbf-ebb7fa0cbf82 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:23.580269 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0de3ac-e9c8-4f69-afbf-ebb7fa0cbf82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:23.582044 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-1f0de3ac-e9c8-4f69-afbf-ebb7fa0cbf82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:23.642367 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0de3ac-e9c8-4f69-afbf-ebb7fa0cbf82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:23.644359 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0de3ac-e9c8-4f69-afbf-ebb7fa0cbf82 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:23.654089 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1173/2337] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:59:25.403318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=28 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:27.468059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec07dd-f86e-444c-8168-87b8d5991f52 service nova] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:27.469511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e6ec07dd-f86e-444c-8168-87b8d5991f52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:27.482616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec07dd-f86e-444c-8168-87b8d5991f52 service nova] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:27.488187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8c67c-2112-4563-9d00-781c8699bc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:27.489056 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8c67c-2112-4563-9d00-781c8699bc8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:27.489375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8c67c-2112-4563-9d00-781c8699bc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:27.489657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8c67c-2112-4563-9d00-781c8699bc8d admin admin] PATH_INFO: `/v3/users/81f42e71a4d24250874f31f4e8269e04` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:27.490845 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8c67c-2112-4563-9d00-781c8699bc8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=81f42e71a4d24250874f31f4e8269e04)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:27.492771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8c67c-2112-4563-9d00-781c8699bc8d admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:27.540599 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-25c8c67c-2112-4563-9d00-781c8699bc8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81f42e71a4d24250874f31f4e8269e04'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:27.554006 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-25c8c67c-2112-4563-9d00-781c8699bc8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81f42e71a4d24250874f31f4e8269e04'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:27.554869 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-25c8c67c-2112-4563-9d00-781c8699bc8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81f42e71a4d24250874f31f4e8269e04'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:27.558625 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-25c8c67c-2112-4563-9d00-781c8699bc8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81f42e71a4d24250874f31f4e8269e04'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:27.563840 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-25c8c67c-2112-4563-9d00-781c8699bc8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81f42e71a4d24250874f31f4e8269e04'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:27.576770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1165/2338] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:59:27 2022] DELETE /identity/v3/users/81f42e71a4d24250874f31f4e8269e04 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:27.759635 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0de3ac-e9c8-4f69-afbf-ebb7fa0cbf82 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:27.771261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0de3ac-e9c8-4f69-afbf-ebb7fa0cbf82 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:27.840856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aa556-4517-40e3-8625-c465d93a6a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:27.841778 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aa556-4517-40e3-8625-c465d93a6a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:27.842048 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aa556-4517-40e3-8625-c465d93a6a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:27.842327 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aa556-4517-40e3-8625-c465d93a6a79 admin admin] PATH_INFO: `/v3/projects/147701dfbae64d0a85318187af9dcf2e` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:27.843531 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3aa556-4517-40e3-8625-c465d93a6a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=147701dfbae64d0a85318187af9dcf2e)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:27.845702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3aa556-4517-40e3-8625-c465d93a6a79 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:27.898283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-2b3aa556-4517-40e3-8625-c465d93a6a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '147701dfbae64d0a85318187af9dcf2e', 'request_id': 'req-2b3aa556-4517-40e3-8625-c465d93a6a79'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:27.906070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-2b3aa556-4517-40e3-8625-c465d93a6a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '147701dfbae64d0a85318187af9dcf2e', 'request_id': 'req-2b3aa556-4517-40e3-8625-c465d93a6a79'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:27.916699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-2b3aa556-4517-40e3-8625-c465d93a6a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '147701dfbae64d0a85318187af9dcf2e', 'request_id': 'req-2b3aa556-4517-40e3-8625-c465d93a6a79'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:27.929464 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-2b3aa556-4517-40e3-8625-c465d93a6a79 admin admin] The token cache is being invalidate because project 147701dfbae64d0a85318187af9dcf2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:59:27.929972 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-2b3aa556-4517-40e3-8625-c465d93a6a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:27.930881 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-2b3aa556-4517-40e3-8625-c465d93a6a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:27.932803 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1174/2339] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:59:27 2022] DELETE /identity/v3/projects/147701dfbae64d0a85318187af9dcf2e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:27.937672 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6224a-46ef-46f5-8172-f973b69015fe None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:27.937965 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6224a-46ef-46f5-8172-f973b69015fe None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:27.938245 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6224a-46ef-46f5-8172-f973b69015fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:27.956338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-63d6224a-46ef-46f5-8172-f973b69015fe None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:27.957594 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-63d6224a-46ef-46f5-8172-f973b69015fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:28.030152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1166/2340] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:59:28.031776 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dad7b7-4ef8-44a6-8d2f-069020815574 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:28.032087 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dad7b7-4ef8-44a6-8d2f-069020815574 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:28.032363 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dad7b7-4ef8-44a6-8d2f-069020815574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:28.051540 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-d3dad7b7-4ef8-44a6-8d2f-069020815574 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:28.052676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d3dad7b7-4ef8-44a6-8d2f-069020815574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:28.061142 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1175/2341] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:28.065397 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6224a-46ef-46f5-8172-f973b69015fe None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:28.075154 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6224a-46ef-46f5-8172-f973b69015fe None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:28.079813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bb750-c1a2-423c-8e30-d88afe4bd4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:28.081320 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bb750-c1a2-423c-8e30-d88afe4bd4ee admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:28.081320 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bb750-c1a2-423c-8e30-d88afe4bd4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:28.081621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bb750-c1a2-423c-8e30-d88afe4bd4ee admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:28.082340 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bb750-c1a2-423c-8e30-d88afe4bd4ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:59:28.082639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bb750-c1a2-423c-8e30-d88afe4bd4ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:28.084246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bb750-c1a2-423c-8e30-d88afe4bd4ee admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:28.097010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1167/2342] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:59:28.101643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dad7b7-4ef8-44a6-8d2f-069020815574 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:28.111379 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dad7b7-4ef8-44a6-8d2f-069020815574 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:28.117044 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46beb983-5048-4fc5-943c-ba857456a901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:28.117760 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46beb983-5048-4fc5-943c-ba857456a901 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:28.118038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46beb983-5048-4fc5-943c-ba857456a901 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:28.118315 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46beb983-5048-4fc5-943c-ba857456a901 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:28.119285 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46beb983-5048-4fc5-943c-ba857456a901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:28.121200 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46beb983-5048-4fc5-943c-ba857456a901 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:28.137033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:28.163872 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1176/2343] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:59:28 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:59:28.168053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bb750-c1a2-423c-8e30-d88afe4bd4ee admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:28.178951 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bb750-c1a2-423c-8e30-d88afe4bd4ee admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:28.238050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f701d1-377f-4582-84c3-c8ef5eb683c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:28.238757 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f701d1-377f-4582-84c3-c8ef5eb683c0 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:28.239007 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f701d1-377f-4582-84c3-c8ef5eb683c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:28.239283 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f701d1-377f-4582-84c3-c8ef5eb683c0 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:28.239976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f701d1-377f-4582-84c3-c8ef5eb683c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:28.241958 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f701d1-377f-4582-84c3-c8ef5eb683c0 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:28.248939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:28.265359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1168/2344] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:59:28 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:59:28.269922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46beb983-5048-4fc5-943c-ba857456a901 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:28.280664 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46beb983-5048-4fc5-943c-ba857456a901 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:28.285937 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a3e0d-e9ad-4422-9a1c-a4cae8740df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:28.286602 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a3e0d-e9ad-4422-9a1c-a4cae8740df6 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:28.286890 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a3e0d-e9ad-4422-9a1c-a4cae8740df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:28.287168 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a3e0d-e9ad-4422-9a1c-a4cae8740df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:28.287894 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a3e0d-e9ad-4422-9a1c-a4cae8740df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:28.289525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a3e0d-e9ad-4422-9a1c-a4cae8740df6 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:28.302967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1177/2345] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:59:28.304115 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f701d1-377f-4582-84c3-c8ef5eb683c0 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:28.314680 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f701d1-377f-4582-84c3-c8ef5eb683c0 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:28.320888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a05b6-7f40-4c29-85d2-2ba55f026245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:28.321603 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a05b6-7f40-4c29-85d2-2ba55f026245 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:28.321888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a05b6-7f40-4c29-85d2-2ba55f026245 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:28.322229 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a05b6-7f40-4c29-85d2-2ba55f026245 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:28.322994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a05b6-7f40-4c29-85d2-2ba55f026245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:28.324605 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a05b6-7f40-4c29-85d2-2ba55f026245 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:28.335746 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1169/2346] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:59:28.339742 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a3e0d-e9ad-4422-9a1c-a4cae8740df6 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:28.350497 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a3e0d-e9ad-4422-9a1c-a4cae8740df6 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:28.355247 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c9616-87d5-46f0-bfa6-d0da69cde7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:28.356124 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c9616-87d5-46f0-bfa6-d0da69cde7a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:28.356410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c9616-87d5-46f0-bfa6-d0da69cde7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:28.356690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c9616-87d5-46f0-bfa6-d0da69cde7a9 admin admin] PATH_INFO: `/v3/projects/92131e8891ba44a8aed9d45177f8970f/users/76ad2a22289644418bd2c4bb3845be79/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:28.372644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c9616-87d5-46f0-bfa6-d0da69cde7a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92131e8891ba44a8aed9d45177f8970f, user_id=76ad2a22289644418bd2c4bb3845be79, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:28.375342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c9616-87d5-46f0-bfa6-d0da69cde7a9 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:28.390092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1178/2347] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:59:28 2022] PUT /identity/v3/projects/92131e8891ba44a8aed9d45177f8970f/users/76ad2a22289644418bd2c4bb3845be79/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:28.400678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e00b4-bf5b-449b-99dc-20918fce2a8b None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:28.400974 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e00b4-bf5b-449b-99dc-20918fce2a8b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:28.401258 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e00b4-bf5b-449b-99dc-20918fce2a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:28.427273 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-199e00b4-bf5b-449b-99dc-20918fce2a8b None None] MFA Rules not processed for user `76ad2a22289644418bd2c4bb3845be79`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:28.428478 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-199e00b4-bf5b-449b-99dc-20918fce2a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:28.495344 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1170/2348] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:59:28.499792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c9616-87d5-46f0-bfa6-d0da69cde7a9 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:28.572033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c9616-87d5-46f0-bfa6-d0da69cde7a9 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:28.577918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffb7cd-7ed4-45af-8ab4-2e5edc9d2ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:28.577918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffb7cd-7ed4-45af-8ab4-2e5edc9d2ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:28.577918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffb7cd-7ed4-45af-8ab4-2e5edc9d2ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:28.578226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffb7cd-7ed4-45af-8ab4-2e5edc9d2ae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:28.578783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffb7cd-7ed4-45af-8ab4-2e5edc9d2ae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:28.581261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffb7cd-7ed4-45af-8ab4-2e5edc9d2ae1 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:28.617214 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1179/2349] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:59:28 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:59:28.622446 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e00b4-bf5b-449b-99dc-20918fce2a8b None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:28.635591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e00b4-bf5b-449b-99dc-20918fce2a8b None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:28.712005 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb424320-ad16-4276-8108-61078ca6f8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:28.712661 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb424320-ad16-4276-8108-61078ca6f8c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:28.712949 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb424320-ad16-4276-8108-61078ca6f8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:28.713232 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb424320-ad16-4276-8108-61078ca6f8c7 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:28.713961 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb424320-ad16-4276-8108-61078ca6f8c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:28.715884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb424320-ad16-4276-8108-61078ca6f8c7 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:28.736273 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1171/2350] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:59:28 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:59:28.740280 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffb7cd-7ed4-45af-8ab4-2e5edc9d2ae1 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:28.751154 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffb7cd-7ed4-45af-8ab4-2e5edc9d2ae1 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:28.757186 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d3070-2fda-405f-8ccd-558939cc2cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:28.757878 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d3070-2fda-405f-8ccd-558939cc2cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:28.758166 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d3070-2fda-405f-8ccd-558939cc2cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:28.758444 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d3070-2fda-405f-8ccd-558939cc2cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:28.759168 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d3070-2fda-405f-8ccd-558939cc2cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:28.760832 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d3070-2fda-405f-8ccd-558939cc2cf4 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:28.772579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1180/2351] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:59:28.776672 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb424320-ad16-4276-8108-61078ca6f8c7 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:28.787284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb424320-ad16-4276-8108-61078ca6f8c7 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:28.792177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737cd53-31d9-43f6-9b02-afb5bbaa9b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:28.793160 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737cd53-31d9-43f6-9b02-afb5bbaa9b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:28.793469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737cd53-31d9-43f6-9b02-afb5bbaa9b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:28.793742 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737cd53-31d9-43f6-9b02-afb5bbaa9b7b admin admin] PATH_INFO: `/v3/projects/bb4b0712e0f84939ab77587583a099dd/users/cd93294ab41342ae856ef12ed4bd4d8e/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:28.808876 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737cd53-31d9-43f6-9b02-afb5bbaa9b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb4b0712e0f84939ab77587583a099dd, user_id=cd93294ab41342ae856ef12ed4bd4d8e, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:28.811493 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737cd53-31d9-43f6-9b02-afb5bbaa9b7b admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:28.824656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1172/2352] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:59:28 2022] PUT /identity/v3/projects/bb4b0712e0f84939ab77587583a099dd/users/cd93294ab41342ae856ef12ed4bd4d8e/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:28.828978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d3070-2fda-405f-8ccd-558939cc2cf4 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:28.838508 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d3070-2fda-405f-8ccd-558939cc2cf4 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:28.898181 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8fb2c-4746-4b91-83e0-9e49203792e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:28.899319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8fb2c-4746-4b91-83e0-9e49203792e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:28.899808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8fb2c-4746-4b91-83e0-9e49203792e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:28.900305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8fb2c-4746-4b91-83e0-9e49203792e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:28.901418 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8fb2c-4746-4b91-83e0-9e49203792e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:28.903962 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8fb2c-4746-4b91-83e0-9e49203792e9 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:28.915998 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1181/2353] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:59:28.920050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737cd53-31d9-43f6-9b02-afb5bbaa9b7b admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:28.931111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737cd53-31d9-43f6-9b02-afb5bbaa9b7b admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:28.935892 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fefd6c-cdef-4bf8-b1a8-eda90c991fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:28.936771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fefd6c-cdef-4bf8-b1a8-eda90c991fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:28.937054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fefd6c-cdef-4bf8-b1a8-eda90c991fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:28.937496 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fefd6c-cdef-4bf8-b1a8-eda90c991fbd admin admin] PATH_INFO: `/v3/projects/bb4b0712e0f84939ab77587583a099dd/users/cd93294ab41342ae856ef12ed4bd4d8e/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:28.939513 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fefd6c-cdef-4bf8-b1a8-eda90c991fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb4b0712e0f84939ab77587583a099dd, user_id=cd93294ab41342ae856ef12ed4bd4d8e, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:28.942872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fefd6c-cdef-4bf8-b1a8-eda90c991fbd admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:28.954426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1173/2354] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:59:28 2022] PUT /identity/v3/projects/bb4b0712e0f84939ab77587583a099dd/users/cd93294ab41342ae856ef12ed4bd4d8e/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:28.966161 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89cefe-778f-43b3-946b-3f4fd7205b55 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:28.966452 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89cefe-778f-43b3-946b-3f4fd7205b55 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:28.966732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89cefe-778f-43b3-946b-3f4fd7205b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:29.002340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-ad89cefe-778f-43b3-946b-3f4fd7205b55 None None] MFA Rules not processed for user `cd93294ab41342ae856ef12ed4bd4d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:29.004119 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ad89cefe-778f-43b3-946b-3f4fd7205b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:29.014240 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:29.082018 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1182/2355] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:28 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:29.093711 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fefd6c-cdef-4bf8-b1a8-eda90c991fbd admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:29.095784 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-60fefd6c-cdef-4bf8-b1a8-eda90c991fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:29.120021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:29.160130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fefd6c-cdef-4bf8-b1a8-eda90c991fbd admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:29.163763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c3614-0d1b-4f45-95ad-9101da16e153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:29.164411 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c3614-0d1b-4f45-95ad-9101da16e153 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:29.164694 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c3614-0d1b-4f45-95ad-9101da16e153 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:29.164971 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c3614-0d1b-4f45-95ad-9101da16e153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:29.176145 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c3614-0d1b-4f45-95ad-9101da16e153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:29.177685 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c3614-0d1b-4f45-95ad-9101da16e153 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:29.188532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1174/2356] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:29 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:59:29.244833 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89cefe-778f-43b3-946b-3f4fd7205b55 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:29.246429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ad89cefe-778f-43b3-946b-3f4fd7205b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:29.253942 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b9f24-e147-4053-89db-a64f35f7e2e8 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:29.254272 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b9f24-e147-4053-89db-a64f35f7e2e8 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:29.254554 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b9f24-e147-4053-89db-a64f35f7e2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:29.260819 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89cefe-778f-43b3-946b-3f4fd7205b55 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:29.264544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a532dcf-a1a8-4ee2-af91-e35a998eabb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:29.265188 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a532dcf-a1a8-4ee2-af91-e35a998eabb0 service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:29.265513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a532dcf-a1a8-4ee2-af91-e35a998eabb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:29.265789 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a532dcf-a1a8-4ee2-af91-e35a998eabb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:29.272019 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-ac2b9f24-e147-4053-89db-a64f35f7e2e8 None None] MFA Rules not processed for user `000330dc3f1a4b38b58686ee37b3b78c`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:29.273258 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ac2b9f24-e147-4053-89db-a64f35f7e2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:29.332511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1175/2357] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:29.333672 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a532dcf-a1a8-4ee2-af91-e35a998eabb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:29.335129 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a532dcf-a1a8-4ee2-af91-e35a998eabb0 service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:29.344946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1183/2358] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:59:29.663345 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b9f24-e147-4053-89db-a64f35f7e2e8 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:29.664795 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ac2b9f24-e147-4053-89db-a64f35f7e2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:29.722949 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b9f24-e147-4053-89db-a64f35f7e2e8 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:29.726808 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59296a50-3a42-4055-85ed-255fe4dd134f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:29.727091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59296a50-3a42-4055-85ed-255fe4dd134f service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:29.727434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59296a50-3a42-4055-85ed-255fe4dd134f service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:29.727634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59296a50-3a42-4055-85ed-255fe4dd134f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:29.729561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-59296a50-3a42-4055-85ed-255fe4dd134f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:29.740194 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59296a50-3a42-4055-85ed-255fe4dd134f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:29.741693 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59296a50-3a42-4055-85ed-255fe4dd134f service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:29.750008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1176/2359] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:59:31.782021 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a532dcf-a1a8-4ee2-af91-e35a998eabb0 service cinder] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:31.784182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8a532dcf-a1a8-4ee2-af91-e35a998eabb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:31.866078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a532dcf-a1a8-4ee2-af91-e35a998eabb0 service cinder] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:31.871732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af267984-78b9-4d0d-b138-96c40d5bbd32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:31.872510 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af267984-78b9-4d0d-b138-96c40d5bbd32 service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:31.872743 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af267984-78b9-4d0d-b138-96c40d5bbd32 service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:31.873555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af267984-78b9-4d0d-b138-96c40d5bbd32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:31.875677 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-af267984-78b9-4d0d-b138-96c40d5bbd32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:31.927623 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:31.944331 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af267984-78b9-4d0d-b138-96c40d5bbd32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:31.945992 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af267984-78b9-4d0d-b138-96c40d5bbd32 service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:31.955823 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1184/2360] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:59:32.958109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59296a50-3a42-4055-85ed-255fe4dd134f service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:33.019413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59296a50-3a42-4055-85ed-255fe4dd134f service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:33.024013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd801a5-6071-4f03-86c6-2b9755239e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:33.024866 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd801a5-6071-4f03-86c6-2b9755239e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:33.025150 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd801a5-6071-4f03-86c6-2b9755239e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:33.025459 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd801a5-6071-4f03-86c6-2b9755239e51 admin admin] PATH_INFO: `/v3/users/76ad2a22289644418bd2c4bb3845be79` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:33.026620 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd801a5-6071-4f03-86c6-2b9755239e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ad2a22289644418bd2c4bb3845be79)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:33.028526 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd801a5-6071-4f03-86c6-2b9755239e51 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:33.040783 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:33.083189 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-1fd801a5-6071-4f03-86c6-2b9755239e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ad2a22289644418bd2c4bb3845be79'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:33.097231 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-1fd801a5-6071-4f03-86c6-2b9755239e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ad2a22289644418bd2c4bb3845be79'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:33.097915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-1fd801a5-6071-4f03-86c6-2b9755239e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ad2a22289644418bd2c4bb3845be79'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:33.098531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-1fd801a5-6071-4f03-86c6-2b9755239e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ad2a22289644418bd2c4bb3845be79'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:33.106828 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-1fd801a5-6071-4f03-86c6-2b9755239e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ad2a22289644418bd2c4bb3845be79'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:33.120053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1177/2361] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:59:32 2022] DELETE /identity/v3/users/76ad2a22289644418bd2c4bb3845be79 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:33.124734 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3ef01-99de-4e88-b974-095edf5e883b None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:33.125665 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3ef01-99de-4e88-b974-095edf5e883b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:33.125975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3ef01-99de-4e88-b974-095edf5e883b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:33.146206 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-bcf3ef01-99de-4e88-b974-095edf5e883b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:33.147680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-bcf3ef01-99de-4e88-b974-095edf5e883b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:33.213252 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1185/2362] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:59:33.226201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd801a5-6071-4f03-86c6-2b9755239e51 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:33.227752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1fd801a5-6071-4f03-86c6-2b9755239e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:33.287515 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd801a5-6071-4f03-86c6-2b9755239e51 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:33.291120 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d684e-d099-4992-ad62-1d4c5d58eb94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:33.291760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d684e-d099-4992-ad62-1d4c5d58eb94 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:33.292039 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d684e-d099-4992-ad62-1d4c5d58eb94 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:33.292315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d684e-d099-4992-ad62-1d4c5d58eb94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:33.302025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d684e-d099-4992-ad62-1d4c5d58eb94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:33.303452 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d684e-d099-4992-ad62-1d4c5d58eb94 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:33.312906 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1178/2363] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:59:33.784335 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3ef01-99de-4e88-b974-095edf5e883b None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:33.785974 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-bcf3ef01-99de-4e88-b974-095edf5e883b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:33.800292 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3ef01-99de-4e88-b974-095edf5e883b None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:33.806062 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8593d8-4ce9-491b-adc6-9997bb6eecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:33.806795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8593d8-4ce9-491b-adc6-9997bb6eecf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:33.807146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8593d8-4ce9-491b-adc6-9997bb6eecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:33.807499 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8593d8-4ce9-491b-adc6-9997bb6eecf4 admin admin] PATH_INFO: `/v3/projects/92131e8891ba44a8aed9d45177f8970f` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:33.808827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8593d8-4ce9-491b-adc6-9997bb6eecf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92131e8891ba44a8aed9d45177f8970f)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:33.810857 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8593d8-4ce9-491b-adc6-9997bb6eecf4 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:33.862405 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8d8593d8-4ce9-491b-adc6-9997bb6eecf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92131e8891ba44a8aed9d45177f8970f', 'request_id': 'req-8d8593d8-4ce9-491b-adc6-9997bb6eecf4'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:33.869150 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8d8593d8-4ce9-491b-adc6-9997bb6eecf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92131e8891ba44a8aed9d45177f8970f', 'request_id': 'req-8d8593d8-4ce9-491b-adc6-9997bb6eecf4'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:33.877167 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8d8593d8-4ce9-491b-adc6-9997bb6eecf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92131e8891ba44a8aed9d45177f8970f', 'request_id': 'req-8d8593d8-4ce9-491b-adc6-9997bb6eecf4'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:33.889418 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8d8593d8-4ce9-491b-adc6-9997bb6eecf4 admin admin] The token cache is being invalidate because project 92131e8891ba44a8aed9d45177f8970f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:59:33.889716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8d8593d8-4ce9-491b-adc6-9997bb6eecf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:33.890346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8d8593d8-4ce9-491b-adc6-9997bb6eecf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:33.891882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1186/2364] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:59:33 2022] DELETE /identity/v3/projects/92131e8891ba44a8aed9d45177f8970f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:33.895981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d684e-d099-4992-ad62-1d4c5d58eb94 service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:33.905579 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d684e-d099-4992-ad62-1d4c5d58eb94 service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:33.960017 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf417d74-a79c-477a-9b2d-1b50ee45a15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:33.960875 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf417d74-a79c-477a-9b2d-1b50ee45a15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:33.961155 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf417d74-a79c-477a-9b2d-1b50ee45a15b admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:33.961457 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf417d74-a79c-477a-9b2d-1b50ee45a15b admin admin] PATH_INFO: `/v3/users/cd93294ab41342ae856ef12ed4bd4d8e` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:33.962622 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf417d74-a79c-477a-9b2d-1b50ee45a15b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd93294ab41342ae856ef12ed4bd4d8e)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:33.964526 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf417d74-a79c-477a-9b2d-1b50ee45a15b admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:34.001373 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:34.012500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-bf417d74-a79c-477a-9b2d-1b50ee45a15b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd93294ab41342ae856ef12ed4bd4d8e'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:34.024455 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-bf417d74-a79c-477a-9b2d-1b50ee45a15b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd93294ab41342ae856ef12ed4bd4d8e'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:34.025097 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-bf417d74-a79c-477a-9b2d-1b50ee45a15b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd93294ab41342ae856ef12ed4bd4d8e'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:34.025725 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-bf417d74-a79c-477a-9b2d-1b50ee45a15b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd93294ab41342ae856ef12ed4bd4d8e'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:34.032488 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-bf417d74-a79c-477a-9b2d-1b50ee45a15b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd93294ab41342ae856ef12ed4bd4d8e'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:34.045187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1179/2365] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:59:33 2022] DELETE /identity/v3/users/cd93294ab41342ae856ef12ed4bd4d8e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:34.319870 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8593d8-4ce9-491b-adc6-9997bb6eecf4 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:34.321340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8d8593d8-4ce9-491b-adc6-9997bb6eecf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:34.335696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8593d8-4ce9-491b-adc6-9997bb6eecf4 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:34.393487 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf5c21-fecd-4514-87af-af8dadd3e30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:34.394347 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf5c21-fecd-4514-87af-af8dadd3e30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:34.394629 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf5c21-fecd-4514-87af-af8dadd3e30a admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:34.394906 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf5c21-fecd-4514-87af-af8dadd3e30a admin admin] PATH_INFO: `/v3/projects/bb4b0712e0f84939ab77587583a099dd` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:34.396073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf5c21-fecd-4514-87af-af8dadd3e30a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb4b0712e0f84939ab77587583a099dd)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:34.398018 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf5c21-fecd-4514-87af-af8dadd3e30a admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:34.405946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:34.444099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-fcbf5c21-fecd-4514-87af-af8dadd3e30a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb4b0712e0f84939ab77587583a099dd', 'request_id': 'req-fcbf5c21-fecd-4514-87af-af8dadd3e30a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:34.450047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-fcbf5c21-fecd-4514-87af-af8dadd3e30a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb4b0712e0f84939ab77587583a099dd', 'request_id': 'req-fcbf5c21-fecd-4514-87af-af8dadd3e30a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:34.457788 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-fcbf5c21-fecd-4514-87af-af8dadd3e30a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb4b0712e0f84939ab77587583a099dd', 'request_id': 'req-fcbf5c21-fecd-4514-87af-af8dadd3e30a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:34.468104 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-fcbf5c21-fecd-4514-87af-af8dadd3e30a admin admin] The token cache is being invalidate because project bb4b0712e0f84939ab77587583a099dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:59:34.468389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-fcbf5c21-fecd-4514-87af-af8dadd3e30a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:34.469007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-fcbf5c21-fecd-4514-87af-af8dadd3e30a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:34.470547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1187/2366] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:59:34 2022] DELETE /identity/v3/projects/bb4b0712e0f84939ab77587583a099dd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:34.475464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec683bb4-c10e-4ba0-b4cc-32988493fb47 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:34.475759 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec683bb4-c10e-4ba0-b4cc-32988493fb47 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:34.476069 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec683bb4-c10e-4ba0-b4cc-32988493fb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:34.494535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-ec683bb4-c10e-4ba0-b4cc-32988493fb47 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:34.495802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ec683bb4-c10e-4ba0-b4cc-32988493fb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:34.553743 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1180/2367] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:34.561892 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0c288-cc6c-4b6c-9a85-97d09d465878 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:34.562148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0c288-cc6c-4b6c-9a85-97d09d465878 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:34.562453 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0c288-cc6c-4b6c-9a85-97d09d465878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:34.583077 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-75e0c288-cc6c-4b6c-9a85-97d09d465878 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:34.584280 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-75e0c288-cc6c-4b6c-9a85-97d09d465878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:34.592116 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1188/2368] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:34.596658 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec683bb4-c10e-4ba0-b4cc-32988493fb47 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:34.606250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec683bb4-c10e-4ba0-b4cc-32988493fb47 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:34.611584 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da06669-dd02-4104-8f37-1fbfb175aa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:34.612248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da06669-dd02-4104-8f37-1fbfb175aa2d admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:34.612529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da06669-dd02-4104-8f37-1fbfb175aa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:34.612802 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da06669-dd02-4104-8f37-1fbfb175aa2d admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:34.613556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da06669-dd02-4104-8f37-1fbfb175aa2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:59:34.613862 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da06669-dd02-4104-8f37-1fbfb175aa2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:34.615836 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da06669-dd02-4104-8f37-1fbfb175aa2d admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:34.629986 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1181/2369] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:59:34.634314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0c288-cc6c-4b6c-9a85-97d09d465878 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:34.644192 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0c288-cc6c-4b6c-9a85-97d09d465878 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:34.649164 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ebdef-016a-4cac-9724-e0d91285dcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:34.649856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ebdef-016a-4cac-9724-e0d91285dcd3 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:34.650138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ebdef-016a-4cac-9724-e0d91285dcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:34.650410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ebdef-016a-4cac-9724-e0d91285dcd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:34.651135 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ebdef-016a-4cac-9724-e0d91285dcd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:34.653036 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ebdef-016a-4cac-9724-e0d91285dcd3 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:34.682391 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1189/2370] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:59:34 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:59:34.686703 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da06669-dd02-4104-8f37-1fbfb175aa2d admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:34.697210 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da06669-dd02-4104-8f37-1fbfb175aa2d admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:34.757533 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6bc28-e19b-4fd8-b7fe-9e052d872973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:34.758722 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6bc28-e19b-4fd8-b7fe-9e052d872973 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:34.759281 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6bc28-e19b-4fd8-b7fe-9e052d872973 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:34.759715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6bc28-e19b-4fd8-b7fe-9e052d872973 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:34.760689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6bc28-e19b-4fd8-b7fe-9e052d872973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:34.762793 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6bc28-e19b-4fd8-b7fe-9e052d872973 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:34.791056 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1182/2371] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:59:34 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:59:34.795088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ebdef-016a-4cac-9724-e0d91285dcd3 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:34.817510 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ebdef-016a-4cac-9724-e0d91285dcd3 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:34.822724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57244f84-dbf0-4307-a129-55c868490a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:34.823384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57244f84-dbf0-4307-a129-55c868490a79 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:34.823838 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57244f84-dbf0-4307-a129-55c868490a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:34.824118 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57244f84-dbf0-4307-a129-55c868490a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:34.824838 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57244f84-dbf0-4307-a129-55c868490a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:34.827149 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57244f84-dbf0-4307-a129-55c868490a79 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:34.837611 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1190/2372] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:59:34.841703 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6bc28-e19b-4fd8-b7fe-9e052d872973 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:34.852154 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6bc28-e19b-4fd8-b7fe-9e052d872973 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:34.856889 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e9a1a-4592-47e4-af0f-f6498a7488d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:34.857721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e9a1a-4592-47e4-af0f-f6498a7488d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:34.858109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e9a1a-4592-47e4-af0f-f6498a7488d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:34.858648 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e9a1a-4592-47e4-af0f-f6498a7488d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:34.859585 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e9a1a-4592-47e4-af0f-f6498a7488d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:34.861837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e9a1a-4592-47e4-af0f-f6498a7488d8 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:34.872670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1183/2373] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:59:34.877752 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57244f84-dbf0-4307-a129-55c868490a79 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:34.889997 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57244f84-dbf0-4307-a129-55c868490a79 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:34.896372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520099d-504b-4b75-a65e-d0823f23647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:34.897286 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520099d-504b-4b75-a65e-d0823f23647e admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:34.898126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520099d-504b-4b75-a65e-d0823f23647e admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:34.898126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520099d-504b-4b75-a65e-d0823f23647e admin admin] PATH_INFO: `/v3/projects/72a7b877814c49a5a847f142ebc332eb/users/9663303794f046318e52e1793ae8b0b0/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:34.918620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520099d-504b-4b75-a65e-d0823f23647e admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a7b877814c49a5a847f142ebc332eb, user_id=9663303794f046318e52e1793ae8b0b0, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:34.921539 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520099d-504b-4b75-a65e-d0823f23647e admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:34.940744 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1191/2374] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:59:34 2022] PUT /identity/v3/projects/72a7b877814c49a5a847f142ebc332eb/users/9663303794f046318e52e1793ae8b0b0/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:59:34.950820 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7751ab4-fcd7-484e-8508-ecddaee63a4a None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:34.951211 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7751ab4-fcd7-484e-8508-ecddaee63a4a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:34.951565 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7751ab4-fcd7-484e-8508-ecddaee63a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:34.978573 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-c7751ab4-fcd7-484e-8508-ecddaee63a4a None None] MFA Rules not processed for user `9663303794f046318e52e1793ae8b0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:34.979983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c7751ab4-fcd7-484e-8508-ecddaee63a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:34.988062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:35.055033 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1184/2375] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:35.059346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520099d-504b-4b75-a65e-d0823f23647e admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:35.128477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520099d-504b-4b75-a65e-d0823f23647e admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:35.133259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeeb464-7482-4311-9c86-268c064c7145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:35.133946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeeb464-7482-4311-9c86-268c064c7145 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:35.134226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeeb464-7482-4311-9c86-268c064c7145 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:35.134500 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeeb464-7482-4311-9c86-268c064c7145 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:35.135246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeeb464-7482-4311-9c86-268c064c7145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:35.137163 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeeb464-7482-4311-9c86-268c064c7145 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:35.166324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1192/2376] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:59:35 2022] POST /identity/v3/projects => generated 401 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:59:35.171473 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7751ab4-fcd7-484e-8508-ecddaee63a4a None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:35.181684 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7751ab4-fcd7-484e-8508-ecddaee63a4a None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:35.234730 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17b128-8d63-4418-bea8-a76346562105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:35.235379 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17b128-8d63-4418-bea8-a76346562105 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:35.235658 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17b128-8d63-4418-bea8-a76346562105 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:35.235929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17b128-8d63-4418-bea8-a76346562105 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:35.237292 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17b128-8d63-4418-bea8-a76346562105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:35.239187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17b128-8d63-4418-bea8-a76346562105 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:35.259360 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1185/2377] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:59:35 2022] POST /identity/v3/users => generated 307 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:59:35.263619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeeb464-7482-4311-9c86-268c064c7145 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:35.274771 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeeb464-7482-4311-9c86-268c064c7145 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:35.279443 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da67e99-505b-4924-bdd6-c17d6337dcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:35.280095 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da67e99-505b-4924-bdd6-c17d6337dcec admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:35.280377 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da67e99-505b-4924-bdd6-c17d6337dcec admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:35.280653 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da67e99-505b-4924-bdd6-c17d6337dcec admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:35.281402 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da67e99-505b-4924-bdd6-c17d6337dcec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:35.282971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da67e99-505b-4924-bdd6-c17d6337dcec admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:35.293944 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1193/2378] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:59:35.298108 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17b128-8d63-4418-bea8-a76346562105 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:35.308490 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17b128-8d63-4418-bea8-a76346562105 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:35.313038 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ea6c9-4633-4074-8ed7-ec23116f3d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:35.313949 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ea6c9-4633-4074-8ed7-ec23116f3d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:35.314235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ea6c9-4633-4074-8ed7-ec23116f3d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:35.314547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ea6c9-4633-4074-8ed7-ec23116f3d57 admin admin] PATH_INFO: `/v3/projects/3bc2c90157fa44a8b441992500c1f05b/users/4fa9e1e4377a45ac92d47c8fa5319511/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:35.329420 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ea6c9-4633-4074-8ed7-ec23116f3d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc2c90157fa44a8b441992500c1f05b, user_id=4fa9e1e4377a45ac92d47c8fa5319511, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:35.332091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ea6c9-4633-4074-8ed7-ec23116f3d57 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:35.346855 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1186/2379] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:59:35 2022] PUT /identity/v3/projects/3bc2c90157fa44a8b441992500c1f05b/users/4fa9e1e4377a45ac92d47c8fa5319511/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:35.350993 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da67e99-505b-4924-bdd6-c17d6337dcec admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:35.362012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da67e99-505b-4924-bdd6-c17d6337dcec admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:35.365926 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:35.424845 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a5b15-3b2f-4f3b-abe4-5fd76986b68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:35.425523 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a5b15-3b2f-4f3b-abe4-5fd76986b68e admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:35.425809 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a5b15-3b2f-4f3b-abe4-5fd76986b68e admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:35.426088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a5b15-3b2f-4f3b-abe4-5fd76986b68e admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:35.426806 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a5b15-3b2f-4f3b-abe4-5fd76986b68e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:35.428389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a5b15-3b2f-4f3b-abe4-5fd76986b68e admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:35.439804 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1194/2380] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:59:35.443913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ea6c9-4633-4074-8ed7-ec23116f3d57 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:35.454406 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ea6c9-4633-4074-8ed7-ec23116f3d57 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:35.459171 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63845b-9c61-45a6-9f48-697116c2e0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:35.460047 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63845b-9c61-45a6-9f48-697116c2e0df admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:35.460382 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63845b-9c61-45a6-9f48-697116c2e0df admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:35.460885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63845b-9c61-45a6-9f48-697116c2e0df admin admin] PATH_INFO: `/v3/projects/3bc2c90157fa44a8b441992500c1f05b/users/4fa9e1e4377a45ac92d47c8fa5319511/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:35.462883 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63845b-9c61-45a6-9f48-697116c2e0df admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc2c90157fa44a8b441992500c1f05b, user_id=4fa9e1e4377a45ac92d47c8fa5319511, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:35.465552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63845b-9c61-45a6-9f48-697116c2e0df admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:35.477205 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1187/2381] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:59:35 2022] PUT /identity/v3/projects/3bc2c90157fa44a8b441992500c1f05b/users/4fa9e1e4377a45ac92d47c8fa5319511/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:35.489189 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e5bdd-d775-4702-8dbf-eb5eb8609967 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:35.489593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e5bdd-d775-4702-8dbf-eb5eb8609967 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:35.489977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e5bdd-d775-4702-8dbf-eb5eb8609967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:35.517400 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-8b8e5bdd-d775-4702-8dbf-eb5eb8609967 None None] MFA Rules not processed for user `4fa9e1e4377a45ac92d47c8fa5319511`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:35.519106 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8b8e5bdd-d775-4702-8dbf-eb5eb8609967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:35.586382 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1195/2382] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:35 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:35.597032 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63845b-9c61-45a6-9f48-697116c2e0df admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:35.598923 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-fe63845b-9c61-45a6-9f48-697116c2e0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:35.656657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63845b-9c61-45a6-9f48-697116c2e0df admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:35.660301 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0010e7-e8a6-4282-a9bf-03ebda6231e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:35.660936 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0010e7-e8a6-4282-a9bf-03ebda6231e0 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:35.661216 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0010e7-e8a6-4282-a9bf-03ebda6231e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:35.661517 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0010e7-e8a6-4282-a9bf-03ebda6231e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:35.670698 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0010e7-e8a6-4282-a9bf-03ebda6231e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:35.672130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0010e7-e8a6-4282-a9bf-03ebda6231e0 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:35.686922 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1188/2383] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:35 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:59:35.764202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e5bdd-d775-4702-8dbf-eb5eb8609967 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:35.773899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e5bdd-d775-4702-8dbf-eb5eb8609967 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:35.777582 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638a7d8-63f2-43e9-9da6-4f624b51c984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:35.778212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638a7d8-63f2-43e9-9da6-4f624b51c984 service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:35.778498 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638a7d8-63f2-43e9-9da6-4f624b51c984 service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:35.778778 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638a7d8-63f2-43e9-9da6-4f624b51c984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:35.836729 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638a7d8-63f2-43e9-9da6-4f624b51c984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:35.838191 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638a7d8-63f2-43e9-9da6-4f624b51c984 service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:35.848283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1196/2384] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:59:37.426363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0010e7-e8a6-4282-a9bf-03ebda6231e0 service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:37.427901 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-fd0010e7-e8a6-4282-a9bf-03ebda6231e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:37.435438 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:37.559077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0010e7-e8a6-4282-a9bf-03ebda6231e0 service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:37.564577 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca710455-ca69-4bdf-b56b-650ed3fe669b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:37.565234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca710455-ca69-4bdf-b56b-650ed3fe669b service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:37.565543 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca710455-ca69-4bdf-b56b-650ed3fe669b service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:37.565821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca710455-ca69-4bdf-b56b-650ed3fe669b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:37.567588 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ca710455-ca69-4bdf-b56b-650ed3fe669b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:37.580388 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca710455-ca69-4bdf-b56b-650ed3fe669b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:37.582007 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca710455-ca69-4bdf-b56b-650ed3fe669b service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:37.593006 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1189/2385] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:59:39.978789 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638a7d8-63f2-43e9-9da6-4f624b51c984 service cinder] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:40.008177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:40.040087 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638a7d8-63f2-43e9-9da6-4f624b51c984 service cinder] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:40.044620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2c04a-6435-465e-ab67-d9cccc2d887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:40.045515 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2c04a-6435-465e-ab67-d9cccc2d887f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:40.045799 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2c04a-6435-465e-ab67-d9cccc2d887f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:40.046075 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2c04a-6435-465e-ab67-d9cccc2d887f admin admin] PATH_INFO: `/v3/users/9663303794f046318e52e1793ae8b0b0` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:40.047250 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2c04a-6435-465e-ab67-d9cccc2d887f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9663303794f046318e52e1793ae8b0b0)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:40.049738 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2c04a-6435-465e-ab67-d9cccc2d887f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:40.093619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-66e2c04a-6435-465e-ab67-d9cccc2d887f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9663303794f046318e52e1793ae8b0b0'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:40.094260 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-66e2c04a-6435-465e-ab67-d9cccc2d887f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9663303794f046318e52e1793ae8b0b0'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:40.094863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-66e2c04a-6435-465e-ab67-d9cccc2d887f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9663303794f046318e52e1793ae8b0b0'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:40.101889 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-66e2c04a-6435-465e-ab67-d9cccc2d887f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9663303794f046318e52e1793ae8b0b0'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:40.108963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-66e2c04a-6435-465e-ab67-d9cccc2d887f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9663303794f046318e52e1793ae8b0b0'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:40.126512 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1197/2386] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:59:39 2022] DELETE /identity/v3/users/9663303794f046318e52e1793ae8b0b0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:40.131504 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330eb54-e4c2-43f2-9976-f5e4fbbf29e6 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:40.132002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330eb54-e4c2-43f2-9976-f5e4fbbf29e6 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:40.132108 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330eb54-e4c2-43f2-9976-f5e4fbbf29e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:40.149738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-9330eb54-e4c2-43f2-9976-f5e4fbbf29e6 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:40.150918 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9330eb54-e4c2-43f2-9976-f5e4fbbf29e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:40.208741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1190/2387] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:40.218163 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2c04a-6435-465e-ab67-d9cccc2d887f admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:40.219570 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-66e2c04a-6435-465e-ab67-d9cccc2d887f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:40.276178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2c04a-6435-465e-ab67-d9cccc2d887f admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:40.279775 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a565b6-358d-4128-9247-dec964f3af00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:40.280414 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a565b6-358d-4128-9247-dec964f3af00 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:40.280693 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a565b6-358d-4128-9247-dec964f3af00 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:40.280967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a565b6-358d-4128-9247-dec964f3af00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:40.289885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a565b6-358d-4128-9247-dec964f3af00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:40.291295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a565b6-358d-4128-9247-dec964f3af00 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:40.301009 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1198/2388] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:59:40.560862 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330eb54-e4c2-43f2-9976-f5e4fbbf29e6 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:40.562356 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9330eb54-e4c2-43f2-9976-f5e4fbbf29e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:40.577027 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330eb54-e4c2-43f2-9976-f5e4fbbf29e6 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:40.582099 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf9f3b-3707-4052-9210-ea5247564003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:40.583000 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf9f3b-3707-4052-9210-ea5247564003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:40.583311 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf9f3b-3707-4052-9210-ea5247564003 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:40.583550 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf9f3b-3707-4052-9210-ea5247564003 admin admin] PATH_INFO: `/v3/projects/72a7b877814c49a5a847f142ebc332eb` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:40.584810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf9f3b-3707-4052-9210-ea5247564003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a7b877814c49a5a847f142ebc332eb)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:40.586750 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf9f3b-3707-4052-9210-ea5247564003 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:40.632874 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7caf9f3b-3707-4052-9210-ea5247564003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a7b877814c49a5a847f142ebc332eb', 'request_id': 'req-7caf9f3b-3707-4052-9210-ea5247564003'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:40.639052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7caf9f3b-3707-4052-9210-ea5247564003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a7b877814c49a5a847f142ebc332eb', 'request_id': 'req-7caf9f3b-3707-4052-9210-ea5247564003'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:40.644611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7caf9f3b-3707-4052-9210-ea5247564003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a7b877814c49a5a847f142ebc332eb', 'request_id': 'req-7caf9f3b-3707-4052-9210-ea5247564003'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:40.656517 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7caf9f3b-3707-4052-9210-ea5247564003 admin admin] The token cache is being invalidate because project 72a7b877814c49a5a847f142ebc332eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:59:40.656808 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7caf9f3b-3707-4052-9210-ea5247564003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:40.657478 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7caf9f3b-3707-4052-9210-ea5247564003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:40.659510 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1191/2389] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:59:40 2022] DELETE /identity/v3/projects/72a7b877814c49a5a847f142ebc332eb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:40.663542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a565b6-358d-4128-9247-dec964f3af00 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:40.673229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a565b6-358d-4128-9247-dec964f3af00 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:40.718995 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:40.732724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ae64e-807a-409c-9b1d-681a8a74e096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:40.733691 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ae64e-807a-409c-9b1d-681a8a74e096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:40.733912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ae64e-807a-409c-9b1d-681a8a74e096 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:40.734200 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ae64e-807a-409c-9b1d-681a8a74e096 admin admin] PATH_INFO: `/v3/users/4fa9e1e4377a45ac92d47c8fa5319511` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:40.735369 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ae64e-807a-409c-9b1d-681a8a74e096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa9e1e4377a45ac92d47c8fa5319511)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:40.737888 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ae64e-807a-409c-9b1d-681a8a74e096 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:40.782493 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-a45ae64e-807a-409c-9b1d-681a8a74e096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa9e1e4377a45ac92d47c8fa5319511'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:40.783886 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-a45ae64e-807a-409c-9b1d-681a8a74e096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa9e1e4377a45ac92d47c8fa5319511'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:40.784530 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-a45ae64e-807a-409c-9b1d-681a8a74e096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa9e1e4377a45ac92d47c8fa5319511'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:40.792783 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-a45ae64e-807a-409c-9b1d-681a8a74e096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa9e1e4377a45ac92d47c8fa5319511'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:40.804349 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-a45ae64e-807a-409c-9b1d-681a8a74e096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa9e1e4377a45ac92d47c8fa5319511'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:40.821889 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1199/2390] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:59:40 2022] DELETE /identity/v3/users/4fa9e1e4377a45ac92d47c8fa5319511 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:41.116246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf9f3b-3707-4052-9210-ea5247564003 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:41.118148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-7caf9f3b-3707-4052-9210-ea5247564003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:41.139891 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf9f3b-3707-4052-9210-ea5247564003 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:41.152500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:41.212108 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119868e8-4d2d-4edd-a6e2-17ef4cc0bdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:41.212976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119868e8-4d2d-4edd-a6e2-17ef4cc0bdaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:41.213245 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119868e8-4d2d-4edd-a6e2-17ef4cc0bdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:41.213559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119868e8-4d2d-4edd-a6e2-17ef4cc0bdaa admin admin] PATH_INFO: `/v3/projects/3bc2c90157fa44a8b441992500c1f05b` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:41.214731 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119868e8-4d2d-4edd-a6e2-17ef4cc0bdaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bc2c90157fa44a8b441992500c1f05b)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:41.216628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119868e8-4d2d-4edd-a6e2-17ef4cc0bdaa admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:41.265184 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-119868e8-4d2d-4edd-a6e2-17ef4cc0bdaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bc2c90157fa44a8b441992500c1f05b', 'request_id': 'req-119868e8-4d2d-4edd-a6e2-17ef4cc0bdaa'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:41.272366 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-119868e8-4d2d-4edd-a6e2-17ef4cc0bdaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bc2c90157fa44a8b441992500c1f05b', 'request_id': 'req-119868e8-4d2d-4edd-a6e2-17ef4cc0bdaa'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:41.278326 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-119868e8-4d2d-4edd-a6e2-17ef4cc0bdaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bc2c90157fa44a8b441992500c1f05b', 'request_id': 'req-119868e8-4d2d-4edd-a6e2-17ef4cc0bdaa'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:41.292188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-119868e8-4d2d-4edd-a6e2-17ef4cc0bdaa admin admin] The token cache is being invalidate because project 3bc2c90157fa44a8b441992500c1f05b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:59:41.292482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-119868e8-4d2d-4edd-a6e2-17ef4cc0bdaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:41.293133 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-119868e8-4d2d-4edd-a6e2-17ef4cc0bdaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:41.294776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1192/2391] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:59:41 2022] DELETE /identity/v3/projects/3bc2c90157fa44a8b441992500c1f05b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:41.299999 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482f28c-6cfc-42b9-b14c-b22ae19c5d8a None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:41.300519 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482f28c-6cfc-42b9-b14c-b22ae19c5d8a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:41.300619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482f28c-6cfc-42b9-b14c-b22ae19c5d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:41.318460 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-4482f28c-6cfc-42b9-b14c-b22ae19c5d8a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:41.319691 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-4482f28c-6cfc-42b9-b14c-b22ae19c5d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:41.386911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1200/2392] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:41.395134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8474e7-db8a-42dc-9fae-baf0f3ad7485 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:41.395670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8474e7-db8a-42dc-9fae-baf0f3ad7485 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:41.395951 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8474e7-db8a-42dc-9fae-baf0f3ad7485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:41.414105 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-1d8474e7-db8a-42dc-9fae-baf0f3ad7485 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:41.415447 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1d8474e7-db8a-42dc-9fae-baf0f3ad7485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:41.423667 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1193/2393] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:41.428052 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482f28c-6cfc-42b9-b14c-b22ae19c5d8a None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:41.438104 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482f28c-6cfc-42b9-b14c-b22ae19c5d8a None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:41.443724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29316c87-8bcf-4054-99d7-bce39b922c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:41.444381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29316c87-8bcf-4054-99d7-bce39b922c25 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:41.444665 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29316c87-8bcf-4054-99d7-bce39b922c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:41.444942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29316c87-8bcf-4054-99d7-bce39b922c25 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:41.445704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29316c87-8bcf-4054-99d7-bce39b922c25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:59:41.446018 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29316c87-8bcf-4054-99d7-bce39b922c25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:41.447688 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29316c87-8bcf-4054-99d7-bce39b922c25 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:41.460042 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1201/2394] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:59:41.464412 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8474e7-db8a-42dc-9fae-baf0f3ad7485 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:41.473864 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8474e7-db8a-42dc-9fae-baf0f3ad7485 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:41.478589 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd320274-22e5-440a-a79c-f3f262e69f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:41.479243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd320274-22e5-440a-a79c-f3f262e69f0c admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:41.479528 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd320274-22e5-440a-a79c-f3f262e69f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:41.479804 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd320274-22e5-440a-a79c-f3f262e69f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:41.480483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd320274-22e5-440a-a79c-f3f262e69f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:41.482470 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd320274-22e5-440a-a79c-f3f262e69f0c admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:41.513165 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1194/2395] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:59:41 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:59:41.514672 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29316c87-8bcf-4054-99d7-bce39b922c25 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:41.525166 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29316c87-8bcf-4054-99d7-bce39b922c25 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:41.576465 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:41.584588 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9518d-879a-465f-8b59-458e9c8e423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:41.585736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9518d-879a-465f-8b59-458e9c8e423b admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:41.586313 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9518d-879a-465f-8b59-458e9c8e423b admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:41.586827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9518d-879a-465f-8b59-458e9c8e423b admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:41.587729 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9518d-879a-465f-8b59-458e9c8e423b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:41.589964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9518d-879a-465f-8b59-458e9c8e423b admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:41.609526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1202/2396] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:59:41 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:59:41.614099 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd320274-22e5-440a-a79c-f3f262e69f0c admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:41.624534 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd320274-22e5-440a-a79c-f3f262e69f0c admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:41.629715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff306f-bfe3-4373-aede-5ae7711b1d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:41.630364 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff306f-bfe3-4373-aede-5ae7711b1d75 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:41.630643 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff306f-bfe3-4373-aede-5ae7711b1d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:41.630914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff306f-bfe3-4373-aede-5ae7711b1d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:41.631655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff306f-bfe3-4373-aede-5ae7711b1d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:41.633238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff306f-bfe3-4373-aede-5ae7711b1d75 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:41.643646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1195/2397] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:59:41.647644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9518d-879a-465f-8b59-458e9c8e423b admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:41.657849 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9518d-879a-465f-8b59-458e9c8e423b admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:41.662720 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66d96e-a08a-4853-b4c1-65df84417e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:41.663488 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66d96e-a08a-4853-b4c1-65df84417e51 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:41.663855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66d96e-a08a-4853-b4c1-65df84417e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:41.664153 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66d96e-a08a-4853-b4c1-65df84417e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:41.664879 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66d96e-a08a-4853-b4c1-65df84417e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:41.666500 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66d96e-a08a-4853-b4c1-65df84417e51 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:41.685660 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1203/2398] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:59:41.686937 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff306f-bfe3-4373-aede-5ae7711b1d75 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:41.697693 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff306f-bfe3-4373-aede-5ae7711b1d75 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:41.702358 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58228ff4-e0d7-47d8-8ec2-bd18f1e7aa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:41.703264 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58228ff4-e0d7-47d8-8ec2-bd18f1e7aa9e admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:41.703547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58228ff4-e0d7-47d8-8ec2-bd18f1e7aa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:41.703825 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58228ff4-e0d7-47d8-8ec2-bd18f1e7aa9e admin admin] PATH_INFO: `/v3/projects/46067338b6384824b09a5ad856024af9/users/d690773a35af45ad9dda29e7e94d0f26/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:41.719485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58228ff4-e0d7-47d8-8ec2-bd18f1e7aa9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=46067338b6384824b09a5ad856024af9, user_id=d690773a35af45ad9dda29e7e94d0f26, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:41.722226 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58228ff4-e0d7-47d8-8ec2-bd18f1e7aa9e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:41.735513 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1196/2399] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:59:41 2022] PUT /identity/v3/projects/46067338b6384824b09a5ad856024af9/users/d690773a35af45ad9dda29e7e94d0f26/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:41.747673 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a46778-5469-41d5-8f82-6da9e0d9f86f None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:41.747971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a46778-5469-41d5-8f82-6da9e0d9f86f None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:41.748251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a46778-5469-41d5-8f82-6da9e0d9f86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:41.776331 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-a3a46778-5469-41d5-8f82-6da9e0d9f86f None None] MFA Rules not processed for user `d690773a35af45ad9dda29e7e94d0f26`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:41.777552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-a3a46778-5469-41d5-8f82-6da9e0d9f86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:41.842815 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1204/2400] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:41.847277 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58228ff4-e0d7-47d8-8ec2-bd18f1e7aa9e admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:41.888616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:41.913490 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58228ff4-e0d7-47d8-8ec2-bd18f1e7aa9e admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:41.918328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7b04e-29a9-4112-a19c-54e82a65f7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:41.918988 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7b04e-29a9-4112-a19c-54e82a65f7cf admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:41.919271 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7b04e-29a9-4112-a19c-54e82a65f7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:41.919549 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7b04e-29a9-4112-a19c-54e82a65f7cf admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:41.920236 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7b04e-29a9-4112-a19c-54e82a65f7cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:41.922180 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7b04e-29a9-4112-a19c-54e82a65f7cf admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:41.951002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1197/2401] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:59:41 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:59:41.952145 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a46778-5469-41d5-8f82-6da9e0d9f86f None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:41.963274 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a46778-5469-41d5-8f82-6da9e0d9f86f None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:42.021296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6ce6f-1f6e-4c4e-8978-c20c3f79c5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:42.021971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6ce6f-1f6e-4c4e-8978-c20c3f79c5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:42.022262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6ce6f-1f6e-4c4e-8978-c20c3f79c5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:42.022567 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6ce6f-1f6e-4c4e-8978-c20c3f79c5a7 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:42.023259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6ce6f-1f6e-4c4e-8978-c20c3f79c5a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:42.025195 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6ce6f-1f6e-4c4e-8978-c20c3f79c5a7 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:42.047698 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1205/2402] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:59:41 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:59:42.052128 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7b04e-29a9-4112-a19c-54e82a65f7cf admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:42.062763 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7b04e-29a9-4112-a19c-54e82a65f7cf admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:42.067382 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3073388-3ca0-4967-be6a-c95b15c0844a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:42.068039 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3073388-3ca0-4967-be6a-c95b15c0844a admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:42.068320 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3073388-3ca0-4967-be6a-c95b15c0844a admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:42.068586 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3073388-3ca0-4967-be6a-c95b15c0844a admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:42.069382 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3073388-3ca0-4967-be6a-c95b15c0844a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:42.070995 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3073388-3ca0-4967-be6a-c95b15c0844a admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:42.081851 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1198/2403] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:59:42.086096 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6ce6f-1f6e-4c4e-8978-c20c3f79c5a7 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:42.097187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6ce6f-1f6e-4c4e-8978-c20c3f79c5a7 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:42.101881 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d38f1-4362-46e9-893c-46852acb1860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:42.102768 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d38f1-4362-46e9-893c-46852acb1860 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:42.103048 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d38f1-4362-46e9-893c-46852acb1860 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:42.103324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d38f1-4362-46e9-893c-46852acb1860 admin admin] PATH_INFO: `/v3/projects/7f66293c4162443893f3e98e62a946b3/users/f16f2d58b5d24feca0f43926e6cc9901/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:42.125473 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d38f1-4362-46e9-893c-46852acb1860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f66293c4162443893f3e98e62a946b3, user_id=f16f2d58b5d24feca0f43926e6cc9901, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:42.129340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d38f1-4362-46e9-893c-46852acb1860 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:42.144808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1206/2404] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:59:42 2022] PUT /identity/v3/projects/7f66293c4162443893f3e98e62a946b3/users/f16f2d58b5d24feca0f43926e6cc9901/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:59:42.148669 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3073388-3ca0-4967-be6a-c95b15c0844a admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:42.159630 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3073388-3ca0-4967-be6a-c95b15c0844a admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:42.261525 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13853439-7915-4f4b-9273-de995142aa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:42.262503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13853439-7915-4f4b-9273-de995142aa23 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:42.262919 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13853439-7915-4f4b-9273-de995142aa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:42.263306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13853439-7915-4f4b-9273-de995142aa23 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:42.264150 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13853439-7915-4f4b-9273-de995142aa23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:42.265901 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13853439-7915-4f4b-9273-de995142aa23 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:42.277494 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1199/2405] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:59:42.281635 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d38f1-4362-46e9-893c-46852acb1860 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:42.293382 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d38f1-4362-46e9-893c-46852acb1860 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:42.298834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74587cab-b3e2-41f7-b38c-88bba84f3314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:42.300335 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74587cab-b3e2-41f7-b38c-88bba84f3314 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:42.300921 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74587cab-b3e2-41f7-b38c-88bba84f3314 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:42.300921 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74587cab-b3e2-41f7-b38c-88bba84f3314 admin admin] PATH_INFO: `/v3/projects/7f66293c4162443893f3e98e62a946b3/users/f16f2d58b5d24feca0f43926e6cc9901/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:42.303201 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74587cab-b3e2-41f7-b38c-88bba84f3314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f66293c4162443893f3e98e62a946b3, user_id=f16f2d58b5d24feca0f43926e6cc9901, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:42.306272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74587cab-b3e2-41f7-b38c-88bba84f3314 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:42.319202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1207/2406] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:59:42 2022] PUT /identity/v3/projects/7f66293c4162443893f3e98e62a946b3/users/f16f2d58b5d24feca0f43926e6cc9901/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:59:42.329044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f0733-6466-450a-96f7-317d585def92 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:42.330201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f0733-6466-450a-96f7-317d585def92 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:42.330617 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f0733-6466-450a-96f7-317d585def92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:42.365640 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-748f0733-6466-450a-96f7-317d585def92 None None] MFA Rules not processed for user `f16f2d58b5d24feca0f43926e6cc9901`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:42.367186 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-748f0733-6466-450a-96f7-317d585def92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:42.452282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1200/2407] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:42.463568 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74587cab-b3e2-41f7-b38c-88bba84f3314 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:42.465693 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-74587cab-b3e2-41f7-b38c-88bba84f3314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:42.486627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:42.530364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74587cab-b3e2-41f7-b38c-88bba84f3314 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:42.534937 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ed43b-d7d4-4356-bf18-21ef3fceff0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:42.535594 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ed43b-d7d4-4356-bf18-21ef3fceff0e service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:42.535880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ed43b-d7d4-4356-bf18-21ef3fceff0e service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:42.536159 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ed43b-d7d4-4356-bf18-21ef3fceff0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:42.545792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ed43b-d7d4-4356-bf18-21ef3fceff0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:42.547359 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ed43b-d7d4-4356-bf18-21ef3fceff0e service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:42.561428 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1208/2408] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:59:42.669234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f0733-6466-450a-96f7-317d585def92 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:42.679138 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f0733-6466-450a-96f7-317d585def92 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:42.682884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5118f-834d-413e-85a7-fdcbe84a2a81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:42.683599 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5118f-834d-413e-85a7-fdcbe84a2a81 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:42.683889 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5118f-834d-413e-85a7-fdcbe84a2a81 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:42.684196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5118f-834d-413e-85a7-fdcbe84a2a81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:42.721139 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:42.760282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5118f-834d-413e-85a7-fdcbe84a2a81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:42.762029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5118f-834d-413e-85a7-fdcbe84a2a81 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:42.772319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1201/2409] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:59:45.343004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ed43b-d7d4-4356-bf18-21ef3fceff0e service cinder] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:45.405395 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ed43b-d7d4-4356-bf18-21ef3fceff0e service cinder] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:45.410304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c275d6a-c99d-4f0a-87ff-0aae03943814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:45.411248 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c275d6a-c99d-4f0a-87ff-0aae03943814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:45.411536 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c275d6a-c99d-4f0a-87ff-0aae03943814 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:45.411815 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c275d6a-c99d-4f0a-87ff-0aae03943814 admin admin] PATH_INFO: `/v3/users/d690773a35af45ad9dda29e7e94d0f26` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:45.413042 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c275d6a-c99d-4f0a-87ff-0aae03943814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d690773a35af45ad9dda29e7e94d0f26)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:45.415021 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c275d6a-c99d-4f0a-87ff-0aae03943814 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:45.461030 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5c275d6a-c99d-4f0a-87ff-0aae03943814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd690773a35af45ad9dda29e7e94d0f26'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:45.461689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5c275d6a-c99d-4f0a-87ff-0aae03943814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd690773a35af45ad9dda29e7e94d0f26'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:45.462282 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5c275d6a-c99d-4f0a-87ff-0aae03943814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd690773a35af45ad9dda29e7e94d0f26'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:45.469165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5c275d6a-c99d-4f0a-87ff-0aae03943814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd690773a35af45ad9dda29e7e94d0f26'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:45.476547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5c275d6a-c99d-4f0a-87ff-0aae03943814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd690773a35af45ad9dda29e7e94d0f26'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:45.494152 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1209/2410] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:59:45 2022] DELETE /identity/v3/users/d690773a35af45ad9dda29e7e94d0f26 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:45.498591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac0862-4cb9-4b2a-8a00-c1b2a8d95b0a None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:45.499078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac0862-4cb9-4b2a-8a00-c1b2a8d95b0a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:45.499184 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac0862-4cb9-4b2a-8a00-c1b2a8d95b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:45.516482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-47ac0862-4cb9-4b2a-8a00-c1b2a8d95b0a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:45.517746 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-47ac0862-4cb9-4b2a-8a00-c1b2a8d95b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:45.576550 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1202/2411] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:59:45.586599 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c275d6a-c99d-4f0a-87ff-0aae03943814 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:45.588031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-5c275d6a-c99d-4f0a-87ff-0aae03943814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:45.630712 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:45.647163 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c275d6a-c99d-4f0a-87ff-0aae03943814 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:45.650780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ef0c0-e58e-459d-8c9a-6d74558dc2bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:45.651412 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ef0c0-e58e-459d-8c9a-6d74558dc2bb service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:45.651716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ef0c0-e58e-459d-8c9a-6d74558dc2bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:45.651987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ef0c0-e58e-459d-8c9a-6d74558dc2bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:45.661480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ef0c0-e58e-459d-8c9a-6d74558dc2bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:45.662892 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ef0c0-e58e-459d-8c9a-6d74558dc2bb service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:45.673081 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1210/2412] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:59:45.935042 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac0862-4cb9-4b2a-8a00-c1b2a8d95b0a None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:45.936460 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-47ac0862-4cb9-4b2a-8a00-c1b2a8d95b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:45.948843 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac0862-4cb9-4b2a-8a00-c1b2a8d95b0a None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:45.953838 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d17ee9-c9ae-4af6-844d-a7b6a900564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:45.954704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d17ee9-c9ae-4af6-844d-a7b6a900564f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:45.954989 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d17ee9-c9ae-4af6-844d-a7b6a900564f admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:45.955423 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d17ee9-c9ae-4af6-844d-a7b6a900564f admin admin] PATH_INFO: `/v3/projects/46067338b6384824b09a5ad856024af9` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:45.956448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d17ee9-c9ae-4af6-844d-a7b6a900564f admin admin] RBAC: Authorizing `identity:delete_project(project_id=46067338b6384824b09a5ad856024af9)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:45.958411 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d17ee9-c9ae-4af6-844d-a7b6a900564f admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:46.004924 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-57d17ee9-c9ae-4af6-844d-a7b6a900564f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46067338b6384824b09a5ad856024af9', 'request_id': 'req-57d17ee9-c9ae-4af6-844d-a7b6a900564f'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:46.010970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-57d17ee9-c9ae-4af6-844d-a7b6a900564f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46067338b6384824b09a5ad856024af9', 'request_id': 'req-57d17ee9-c9ae-4af6-844d-a7b6a900564f'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:46.016339 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-57d17ee9-c9ae-4af6-844d-a7b6a900564f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46067338b6384824b09a5ad856024af9', 'request_id': 'req-57d17ee9-c9ae-4af6-844d-a7b6a900564f'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:46.029405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-57d17ee9-c9ae-4af6-844d-a7b6a900564f admin admin] The token cache is being invalidate because project 46067338b6384824b09a5ad856024af9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:59:46.029719 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-57d17ee9-c9ae-4af6-844d-a7b6a900564f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:46.030354 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-57d17ee9-c9ae-4af6-844d-a7b6a900564f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:46.031861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1203/2413] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:59:45 2022] DELETE /identity/v3/projects/46067338b6384824b09a5ad856024af9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:46.036335 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ef0c0-e58e-459d-8c9a-6d74558dc2bb service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:46.045790 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ef0c0-e58e-459d-8c9a-6d74558dc2bb service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:46.102697 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f043ff9-54f3-4524-b723-de2e8a1f4769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:46.103564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f043ff9-54f3-4524-b723-de2e8a1f4769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:46.103842 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f043ff9-54f3-4524-b723-de2e8a1f4769 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:46.104115 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f043ff9-54f3-4524-b723-de2e8a1f4769 admin admin] PATH_INFO: `/v3/users/f16f2d58b5d24feca0f43926e6cc9901` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:46.105318 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f043ff9-54f3-4524-b723-de2e8a1f4769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f16f2d58b5d24feca0f43926e6cc9901)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:46.107263 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f043ff9-54f3-4524-b723-de2e8a1f4769 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:46.151654 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-9f043ff9-54f3-4524-b723-de2e8a1f4769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f16f2d58b5d24feca0f43926e6cc9901'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:46.152222 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-9f043ff9-54f3-4524-b723-de2e8a1f4769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f16f2d58b5d24feca0f43926e6cc9901'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:46.152820 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-9f043ff9-54f3-4524-b723-de2e8a1f4769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f16f2d58b5d24feca0f43926e6cc9901'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:46.160320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-9f043ff9-54f3-4524-b723-de2e8a1f4769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f16f2d58b5d24feca0f43926e6cc9901'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:46.168366 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-9f043ff9-54f3-4524-b723-de2e8a1f4769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f16f2d58b5d24feca0f43926e6cc9901'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:46.185733 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1211/2414] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:59:46 2022] DELETE /identity/v3/users/f16f2d58b5d24feca0f43926e6cc9901 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:46.470558 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d17ee9-c9ae-4af6-844d-a7b6a900564f admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:46.472153 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-57d17ee9-c9ae-4af6-844d-a7b6a900564f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:46.485908 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d17ee9-c9ae-4af6-844d-a7b6a900564f admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:46.550327 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:46.559834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a48cc-a902-4f7c-a16b-db0cc4f70dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:46.561060 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a48cc-a902-4f7c-a16b-db0cc4f70dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:46.561504 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a48cc-a902-4f7c-a16b-db0cc4f70dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:46.562686 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a48cc-a902-4f7c-a16b-db0cc4f70dfd admin admin] PATH_INFO: `/v3/projects/7f66293c4162443893f3e98e62a946b3` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:46.563570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a48cc-a902-4f7c-a16b-db0cc4f70dfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f66293c4162443893f3e98e62a946b3)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:46.566180 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a48cc-a902-4f7c-a16b-db0cc4f70dfd admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:46.616079 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ac3a48cc-a902-4f7c-a16b-db0cc4f70dfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f66293c4162443893f3e98e62a946b3', 'request_id': 'req-ac3a48cc-a902-4f7c-a16b-db0cc4f70dfd'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:46.622716 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ac3a48cc-a902-4f7c-a16b-db0cc4f70dfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f66293c4162443893f3e98e62a946b3', 'request_id': 'req-ac3a48cc-a902-4f7c-a16b-db0cc4f70dfd'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:46.629581 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ac3a48cc-a902-4f7c-a16b-db0cc4f70dfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f66293c4162443893f3e98e62a946b3', 'request_id': 'req-ac3a48cc-a902-4f7c-a16b-db0cc4f70dfd'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:46.641681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ac3a48cc-a902-4f7c-a16b-db0cc4f70dfd admin admin] The token cache is being invalidate because project 7f66293c4162443893f3e98e62a946b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:59:46.642541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ac3a48cc-a902-4f7c-a16b-db0cc4f70dfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:46.643155 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ac3a48cc-a902-4f7c-a16b-db0cc4f70dfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:46.644715 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1204/2415] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:59:46 2022] DELETE /identity/v3/projects/7f66293c4162443893f3e98e62a946b3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:46.649796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91918adf-477b-40af-929b-543620a4219b None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:46.650298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91918adf-477b-40af-929b-543620a4219b None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:46.650407 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91918adf-477b-40af-929b-543620a4219b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:46.667936 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-91918adf-477b-40af-929b-543620a4219b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:46.669087 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-91918adf-477b-40af-929b-543620a4219b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:46.721836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:46.731587 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1212/2416] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:46.739318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed72ed9-e83b-455e-9b72-19e4554fb161 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:46.739627 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed72ed9-e83b-455e-9b72-19e4554fb161 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:46.739895 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed72ed9-e83b-455e-9b72-19e4554fb161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:46.758497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-bed72ed9-e83b-455e-9b72-19e4554fb161 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:46.759701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-bed72ed9-e83b-455e-9b72-19e4554fb161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:46.768082 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1205/2417] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:46.772167 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91918adf-477b-40af-929b-543620a4219b None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:46.782397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91918adf-477b-40af-929b-543620a4219b None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:46.787563 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b662ad-bfed-409e-b1f5-8ba9293e140f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:46.788212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b662ad-bfed-409e-b1f5-8ba9293e140f admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:46.788497 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b662ad-bfed-409e-b1f5-8ba9293e140f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:46.788775 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b662ad-bfed-409e-b1f5-8ba9293e140f admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:46.789599 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b662ad-bfed-409e-b1f5-8ba9293e140f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:59:46.789908 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b662ad-bfed-409e-b1f5-8ba9293e140f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:46.791529 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b662ad-bfed-409e-b1f5-8ba9293e140f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:46.803484 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1213/2418] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:59:46.808029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed72ed9-e83b-455e-9b72-19e4554fb161 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:46.817974 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed72ed9-e83b-455e-9b72-19e4554fb161 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:46.822745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d480f92-d6f5-4320-a7b6-3bff5178e5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:46.823389 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d480f92-d6f5-4320-a7b6-3bff5178e5d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:46.823672 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d480f92-d6f5-4320-a7b6-3bff5178e5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:46.823944 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d480f92-d6f5-4320-a7b6-3bff5178e5d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:46.824652 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d480f92-d6f5-4320-a7b6-3bff5178e5d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:46.826628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d480f92-d6f5-4320-a7b6-3bff5178e5d6 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:46.851551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1206/2419] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:59:46 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:59:46.855723 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b662ad-bfed-409e-b1f5-8ba9293e140f admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:46.866209 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b662ad-bfed-409e-b1f5-8ba9293e140f admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:46.921967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c701c8-3631-4d06-bbb3-da7fe91a49c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:46.922656 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c701c8-3631-4d06-bbb3-da7fe91a49c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:46.923500 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c701c8-3631-4d06-bbb3-da7fe91a49c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:46.923852 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c701c8-3631-4d06-bbb3-da7fe91a49c6 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:46.924613 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c701c8-3631-4d06-bbb3-da7fe91a49c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:46.926578 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c701c8-3631-4d06-bbb3-da7fe91a49c6 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:46.950564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1214/2420] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:59:46 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:59:46.951841 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d480f92-d6f5-4320-a7b6-3bff5178e5d6 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:46.962268 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d480f92-d6f5-4320-a7b6-3bff5178e5d6 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:46.966940 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd65e9-928d-4ca3-b654-7313cc495899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:46.967593 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd65e9-928d-4ca3-b654-7313cc495899 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:46.967874 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd65e9-928d-4ca3-b654-7313cc495899 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:46.968147 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd65e9-928d-4ca3-b654-7313cc495899 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:46.968862 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd65e9-928d-4ca3-b654-7313cc495899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:46.970514 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd65e9-928d-4ca3-b654-7313cc495899 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:46.982348 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1207/2421] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:59:46.986914 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c701c8-3631-4d06-bbb3-da7fe91a49c6 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:46.997015 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c701c8-3631-4d06-bbb3-da7fe91a49c6 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:47.002383 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4820a1-919d-430b-bf86-ecf6fba62a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:47.003124 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4820a1-919d-430b-bf86-ecf6fba62a0c admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:47.003500 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4820a1-919d-430b-bf86-ecf6fba62a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:47.003780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4820a1-919d-430b-bf86-ecf6fba62a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:47.004542 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4820a1-919d-430b-bf86-ecf6fba62a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:47.006209 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4820a1-919d-430b-bf86-ecf6fba62a0c admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:47.019484 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1215/2422] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:59:47.020706 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd65e9-928d-4ca3-b654-7313cc495899 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:47.030970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd65e9-928d-4ca3-b654-7313cc495899 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:47.035716 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f4548-0d0a-4146-a0dc-de3141f88dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:47.036593 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f4548-0d0a-4146-a0dc-de3141f88dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:47.036872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f4548-0d0a-4146-a0dc-de3141f88dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:47.037144 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f4548-0d0a-4146-a0dc-de3141f88dc8 admin admin] PATH_INFO: `/v3/projects/edcb93d8a4464ad1985a1dc996de0a79/users/917122d7b86b43078a8447d15ab6b30a/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:47.053179 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f4548-0d0a-4146-a0dc-de3141f88dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edcb93d8a4464ad1985a1dc996de0a79, user_id=917122d7b86b43078a8447d15ab6b30a, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:47.055843 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f4548-0d0a-4146-a0dc-de3141f88dc8 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:47.070942 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1208/2423] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:59:47 2022] PUT /identity/v3/projects/edcb93d8a4464ad1985a1dc996de0a79/users/917122d7b86b43078a8447d15ab6b30a/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:47.081848 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09a4ba-9f82-4483-b9ed-b7092b7d8249 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:47.082140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09a4ba-9f82-4483-b9ed-b7092b7d8249 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:47.082424 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09a4ba-9f82-4483-b9ed-b7092b7d8249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:47.108022 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-6c09a4ba-9f82-4483-b9ed-b7092b7d8249 None None] MFA Rules not processed for user `917122d7b86b43078a8447d15ab6b30a`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:47.109216 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-6c09a4ba-9f82-4483-b9ed-b7092b7d8249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:47.178118 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1216/2424] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:47.182431 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f4548-0d0a-4146-a0dc-de3141f88dc8 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:47.242214 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f4548-0d0a-4146-a0dc-de3141f88dc8 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:47.247094 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c54e12-f9d9-415d-b247-2004156f5bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:47.247766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c54e12-f9d9-415d-b247-2004156f5bde admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:47.248051 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c54e12-f9d9-415d-b247-2004156f5bde admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:47.248333 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c54e12-f9d9-415d-b247-2004156f5bde admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:47.249018 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c54e12-f9d9-415d-b247-2004156f5bde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:47.251140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c54e12-f9d9-415d-b247-2004156f5bde admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:47.275144 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1209/2425] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:59:47 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:59:47.279353 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09a4ba-9f82-4483-b9ed-b7092b7d8249 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:47.291402 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09a4ba-9f82-4483-b9ed-b7092b7d8249 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:47.342367 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:47.351300 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f9a37-f831-482c-818e-6197b305cf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:47.352013 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f9a37-f831-482c-818e-6197b305cf28 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:47.352296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f9a37-f831-482c-818e-6197b305cf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:47.352570 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f9a37-f831-482c-818e-6197b305cf28 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:47.353289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f9a37-f831-482c-818e-6197b305cf28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:47.355216 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f9a37-f831-482c-818e-6197b305cf28 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:47.379446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1217/2426] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:59:47 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:59:47.380704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c54e12-f9d9-415d-b247-2004156f5bde admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:47.391108 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c54e12-f9d9-415d-b247-2004156f5bde admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:47.395900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68df410-c235-4988-835e-f3e66f101ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:47.396559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68df410-c235-4988-835e-f3e66f101ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:47.396840 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68df410-c235-4988-835e-f3e66f101ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:47.397111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68df410-c235-4988-835e-f3e66f101ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:47.397862 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68df410-c235-4988-835e-f3e66f101ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:47.399521 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68df410-c235-4988-835e-f3e66f101ab4 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:47.400997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:47.419122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1210/2427] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:59:47.420532 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f9a37-f831-482c-818e-6197b305cf28 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:47.434255 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f9a37-f831-482c-818e-6197b305cf28 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:47.441459 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b82c8-9799-46a8-951a-2abc4c5494df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:47.442242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b82c8-9799-46a8-951a-2abc4c5494df admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:47.442488 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b82c8-9799-46a8-951a-2abc4c5494df admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:47.442765 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b82c8-9799-46a8-951a-2abc4c5494df admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:47.443493 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b82c8-9799-46a8-951a-2abc4c5494df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:47.445364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b82c8-9799-46a8-951a-2abc4c5494df admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:47.460795 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1218/2428] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:59:47.463020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68df410-c235-4988-835e-f3e66f101ab4 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:47.475885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68df410-c235-4988-835e-f3e66f101ab4 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:47.484303 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed70bae-284a-4ec2-aa7b-7a8e61d7e4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:47.486546 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed70bae-284a-4ec2-aa7b-7a8e61d7e4ea admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:47.486654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed70bae-284a-4ec2-aa7b-7a8e61d7e4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:47.487712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed70bae-284a-4ec2-aa7b-7a8e61d7e4ea admin admin] PATH_INFO: `/v3/projects/adf6e3431de647979d718109ddbadaa4/users/57d73acf4a3c4a368098d04b87aa169a/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:47.503088 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed70bae-284a-4ec2-aa7b-7a8e61d7e4ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf6e3431de647979d718109ddbadaa4, user_id=57d73acf4a3c4a368098d04b87aa169a, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:47.505981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed70bae-284a-4ec2-aa7b-7a8e61d7e4ea admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:47.522044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1211/2429] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:59:47 2022] PUT /identity/v3/projects/adf6e3431de647979d718109ddbadaa4/users/57d73acf4a3c4a368098d04b87aa169a/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:47.532443 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3074c2f-1785-4ff3-995c-240fa9ce9584 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:47.533256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3074c2f-1785-4ff3-995c-240fa9ce9584 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:47.533567 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3074c2f-1785-4ff3-995c-240fa9ce9584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:47.567111 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-d3074c2f-1785-4ff3-995c-240fa9ce9584 None None] MFA Rules not processed for user `57d73acf4a3c4a368098d04b87aa169a`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:47.569978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d3074c2f-1785-4ff3-995c-240fa9ce9584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:47.661158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1219/2430] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:47.669261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed70bae-284a-4ec2-aa7b-7a8e61d7e4ea admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:47.774409 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed70bae-284a-4ec2-aa7b-7a8e61d7e4ea admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:47.780643 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225347bb-fff2-4052-a3b4-ff54090fd8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:47.781375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225347bb-fff2-4052-a3b4-ff54090fd8c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:47.781666 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225347bb-fff2-4052-a3b4-ff54090fd8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:47.781953 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225347bb-fff2-4052-a3b4-ff54090fd8c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:47.782712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225347bb-fff2-4052-a3b4-ff54090fd8c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:47.784164 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d4d42-93e5-48cc-b81b-fa10f84c3f75 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:47.784531 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d4d42-93e5-48cc-b81b-fa10f84c3f75 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:47.784644 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225347bb-fff2-4052-a3b4-ff54090fd8c7 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:47.784957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d4d42-93e5-48cc-b81b-fa10f84c3f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:47.805888 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-5f0d4d42-93e5-48cc-b81b-fa10f84c3f75 None None] MFA Rules not processed for user `135410329e56486c8ccb65b1f2d87aca`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:47.807736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-5f0d4d42-93e5-48cc-b81b-fa10f84c3f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:47.818860 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1212/2431] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:59:47 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:59:47.825665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225347bb-fff2-4052-a3b4-ff54090fd8c7 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:47.874871 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1220/2432] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 13:59:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:47.905002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225347bb-fff2-4052-a3b4-ff54090fd8c7 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:47.910544 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9c313-8c01-4823-a48c-153ad0ec57c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:47.911360 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9c313-8c01-4823-a48c-153ad0ec57c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:47.911717 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9c313-8c01-4823-a48c-153ad0ec57c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:47.912191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9c313-8c01-4823-a48c-153ad0ec57c3 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:47.912859 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9c313-8c01-4823-a48c-153ad0ec57c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:47.914927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9c313-8c01-4823-a48c-153ad0ec57c3 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:47.928065 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d4d42-93e5-48cc-b81b-fa10f84c3f75 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:47.929762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-5f0d4d42-93e5-48cc-b81b-fa10f84c3f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:47.939171 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1213/2433] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:59:47 2022] POST /identity/v3/users => generated 296 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:59:47.943557 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9c313-8c01-4823-a48c-153ad0ec57c3 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:47.960207 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9c313-8c01-4823-a48c-153ad0ec57c3 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:47.967272 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed41ef-ae73-44b1-bdca-9662f745a408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:47.968077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed41ef-ae73-44b1-bdca-9662f745a408 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:47.968548 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed41ef-ae73-44b1-bdca-9662f745a408 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:47.968894 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed41ef-ae73-44b1-bdca-9662f745a408 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:47.970379 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed41ef-ae73-44b1-bdca-9662f745a408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:47.972115 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed41ef-ae73-44b1-bdca-9662f745a408 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:47.985319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1214/2434] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:59:47.989028 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed41ef-ae73-44b1-bdca-9662f745a408 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:48.001837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed41ef-ae73-44b1-bdca-9662f745a408 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:48.007131 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad644f-449d-469c-9986-2365cbb445a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:48.008043 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad644f-449d-469c-9986-2365cbb445a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:48.008320 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad644f-449d-469c-9986-2365cbb445a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:48.008673 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad644f-449d-469c-9986-2365cbb445a4 admin admin] PATH_INFO: `/v3/projects/0ae98e61364847bfae1bb82639816957/users/a75f8604b92b4edeaa3b488f7236d9f2/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:48.011686 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d4d42-93e5-48cc-b81b-fa10f84c3f75 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:48.025953 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad644f-449d-469c-9986-2365cbb445a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae98e61364847bfae1bb82639816957, user_id=a75f8604b92b4edeaa3b488f7236d9f2, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:48.028564 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:48.029553 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad644f-449d-469c-9986-2365cbb445a4 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:48.045850 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1215/2435] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:59:47 2022] PUT /identity/v3/projects/0ae98e61364847bfae1bb82639816957/users/a75f8604b92b4edeaa3b488f7236d9f2/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:59:48.050498 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad644f-449d-469c-9986-2365cbb445a4 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:48.064404 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:48.113856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2840e0-fba4-414d-b50a-df400b06e525 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e517dc43cc6d401e820c65ad4c941386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:48.115183 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2840e0-fba4-414d-b50a-df400b06e525 service swift] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:48.115484 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2840e0-fba4-414d-b50a-df400b06e525 service swift] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:48.115759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2840e0-fba4-414d-b50a-df400b06e525 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:48.130017 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad644f-449d-469c-9986-2365cbb445a4 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:48.135791 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a3d9c-2933-49e0-96da-7a27eec50a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:48.136608 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a3d9c-2933-49e0-96da-7a27eec50a13 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:48.136900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a3d9c-2933-49e0-96da-7a27eec50a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:48.137183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a3d9c-2933-49e0-96da-7a27eec50a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:48.137957 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a3d9c-2933-49e0-96da-7a27eec50a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:48.139765 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a3d9c-2933-49e0-96da-7a27eec50a13 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:48.151520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1216/2436] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:59:48.155675 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a3d9c-2933-49e0-96da-7a27eec50a13 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:48.168387 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a3d9c-2933-49e0-96da-7a27eec50a13 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:48.174650 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84032ce9-f97a-4a63-8085-66d71fe89bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:48.175545 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84032ce9-f97a-4a63-8085-66d71fe89bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:48.175888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84032ce9-f97a-4a63-8085-66d71fe89bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:48.176214 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84032ce9-f97a-4a63-8085-66d71fe89bfd admin admin] PATH_INFO: `/v3/projects/0ae98e61364847bfae1bb82639816957/users/a75f8604b92b4edeaa3b488f7236d9f2/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:48.178412 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84032ce9-f97a-4a63-8085-66d71fe89bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae98e61364847bfae1bb82639816957, user_id=a75f8604b92b4edeaa3b488f7236d9f2, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:48.181340 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84032ce9-f97a-4a63-8085-66d71fe89bfd admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:48.192271 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2840e0-fba4-414d-b50a-df400b06e525 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:48.194520 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2840e0-fba4-414d-b50a-df400b06e525 service swift] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:48.195547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1217/2437] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:59:48 2022] PUT /identity/v3/projects/0ae98e61364847bfae1bb82639816957/users/a75f8604b92b4edeaa3b488f7236d9f2/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:59:48.204813 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1221/2438] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 13:59:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 13:59:48.207072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e38138-8dcc-461a-9acc-dc34dfac2608 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:48.207368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e38138-8dcc-461a-9acc-dc34dfac2608 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:48.207642 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e38138-8dcc-461a-9acc-dc34dfac2608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:48.254930 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-86e38138-8dcc-461a-9acc-dc34dfac2608 None None] MFA Rules not processed for user `a75f8604b92b4edeaa3b488f7236d9f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:48.258051 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-86e38138-8dcc-461a-9acc-dc34dfac2608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:48.351464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1218/2439] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:48.360546 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2840e0-fba4-414d-b50a-df400b06e525 service swift] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:48.362037 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-4f2840e0-fba4-414d-b50a-df400b06e525 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:48.427958 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2840e0-fba4-414d-b50a-df400b06e525 service swift] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:48.497673 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103f6db-98ac-4801-9c87-0d7e994dfa95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:48.498398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103f6db-98ac-4801-9c87-0d7e994dfa95 service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:48.498755 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103f6db-98ac-4801-9c87-0d7e994dfa95 service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:48.499108 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103f6db-98ac-4801-9c87-0d7e994dfa95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:48.512134 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103f6db-98ac-4801-9c87-0d7e994dfa95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:48.513749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103f6db-98ac-4801-9c87-0d7e994dfa95 service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:48.526530 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1222/2440] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:59:48.577640 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e38138-8dcc-461a-9acc-dc34dfac2608 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:48.579146 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-86e38138-8dcc-461a-9acc-dc34dfac2608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:48.592407 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e38138-8dcc-461a-9acc-dc34dfac2608 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:48.597566 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c6fba-87b8-443e-a458-f3e44af693df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:48.598236 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c6fba-87b8-443e-a458-f3e44af693df service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:48.598521 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c6fba-87b8-443e-a458-f3e44af693df service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:48.598799 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c6fba-87b8-443e-a458-f3e44af693df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:48.692826 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c6fba-87b8-443e-a458-f3e44af693df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:48.694599 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c6fba-87b8-443e-a458-f3e44af693df service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:48.705900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1219/2441] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:59:51.909959 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103f6db-98ac-4801-9c87-0d7e994dfa95 service cinder] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:51.924830 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:51.984242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103f6db-98ac-4801-9c87-0d7e994dfa95 service cinder] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:51.989518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb58cfe-715b-4100-ad23-690fb511ceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:51.990674 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb58cfe-715b-4100-ad23-690fb511ceb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:51.990967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb58cfe-715b-4100-ad23-690fb511ceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:51.991245 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb58cfe-715b-4100-ad23-690fb511ceb7 admin admin] PATH_INFO: `/v3/users/917122d7b86b43078a8447d15ab6b30a` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:51.992483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb58cfe-715b-4100-ad23-690fb511ceb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=917122d7b86b43078a8447d15ab6b30a)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:51.995510 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb58cfe-715b-4100-ad23-690fb511ceb7 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:52.069872 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-fbb58cfe-715b-4100-ad23-690fb511ceb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '917122d7b86b43078a8447d15ab6b30a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:52.070648 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-fbb58cfe-715b-4100-ad23-690fb511ceb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '917122d7b86b43078a8447d15ab6b30a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:52.071340 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-fbb58cfe-715b-4100-ad23-690fb511ceb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '917122d7b86b43078a8447d15ab6b30a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:52.086173 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-fbb58cfe-715b-4100-ad23-690fb511ceb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '917122d7b86b43078a8447d15ab6b30a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:52.110175 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-fbb58cfe-715b-4100-ad23-690fb511ceb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '917122d7b86b43078a8447d15ab6b30a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:52.138824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1223/2442] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:59:51 2022] DELETE /identity/v3/users/917122d7b86b43078a8447d15ab6b30a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:52.143464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86249da6-b5a3-472b-bf17-3532d8053e3d None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:52.143970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86249da6-b5a3-472b-bf17-3532d8053e3d None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:52.144059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86249da6-b5a3-472b-bf17-3532d8053e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:52.199252 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-86249da6-b5a3-472b-bf17-3532d8053e3d None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:52.200584 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-86249da6-b5a3-472b-bf17-3532d8053e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:52.219010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:52.311893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1220/2443] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:52.322955 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb58cfe-715b-4100-ad23-690fb511ceb7 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:52.324884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-fbb58cfe-715b-4100-ad23-690fb511ceb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:52.395500 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb58cfe-715b-4100-ad23-690fb511ceb7 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:52.400999 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b43559-991a-48c8-ba08-71f4fd84ee04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:52.401706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b43559-991a-48c8-ba08-71f4fd84ee04 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:52.401986 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b43559-991a-48c8-ba08-71f4fd84ee04 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:52.402272 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b43559-991a-48c8-ba08-71f4fd84ee04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:52.416784 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b43559-991a-48c8-ba08-71f4fd84ee04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:52.418910 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b43559-991a-48c8-ba08-71f4fd84ee04 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:52.431240 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1224/2444] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:59:52.777310 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86249da6-b5a3-472b-bf17-3532d8053e3d None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:52.779228 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-86249da6-b5a3-472b-bf17-3532d8053e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:52.791977 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86249da6-b5a3-472b-bf17-3532d8053e3d None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:52.801439 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ba64e-c9ed-4b2f-ae03-62b885f6407a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:52.802422 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ba64e-c9ed-4b2f-ae03-62b885f6407a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:52.802807 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ba64e-c9ed-4b2f-ae03-62b885f6407a admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:52.803182 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ba64e-c9ed-4b2f-ae03-62b885f6407a admin admin] PATH_INFO: `/v3/projects/edcb93d8a4464ad1985a1dc996de0a79` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:52.805465 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ba64e-c9ed-4b2f-ae03-62b885f6407a admin admin] RBAC: Authorizing `identity:delete_project(project_id=edcb93d8a4464ad1985a1dc996de0a79)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:52.807886 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ba64e-c9ed-4b2f-ae03-62b885f6407a admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:52.864005 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5f6ba64e-c9ed-4b2f-ae03-62b885f6407a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edcb93d8a4464ad1985a1dc996de0a79', 'request_id': 'req-5f6ba64e-c9ed-4b2f-ae03-62b885f6407a'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:52.870986 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5f6ba64e-c9ed-4b2f-ae03-62b885f6407a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edcb93d8a4464ad1985a1dc996de0a79', 'request_id': 'req-5f6ba64e-c9ed-4b2f-ae03-62b885f6407a'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:52.878404 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5f6ba64e-c9ed-4b2f-ae03-62b885f6407a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edcb93d8a4464ad1985a1dc996de0a79', 'request_id': 'req-5f6ba64e-c9ed-4b2f-ae03-62b885f6407a'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:52.896874 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5f6ba64e-c9ed-4b2f-ae03-62b885f6407a admin admin] The token cache is being invalidate because project edcb93d8a4464ad1985a1dc996de0a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:59:52.897258 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5f6ba64e-c9ed-4b2f-ae03-62b885f6407a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:52.898130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-5f6ba64e-c9ed-4b2f-ae03-62b885f6407a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:52.899768 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1221/2445] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:59:52 2022] DELETE /identity/v3/projects/edcb93d8a4464ad1985a1dc996de0a79 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:52.904187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b43559-991a-48c8-ba08-71f4fd84ee04 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:52.915491 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b43559-991a-48c8-ba08-71f4fd84ee04 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:52.976151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:53.008426 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb6a4b-4fa8-45b4-b871-ec7a73de4e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:53.009339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb6a4b-4fa8-45b4-b871-ec7a73de4e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:53.009632 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb6a4b-4fa8-45b4-b871-ec7a73de4e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:53.009920 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb6a4b-4fa8-45b4-b871-ec7a73de4e3b admin admin] PATH_INFO: `/v3/users/57d73acf4a3c4a368098d04b87aa169a` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:53.011251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb6a4b-4fa8-45b4-b871-ec7a73de4e3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=57d73acf4a3c4a368098d04b87aa169a)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:53.013184 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb6a4b-4fa8-45b4-b871-ec7a73de4e3b admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:53.066612 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-98fb6a4b-4fa8-45b4-b871-ec7a73de4e3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57d73acf4a3c4a368098d04b87aa169a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:53.067411 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-98fb6a4b-4fa8-45b4-b871-ec7a73de4e3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57d73acf4a3c4a368098d04b87aa169a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:53.068012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-98fb6a4b-4fa8-45b4-b871-ec7a73de4e3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57d73acf4a3c4a368098d04b87aa169a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:53.077150 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-98fb6a4b-4fa8-45b4-b871-ec7a73de4e3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57d73acf4a3c4a368098d04b87aa169a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:53.092429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-98fb6a4b-4fa8-45b4-b871-ec7a73de4e3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57d73acf4a3c4a368098d04b87aa169a'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:53.119246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1225/2446] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:59:52 2022] DELETE /identity/v3/users/57d73acf4a3c4a368098d04b87aa169a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:53.535305 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ba64e-c9ed-4b2f-ae03-62b885f6407a admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:53.536819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-5f6ba64e-c9ed-4b2f-ae03-62b885f6407a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:53.551350 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ba64e-c9ed-4b2f-ae03-62b885f6407a admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:53.619600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede2935-eb1a-4593-9096-be37eb5c88d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:53.620686 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede2935-eb1a-4593-9096-be37eb5c88d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:53.621074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede2935-eb1a-4593-9096-be37eb5c88d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:53.621483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede2935-eb1a-4593-9096-be37eb5c88d5 admin admin] PATH_INFO: `/v3/projects/adf6e3431de647979d718109ddbadaa4` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:53.622779 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede2935-eb1a-4593-9096-be37eb5c88d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf6e3431de647979d718109ddbadaa4)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:53.624879 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede2935-eb1a-4593-9096-be37eb5c88d5 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:53.696609 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:53.701592 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-cede2935-eb1a-4593-9096-be37eb5c88d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf6e3431de647979d718109ddbadaa4', 'request_id': 'req-cede2935-eb1a-4593-9096-be37eb5c88d5'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:53.713156 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-cede2935-eb1a-4593-9096-be37eb5c88d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf6e3431de647979d718109ddbadaa4', 'request_id': 'req-cede2935-eb1a-4593-9096-be37eb5c88d5'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:53.720118 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-cede2935-eb1a-4593-9096-be37eb5c88d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf6e3431de647979d718109ddbadaa4', 'request_id': 'req-cede2935-eb1a-4593-9096-be37eb5c88d5'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:53.742609 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-cede2935-eb1a-4593-9096-be37eb5c88d5 admin admin] The token cache is being invalidate because project adf6e3431de647979d718109ddbadaa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:59:53.743411 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-cede2935-eb1a-4593-9096-be37eb5c88d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:53.744153 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-cede2935-eb1a-4593-9096-be37eb5c88d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:53.746200 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1222/2447] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:59:53 2022] DELETE /identity/v3/projects/adf6e3431de647979d718109ddbadaa4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:53.750256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb6a4b-4fa8-45b4-b871-ec7a73de4e3b admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:53.752914 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-98fb6a4b-4fa8-45b4-b871-ec7a73de4e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:53.770127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb6a4b-4fa8-45b4-b871-ec7a73de4e3b admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:53.859345 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dd0a1-0aab-4622-9497-35a42c7acf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:53.860865 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dd0a1-0aab-4622-9497-35a42c7acf28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:53.861172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dd0a1-0aab-4622-9497-35a42c7acf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:53.861543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dd0a1-0aab-4622-9497-35a42c7acf28 admin admin] PATH_INFO: `/v3/users/a75f8604b92b4edeaa3b488f7236d9f2` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:53.863086 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975dd0a1-0aab-4622-9497-35a42c7acf28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a75f8604b92b4edeaa3b488f7236d9f2)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:53.865239 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975dd0a1-0aab-4622-9497-35a42c7acf28 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:53.925502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-975dd0a1-0aab-4622-9497-35a42c7acf28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a75f8604b92b4edeaa3b488f7236d9f2'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:53.926667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-975dd0a1-0aab-4622-9497-35a42c7acf28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a75f8604b92b4edeaa3b488f7236d9f2'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:53.927342 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-975dd0a1-0aab-4622-9497-35a42c7acf28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a75f8604b92b4edeaa3b488f7236d9f2'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:53.933766 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:53.940938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-975dd0a1-0aab-4622-9497-35a42c7acf28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a75f8604b92b4edeaa3b488f7236d9f2'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:53.949491 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-975dd0a1-0aab-4622-9497-35a42c7acf28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a75f8604b92b4edeaa3b488f7236d9f2'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:53.972265 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1226/2448] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 13:59:53 2022] DELETE /identity/v3/users/a75f8604b92b4edeaa3b488f7236d9f2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:59:54.272732 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede2935-eb1a-4593-9096-be37eb5c88d5 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:54.274471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-cede2935-eb1a-4593-9096-be37eb5c88d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:54.304596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede2935-eb1a-4593-9096-be37eb5c88d5 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:54.413478 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c686f44-1e01-4f98-8266-d86aad7aef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:54.414459 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c686f44-1e01-4f98-8266-d86aad7aef39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:54.414821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c686f44-1e01-4f98-8266-d86aad7aef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:54.415175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c686f44-1e01-4f98-8266-d86aad7aef39 admin admin] PATH_INFO: `/v3/projects/0ae98e61364847bfae1bb82639816957` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:54.417297 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c686f44-1e01-4f98-8266-d86aad7aef39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ae98e61364847bfae1bb82639816957)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:54.419373 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c686f44-1e01-4f98-8266-d86aad7aef39 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:54.498287 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7c686f44-1e01-4f98-8266-d86aad7aef39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ae98e61364847bfae1bb82639816957', 'request_id': 'req-7c686f44-1e01-4f98-8266-d86aad7aef39'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:54.507670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7c686f44-1e01-4f98-8266-d86aad7aef39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ae98e61364847bfae1bb82639816957', 'request_id': 'req-7c686f44-1e01-4f98-8266-d86aad7aef39'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:54.520897 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7c686f44-1e01-4f98-8266-d86aad7aef39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ae98e61364847bfae1bb82639816957', 'request_id': 'req-7c686f44-1e01-4f98-8266-d86aad7aef39'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:54.559695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7c686f44-1e01-4f98-8266-d86aad7aef39 admin admin] The token cache is being invalidate because project 0ae98e61364847bfae1bb82639816957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:59:54.560258 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7c686f44-1e01-4f98-8266-d86aad7aef39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:54.561229 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7c686f44-1e01-4f98-8266-d86aad7aef39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:59:54.569821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1223/2449] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 13:59:54 2022] DELETE /identity/v3/projects/0ae98e61364847bfae1bb82639816957 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:54.576012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d07ae6-68a1-45f2-879b-59bb8b373676 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:54.576311 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d07ae6-68a1-45f2-879b-59bb8b373676 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:54.576591 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d07ae6-68a1-45f2-879b-59bb8b373676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:54.606238 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-58d07ae6-68a1-45f2-879b-59bb8b373676 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:54.609649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-58d07ae6-68a1-45f2-879b-59bb8b373676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:54.702274 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1227/2450] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:59:54.705984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e1f10-5ae3-42c6-8f14-1b6215dbf06b None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:54.706274 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e1f10-5ae3-42c6-8f14-1b6215dbf06b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:54.706554 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e1f10-5ae3-42c6-8f14-1b6215dbf06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:54.725991 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-5e2e1f10-5ae3-42c6-8f14-1b6215dbf06b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:54.727226 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-5e2e1f10-5ae3-42c6-8f14-1b6215dbf06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:54.737022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1224/2451] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:54.742321 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d07ae6-68a1-45f2-879b-59bb8b373676 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:54.754653 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d07ae6-68a1-45f2-879b-59bb8b373676 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:54.759344 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b396c-bc2b-4a8e-8228-b5d664f71eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:54.760069 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b396c-bc2b-4a8e-8228-b5d664f71eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:54.760358 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b396c-bc2b-4a8e-8228-b5d664f71eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:54.760634 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b396c-bc2b-4a8e-8228-b5d664f71eb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:54.761476 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b396c-bc2b-4a8e-8228-b5d664f71eb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:59:54.761784 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b396c-bc2b-4a8e-8228-b5d664f71eb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:54.763384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b396c-bc2b-4a8e-8228-b5d664f71eb3 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:54.784106 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1228/2452] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 13:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:59:54.784890 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e1f10-5ae3-42c6-8f14-1b6215dbf06b None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:54.801431 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e1f10-5ae3-42c6-8f14-1b6215dbf06b None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:54.806467 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11250569-2905-45ad-aa56-d0f32c91fe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:54.807273 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11250569-2905-45ad-aa56-d0f32c91fe15 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:54.807640 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11250569-2905-45ad-aa56-d0f32c91fe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:54.807993 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11250569-2905-45ad-aa56-d0f32c91fe15 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:54.808761 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11250569-2905-45ad-aa56-d0f32c91fe15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:54.811364 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11250569-2905-45ad-aa56-d0f32c91fe15 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:54.852987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b396c-bc2b-4a8e-8228-b5d664f71eb3 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:54.859868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1225/2453] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:59:54 2022] POST /identity/v3/projects => generated 365 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:59:54.863882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b396c-bc2b-4a8e-8228-b5d664f71eb3 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:54.949928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f210c4-45c4-464a-add5-bb7c1223a6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:54.950738 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f210c4-45c4-464a-add5-bb7c1223a6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:54.951094 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f210c4-45c4-464a-add5-bb7c1223a6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:54.951430 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f210c4-45c4-464a-add5-bb7c1223a6d8 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:54.952196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f210c4-45c4-464a-add5-bb7c1223a6d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:54.955029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f210c4-45c4-464a-add5-bb7c1223a6d8 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:54.989445 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1229/2454] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:59:54 2022] POST /identity/v3/users => generated 283 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:59:54.993261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11250569-2905-45ad-aa56-d0f32c91fe15 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:55.010141 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11250569-2905-45ad-aa56-d0f32c91fe15 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:55.020649 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c5795-ddeb-4efc-acde-f5999cea3b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:55.023775 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c5795-ddeb-4efc-acde-f5999cea3b67 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:55.025600 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c5795-ddeb-4efc-acde-f5999cea3b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:55.025970 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c5795-ddeb-4efc-acde-f5999cea3b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:55.027236 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c5795-ddeb-4efc-acde-f5999cea3b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:55.031378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c5795-ddeb-4efc-acde-f5999cea3b67 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:55.046475 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1226/2455] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:59:55.050958 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f210c4-45c4-464a-add5-bb7c1223a6d8 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:55.063303 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f210c4-45c4-464a-add5-bb7c1223a6d8 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:55.072152 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea0e83-b5f3-4558-a2d8-9687f24fc87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:55.072817 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea0e83-b5f3-4558-a2d8-9687f24fc87e admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:55.073166 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea0e83-b5f3-4558-a2d8-9687f24fc87e admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:55.073749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea0e83-b5f3-4558-a2d8-9687f24fc87e admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:55.074481 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea0e83-b5f3-4558-a2d8-9687f24fc87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:55.076243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea0e83-b5f3-4558-a2d8-9687f24fc87e admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:55.101921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c5795-ddeb-4efc-acde-f5999cea3b67 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:55.102799 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1230/2456] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:59:55.119626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c5795-ddeb-4efc-acde-f5999cea3b67 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:55.126459 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ce06e-c9dd-4e75-b3d9-2b06313457db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:55.128184 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce06e-c9dd-4e75-b3d9-2b06313457db admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:55.128349 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce06e-c9dd-4e75-b3d9-2b06313457db admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:55.128686 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce06e-c9dd-4e75-b3d9-2b06313457db admin admin] PATH_INFO: `/v3/projects/6f637cf3b0e64682bd4b7e8fa73aa532/users/3c3f6ef37c484270893ffa4e7e3b0add/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:55.155002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ce06e-c9dd-4e75-b3d9-2b06313457db admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f637cf3b0e64682bd4b7e8fa73aa532, user_id=3c3f6ef37c484270893ffa4e7e3b0add, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:55.159335 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ce06e-c9dd-4e75-b3d9-2b06313457db admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:55.180774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:55.191627 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1227/2457] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:59:55 2022] PUT /identity/v3/projects/6f637cf3b0e64682bd4b7e8fa73aa532/users/3c3f6ef37c484270893ffa4e7e3b0add/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:59:55.203695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2adb8-d440-4b91-9085-56de5d726c24 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:55.204645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2adb8-d440-4b91-9085-56de5d726c24 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:55.205053 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2adb8-d440-4b91-9085-56de5d726c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:55.240937 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-e9c2adb8-d440-4b91-9085-56de5d726c24 None None] MFA Rules not processed for user `3c3f6ef37c484270893ffa4e7e3b0add`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:55.242280 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e9c2adb8-d440-4b91-9085-56de5d726c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:55.277143 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:55.333000 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1231/2458] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:55.334222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ce06e-c9dd-4e75-b3d9-2b06313457db admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:55.414589 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ce06e-c9dd-4e75-b3d9-2b06313457db admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:55.419975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e911b-e2d6-4000-89a8-5d7ccf882ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:55.420640 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e911b-e2d6-4000-89a8-5d7ccf882ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:55.420955 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e911b-e2d6-4000-89a8-5d7ccf882ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:55.421282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e911b-e2d6-4000-89a8-5d7ccf882ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:55.422020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e911b-e2d6-4000-89a8-5d7ccf882ff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:55.423992 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e911b-e2d6-4000-89a8-5d7ccf882ff4 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:55.456193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1228/2459] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 13:59:55 2022] POST /identity/v3/projects => generated 363 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:59:55.460572 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2adb8-d440-4b91-9085-56de5d726c24 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:55.472378 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2adb8-d440-4b91-9085-56de5d726c24 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:55.543911 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f6e81-5ee6-4723-80cc-a7773bdd6e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:55.549130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f6e81-5ee6-4723-80cc-a7773bdd6e75 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:55.549605 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f6e81-5ee6-4723-80cc-a7773bdd6e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:55.550274 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f6e81-5ee6-4723-80cc-a7773bdd6e75 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:55.553586 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f6e81-5ee6-4723-80cc-a7773bdd6e75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:55.555651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f6e81-5ee6-4723-80cc-a7773bdd6e75 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:55.593696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1232/2460] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 13:59:55 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:59:55.597839 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e911b-e2d6-4000-89a8-5d7ccf882ff4 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:55.610674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e911b-e2d6-4000-89a8-5d7ccf882ff4 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:55.616670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc39e37-9c77-4d92-bb83-1e52a073c044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:55.617627 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc39e37-9c77-4d92-bb83-1e52a073c044 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:55.618333 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc39e37-9c77-4d92-bb83-1e52a073c044 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:55.619879 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc39e37-9c77-4d92-bb83-1e52a073c044 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:55.620788 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc39e37-9c77-4d92-bb83-1e52a073c044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:55.623407 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc39e37-9c77-4d92-bb83-1e52a073c044 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:55.642150 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1229/2461] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:59:55.646741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f6e81-5ee6-4723-80cc-a7773bdd6e75 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:55.661088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f6e81-5ee6-4723-80cc-a7773bdd6e75 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:55.668061 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c0a93-06fa-4da6-92e6-7a759f69f51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:55.669088 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c0a93-06fa-4da6-92e6-7a759f69f51c admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:55.670787 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c0a93-06fa-4da6-92e6-7a759f69f51c admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:55.671188 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c0a93-06fa-4da6-92e6-7a759f69f51c admin admin] PATH_INFO: `/v3/projects/aec8f2b2feed47fba9753a63e728ee7a/users/f56bbb5e00ef40e499f6652c600a0617/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:55.707954 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c0a93-06fa-4da6-92e6-7a759f69f51c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec8f2b2feed47fba9753a63e728ee7a, user_id=f56bbb5e00ef40e499f6652c600a0617, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:55.711119 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c0a93-06fa-4da6-92e6-7a759f69f51c admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:55.730785 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1233/2462] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:59:55 2022] PUT /identity/v3/projects/aec8f2b2feed47fba9753a63e728ee7a/users/f56bbb5e00ef40e499f6652c600a0617/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:55.734837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc39e37-9c77-4d92-bb83-1e52a073c044 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:55.746769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc39e37-9c77-4d92-bb83-1e52a073c044 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:55.822377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc79d5-fb9c-4869-933d-b966eb0e548f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:55.823319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc79d5-fb9c-4869-933d-b966eb0e548f admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:55.823768 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc79d5-fb9c-4869-933d-b966eb0e548f admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:55.824042 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc79d5-fb9c-4869-933d-b966eb0e548f admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:55.824794 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc79d5-fb9c-4869-933d-b966eb0e548f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:55.826501 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc79d5-fb9c-4869-933d-b966eb0e548f admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:55.837666 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1230/2463] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 13:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:59:55.841756 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c0a93-06fa-4da6-92e6-7a759f69f51c admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:55.852407 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c0a93-06fa-4da6-92e6-7a759f69f51c admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:55.857531 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6429fb-a020-4276-9e60-d83425a2148b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:55.858426 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6429fb-a020-4276-9e60-d83425a2148b admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:55.858711 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6429fb-a020-4276-9e60-d83425a2148b admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:55.858988 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6429fb-a020-4276-9e60-d83425a2148b admin admin] PATH_INFO: `/v3/projects/aec8f2b2feed47fba9753a63e728ee7a/users/f56bbb5e00ef40e499f6652c600a0617/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:55.861701 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6429fb-a020-4276-9e60-d83425a2148b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec8f2b2feed47fba9753a63e728ee7a, user_id=f56bbb5e00ef40e499f6652c600a0617, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:55.864320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6429fb-a020-4276-9e60-d83425a2148b admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:55.880165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1234/2464] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 13:59:55 2022] PUT /identity/v3/projects/aec8f2b2feed47fba9753a63e728ee7a/users/f56bbb5e00ef40e499f6652c600a0617/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:59:55.891227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556ff85-a303-4df9-b27f-f2b8f078e61d None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:55.891554 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556ff85-a303-4df9-b27f-f2b8f078e61d None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:55.891832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556ff85-a303-4df9-b27f-f2b8f078e61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:55.921215 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-8556ff85-a303-4df9-b27f-f2b8f078e61d None None] MFA Rules not processed for user `f56bbb5e00ef40e499f6652c600a0617`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:59:55.923732 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-8556ff85-a303-4df9-b27f-f2b8f078e61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:55.990258 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:56.010488 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1231/2465] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 13:59:55 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:59:56.018527 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6429fb-a020-4276-9e60-d83425a2148b admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:56.021131 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-4a6429fb-a020-4276-9e60-d83425a2148b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:56.099359 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6429fb-a020-4276-9e60-d83425a2148b admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:56.105895 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d62c0c-3b0e-491e-a95b-5caee3085d18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:56.106818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d62c0c-3b0e-491e-a95b-5caee3085d18 service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:56.107642 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d62c0c-3b0e-491e-a95b-5caee3085d18 service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:56.108000 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d62c0c-3b0e-491e-a95b-5caee3085d18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:56.127508 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d62c0c-3b0e-491e-a95b-5caee3085d18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:56.129344 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d62c0c-3b0e-491e-a95b-5caee3085d18 service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:56.152358 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1235/2466] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:56 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:59:56.293383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556ff85-a303-4df9-b27f-f2b8f078e61d None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:59:56.294880 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-8556ff85-a303-4df9-b27f-f2b8f078e61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:59:56.307684 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556ff85-a303-4df9-b27f-f2b8f078e61d None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:59:56.311485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c4374-2167-4973-84cd-98e441488ebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:59:56.312153 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c4374-2167-4973-84cd-98e441488ebb service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:59:56.313202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c4374-2167-4973-84cd-98e441488ebb service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:59:56.313689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c4374-2167-4973-84cd-98e441488ebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:59:56.384211 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c4374-2167-4973-84cd-98e441488ebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:59:56.385891 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c4374-2167-4973-84cd-98e441488ebb service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:59:56.396550 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1232/2467] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 13:59:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:01.321798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d62c0c-3b0e-491e-a95b-5caee3085d18 service cinder] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:01.348073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:01.391011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d62c0c-3b0e-491e-a95b-5caee3085d18 service cinder] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:01.403737 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a581139-8b34-4df4-a50a-d78ba1a2a1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:01.404644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a581139-8b34-4df4-a50a-d78ba1a2a1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:01.405142 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a581139-8b34-4df4-a50a-d78ba1a2a1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:01.405465 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a581139-8b34-4df4-a50a-d78ba1a2a1dc admin admin] PATH_INFO: `/v3/users/3c3f6ef37c484270893ffa4e7e3b0add` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:01.407757 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a581139-8b34-4df4-a50a-d78ba1a2a1dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c3f6ef37c484270893ffa4e7e3b0add)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:01.414495 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a581139-8b34-4df4-a50a-d78ba1a2a1dc admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:01.449719 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c4374-2167-4973-84cd-98e441488ebb service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:01.451210 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-664c4374-2167-4973-84cd-98e441488ebb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:01.480764 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-7a581139-8b34-4df4-a50a-d78ba1a2a1dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c3f6ef37c484270893ffa4e7e3b0add'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:01.481598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-7a581139-8b34-4df4-a50a-d78ba1a2a1dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c3f6ef37c484270893ffa4e7e3b0add'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:01.482288 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-7a581139-8b34-4df4-a50a-d78ba1a2a1dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c3f6ef37c484270893ffa4e7e3b0add'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:01.491491 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-7a581139-8b34-4df4-a50a-d78ba1a2a1dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c3f6ef37c484270893ffa4e7e3b0add'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:01.504294 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-7a581139-8b34-4df4-a50a-d78ba1a2a1dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c3f6ef37c484270893ffa4e7e3b0add'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:01.530647 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1236/2468] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:01 2022] DELETE /identity/v3/users/3c3f6ef37c484270893ffa4e7e3b0add => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:01.537323 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774bcdd-4683-4e07-851e-d37d928436d0 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:01.538032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774bcdd-4683-4e07-851e-d37d928436d0 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:01.538808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774bcdd-4683-4e07-851e-d37d928436d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:01.564533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-e774bcdd-4683-4e07-851e-d37d928436d0 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:01.566681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e774bcdd-4683-4e07-851e-d37d928436d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:01.600825 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c4374-2167-4973-84cd-98e441488ebb service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:01.673326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1237/2469] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:01.681565 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774bcdd-4683-4e07-851e-d37d928436d0 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:01.683320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e774bcdd-4683-4e07-851e-d37d928436d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:01.717246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c3e35-02c0-4d5b-8924-53836d97747e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:01.718589 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c3e35-02c0-4d5b-8924-53836d97747e service nova] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:01.719760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c3e35-02c0-4d5b-8924-53836d97747e service nova] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:01.720216 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c3e35-02c0-4d5b-8924-53836d97747e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:01.723074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-d59c3e35-02c0-4d5b-8924-53836d97747e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:01.740823 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c3e35-02c0-4d5b-8924-53836d97747e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:01.742913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c3e35-02c0-4d5b-8924-53836d97747e service nova] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:01.770156 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1233/2470] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 14:00:01.774482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:01.796968 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774bcdd-4683-4e07-851e-d37d928436d0 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:01.803355 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702ff81-3038-4971-9a1a-37b4ce7abfad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:01.804191 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702ff81-3038-4971-9a1a-37b4ce7abfad service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:01.804360 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702ff81-3038-4971-9a1a-37b4ce7abfad service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:01.804855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702ff81-3038-4971-9a1a-37b4ce7abfad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:01.819390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702ff81-3038-4971-9a1a-37b4ce7abfad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:01.822444 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702ff81-3038-4971-9a1a-37b4ce7abfad service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:01.835413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1238/2471] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 14:00:02.127972 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c3e35-02c0-4d5b-8924-53836d97747e service nova] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:02.129516 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-d59c3e35-02c0-4d5b-8924-53836d97747e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:02.147693 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c3e35-02c0-4d5b-8924-53836d97747e service nova] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:02.153417 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df544c3-f19e-486b-9c3d-a482ea0b5767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:02.154290 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df544c3-f19e-486b-9c3d-a482ea0b5767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:02.154571 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df544c3-f19e-486b-9c3d-a482ea0b5767 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:02.154982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df544c3-f19e-486b-9c3d-a482ea0b5767 admin admin] PATH_INFO: `/v3/projects/6f637cf3b0e64682bd4b7e8fa73aa532` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:02.156133 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df544c3-f19e-486b-9c3d-a482ea0b5767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f637cf3b0e64682bd4b7e8fa73aa532)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:02.158670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df544c3-f19e-486b-9c3d-a482ea0b5767 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:02.170329 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:02.217220 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-8df544c3-f19e-486b-9c3d-a482ea0b5767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f637cf3b0e64682bd4b7e8fa73aa532', 'request_id': 'req-8df544c3-f19e-486b-9c3d-a482ea0b5767'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:02.224284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-8df544c3-f19e-486b-9c3d-a482ea0b5767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f637cf3b0e64682bd4b7e8fa73aa532', 'request_id': 'req-8df544c3-f19e-486b-9c3d-a482ea0b5767'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:02.230071 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-8df544c3-f19e-486b-9c3d-a482ea0b5767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f637cf3b0e64682bd4b7e8fa73aa532', 'request_id': 'req-8df544c3-f19e-486b-9c3d-a482ea0b5767'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:02.244421 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-8df544c3-f19e-486b-9c3d-a482ea0b5767 admin admin] The token cache is being invalidate because project 6f637cf3b0e64682bd4b7e8fa73aa532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:02.244710 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-8df544c3-f19e-486b-9c3d-a482ea0b5767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:02.245381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-8df544c3-f19e-486b-9c3d-a482ea0b5767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:02.246968 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1234/2472] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:02 2022] DELETE /identity/v3/projects/6f637cf3b0e64682bd4b7e8fa73aa532 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:02.251237 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702ff81-3038-4971-9a1a-37b4ce7abfad service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:02.261112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702ff81-3038-4971-9a1a-37b4ce7abfad service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:02.325348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f48b0f-122a-4a88-955c-d530f39e701e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:02.326233 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f48b0f-122a-4a88-955c-d530f39e701e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:02.326519 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f48b0f-122a-4a88-955c-d530f39e701e admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:02.326800 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f48b0f-122a-4a88-955c-d530f39e701e admin admin] PATH_INFO: `/v3/users/f56bbb5e00ef40e499f6652c600a0617` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:02.328069 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f48b0f-122a-4a88-955c-d530f39e701e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f56bbb5e00ef40e499f6652c600a0617)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:02.330205 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f48b0f-122a-4a88-955c-d530f39e701e admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:02.380677 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-10f48b0f-122a-4a88-955c-d530f39e701e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f56bbb5e00ef40e499f6652c600a0617'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:02.381338 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-10f48b0f-122a-4a88-955c-d530f39e701e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f56bbb5e00ef40e499f6652c600a0617'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:02.381929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-10f48b0f-122a-4a88-955c-d530f39e701e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f56bbb5e00ef40e499f6652c600a0617'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:02.388587 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-10f48b0f-122a-4a88-955c-d530f39e701e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f56bbb5e00ef40e499f6652c600a0617'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:02.395393 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-10f48b0f-122a-4a88-955c-d530f39e701e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f56bbb5e00ef40e499f6652c600a0617'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:02.413699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1239/2473] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:02 2022] DELETE /identity/v3/users/f56bbb5e00ef40e499f6652c600a0617 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:02.714652 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df544c3-f19e-486b-9c3d-a482ea0b5767 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:02.716085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-8df544c3-f19e-486b-9c3d-a482ea0b5767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:02.732126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df544c3-f19e-486b-9c3d-a482ea0b5767 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:02.790800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ec174-4198-41ae-910a-3b0b80ebee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:02.791660 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ec174-4198-41ae-910a-3b0b80ebee33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:02.791943 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ec174-4198-41ae-910a-3b0b80ebee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:02.792220 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ec174-4198-41ae-910a-3b0b80ebee33 admin admin] PATH_INFO: `/v3/projects/aec8f2b2feed47fba9753a63e728ee7a` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:02.793422 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ec174-4198-41ae-910a-3b0b80ebee33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aec8f2b2feed47fba9753a63e728ee7a)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:02.795334 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ec174-4198-41ae-910a-3b0b80ebee33 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:02.839707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-746ec174-4198-41ae-910a-3b0b80ebee33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aec8f2b2feed47fba9753a63e728ee7a', 'request_id': 'req-746ec174-4198-41ae-910a-3b0b80ebee33'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:02.846227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-746ec174-4198-41ae-910a-3b0b80ebee33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aec8f2b2feed47fba9753a63e728ee7a', 'request_id': 'req-746ec174-4198-41ae-910a-3b0b80ebee33'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:02.851807 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-746ec174-4198-41ae-910a-3b0b80ebee33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aec8f2b2feed47fba9753a63e728ee7a', 'request_id': 'req-746ec174-4198-41ae-910a-3b0b80ebee33'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:02.863629 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-746ec174-4198-41ae-910a-3b0b80ebee33 admin admin] The token cache is being invalidate because project aec8f2b2feed47fba9753a63e728ee7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:02.863915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-746ec174-4198-41ae-910a-3b0b80ebee33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:02.864532 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-746ec174-4198-41ae-910a-3b0b80ebee33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:02.866092 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1235/2474] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:02 2022] DELETE /identity/v3/projects/aec8f2b2feed47fba9753a63e728ee7a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:02.871307 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38c110-ac12-4e7c-9caa-5e96865d6461 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:02.871599 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38c110-ac12-4e7c-9caa-5e96865d6461 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:02.871882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38c110-ac12-4e7c-9caa-5e96865d6461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:02.892680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-5a38c110-ac12-4e7c-9caa-5e96865d6461 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:02.895023 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-5a38c110-ac12-4e7c-9caa-5e96865d6461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:02.975253 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1240/2475] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:02.983735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ed3e1-7a9c-405f-bb90-f898c2fe701b None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:02.984024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ed3e1-7a9c-405f-bb90-f898c2fe701b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:02.984296 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ed3e1-7a9c-405f-bb90-f898c2fe701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:03.017757 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-c35ed3e1-7a9c-405f-bb90-f898c2fe701b None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:03.019069 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c35ed3e1-7a9c-405f-bb90-f898c2fe701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:03.027507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1236/2476] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:03.031849 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38c110-ac12-4e7c-9caa-5e96865d6461 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:03.037887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:03.042011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38c110-ac12-4e7c-9caa-5e96865d6461 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:03.048740 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbdcf3-1ada-4fd3-8991-dfd3f062c5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:03.049436 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbdcf3-1ada-4fd3-8991-dfd3f062c5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:03.050081 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbdcf3-1ada-4fd3-8991-dfd3f062c5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:03.050721 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbdcf3-1ada-4fd3-8991-dfd3f062c5e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:03.051868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbdcf3-1ada-4fd3-8991-dfd3f062c5e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:00:03.052227 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbdcf3-1ada-4fd3-8991-dfd3f062c5e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:03.054576 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbdcf3-1ada-4fd3-8991-dfd3f062c5e2 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:03.067309 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1241/2477] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:00:03.071302 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ed3e1-7a9c-405f-bb90-f898c2fe701b None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:03.081124 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ed3e1-7a9c-405f-bb90-f898c2fe701b None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:03.086149 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad7de9-cf47-4564-aad1-16196ed7284e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:03.086805 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad7de9-cf47-4564-aad1-16196ed7284e admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:03.087087 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad7de9-cf47-4564-aad1-16196ed7284e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:03.087365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad7de9-cf47-4564-aad1-16196ed7284e admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:03.088052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad7de9-cf47-4564-aad1-16196ed7284e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:03.090003 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad7de9-cf47-4564-aad1-16196ed7284e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:03.110063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:03.117377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1237/2478] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:03 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:03.121810 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbdcf3-1ada-4fd3-8991-dfd3f062c5e2 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:03.132173 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbdcf3-1ada-4fd3-8991-dfd3f062c5e2 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:03.191431 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd122046-fd0c-4af9-b737-e4f81b9d165f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:03.192098 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd122046-fd0c-4af9-b737-e4f81b9d165f admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:03.192377 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd122046-fd0c-4af9-b737-e4f81b9d165f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:03.192653 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd122046-fd0c-4af9-b737-e4f81b9d165f admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:03.193402 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd122046-fd0c-4af9-b737-e4f81b9d165f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:03.195293 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd122046-fd0c-4af9-b737-e4f81b9d165f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:03.217102 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1242/2479] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:03 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:03.221173 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad7de9-cf47-4564-aad1-16196ed7284e admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:03.236019 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad7de9-cf47-4564-aad1-16196ed7284e admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:03.241070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2222d-1d14-417b-8721-0c1ef43e7055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:03.242087 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2222d-1d14-417b-8721-0c1ef43e7055 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:03.242435 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2222d-1d14-417b-8721-0c1ef43e7055 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:03.243043 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2222d-1d14-417b-8721-0c1ef43e7055 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:03.243845 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2222d-1d14-417b-8721-0c1ef43e7055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:03.245858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2222d-1d14-417b-8721-0c1ef43e7055 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:03.260686 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1238/2480] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:03.261976 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd122046-fd0c-4af9-b737-e4f81b9d165f admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:03.281673 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd122046-fd0c-4af9-b737-e4f81b9d165f admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:03.289605 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8299545-f859-44a9-9fab-aa1d06780bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:03.290606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8299545-f859-44a9-9fab-aa1d06780bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:03.290877 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8299545-f859-44a9-9fab-aa1d06780bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:03.291153 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8299545-f859-44a9-9fab-aa1d06780bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:03.291921 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8299545-f859-44a9-9fab-aa1d06780bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:03.293474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8299545-f859-44a9-9fab-aa1d06780bd6 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:03.305302 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1243/2481] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 14:00:03.309671 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2222d-1d14-417b-8721-0c1ef43e7055 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:03.323688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2222d-1d14-417b-8721-0c1ef43e7055 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:03.329308 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7362e97-5247-4cf5-9070-0d7a8a5d2ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:03.330420 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7362e97-5247-4cf5-9070-0d7a8a5d2ff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:03.330882 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7362e97-5247-4cf5-9070-0d7a8a5d2ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:03.331605 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7362e97-5247-4cf5-9070-0d7a8a5d2ff4 admin admin] PATH_INFO: `/v3/projects/275a28c90eed4af58373eb2367cd1b4b/users/54ac98c13bf3441dae28640a2c8f8a00/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:03.350149 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7362e97-5247-4cf5-9070-0d7a8a5d2ff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=275a28c90eed4af58373eb2367cd1b4b, user_id=54ac98c13bf3441dae28640a2c8f8a00, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:03.352953 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7362e97-5247-4cf5-9070-0d7a8a5d2ff4 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:03.366754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1239/2482] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:03 2022] PUT /identity/v3/projects/275a28c90eed4af58373eb2367cd1b4b/users/54ac98c13bf3441dae28640a2c8f8a00/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:03.372184 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfe966-734a-47a5-89c6-bbe7de0f79d8 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:03.372717 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfe966-734a-47a5-89c6-bbe7de0f79d8 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:03.372908 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfe966-734a-47a5-89c6-bbe7de0f79d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:03.391535 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-8acfe966-734a-47a5-89c6-bbe7de0f79d8 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:03.392820 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8acfe966-734a-47a5-89c6-bbe7de0f79d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:03.456073 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1244/2483] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:03.466724 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7362e97-5247-4cf5-9070-0d7a8a5d2ff4 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:03.469070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f7362e97-5247-4cf5-9070-0d7a8a5d2ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:03.529333 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7362e97-5247-4cf5-9070-0d7a8a5d2ff4 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:03.533102 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0e587-2ebb-4cbd-9d40-c47243c9fb8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:03.533807 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0e587-2ebb-4cbd-9d40-c47243c9fb8f service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:03.534091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0e587-2ebb-4cbd-9d40-c47243c9fb8f service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:03.534386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0e587-2ebb-4cbd-9d40-c47243c9fb8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:03.543604 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0e587-2ebb-4cbd-9d40-c47243c9fb8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:03.545015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0e587-2ebb-4cbd-9d40-c47243c9fb8f service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:03.555266 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1240/2484] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 14:00:04.074901 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a3d37-35f8-4eeb-857d-45605e5f3c1f None None] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:04.075189 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a3d37-35f8-4eeb-857d-45605e5f3c1f None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:04.075470 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a3d37-35f8-4eeb-857d-45605e5f3c1f None None] PATH_INFO: `/` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:04.077094 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1245/2485] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 14:00:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:00:04.087928 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019867a-bc2a-47f9-b1bf-a70fc576d65d None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:04.088519 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019867a-bc2a-47f9-b1bf-a70fc576d65d None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:04.092735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019867a-bc2a-47f9-b1bf-a70fc576d65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:04.137586 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-4019867a-bc2a-47f9-b1bf-a70fc576d65d None None] MFA Rules not processed for user `1994043a81bb454297c208839794a479`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:04.140173 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-4019867a-bc2a-47f9-b1bf-a70fc576d65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:04.230004 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1241/2486] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 14:00:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:04.242429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a3d37-35f8-4eeb-857d-45605e5f3c1f None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:04.245227 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0f0a3d37-35f8-4eeb-857d-45605e5f3c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:04.321660 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a3d37-35f8-4eeb-857d-45605e5f3c1f None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:04.329418 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e7b52-5efe-46b0-9510-7503df74b159 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3039ec7e613464c8a71f4440dfe8bc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:04.330442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e7b52-5efe-46b0-9510-7503df74b159 service glance] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:04.330913 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e7b52-5efe-46b0-9510-7503df74b159 service glance] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:04.331372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e7b52-5efe-46b0-9510-7503df74b159 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:04.345567 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e7b52-5efe-46b0-9510-7503df74b159 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:04.346993 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e7b52-5efe-46b0-9510-7503df74b159 service glance] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:04.359098 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1246/2487] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 14:00:04.463683 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd1682-6c91-4f84-b8a6-b53cb3f3be7b None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:04.463980 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd1682-6c91-4f84-b8a6-b53cb3f3be7b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:04.464274 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd1682-6c91-4f84-b8a6-b53cb3f3be7b None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:04.465928 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1242/2488] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 14:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:00:04.471427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62583c85-33bd-4833-ba74-e5d40bd69023 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:04.472243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62583c85-33bd-4833-ba74-e5d40bd69023 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:04.472525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62583c85-33bd-4833-ba74-e5d40bd69023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:04.485850 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fefb2-7ad4-4edd-ac47-68ab1a5e5cdd None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:04.486174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fefb2-7ad4-4edd-ac47-68ab1a5e5cdd None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:04.486620 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fefb2-7ad4-4edd-ac47-68ab1a5e5cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:04.497227 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-62583c85-33bd-4833-ba74-e5d40bd69023 None None] MFA Rules not processed for user `45105360300a4cae802fdbda91b9d5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:04.498804 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-62583c85-33bd-4833-ba74-e5d40bd69023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:04.519020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1247/2489] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 14:00:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:04.520223 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62583c85-33bd-4833-ba74-e5d40bd69023 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:04.522928 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-296fefb2-7ad4-4edd-ac47-68ab1a5e5cdd None None] MFA Rules not processed for user `54ac98c13bf3441dae28640a2c8f8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:04.525529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-296fefb2-7ad4-4edd-ac47-68ab1a5e5cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:04.529900 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62583c85-33bd-4833-ba74-e5d40bd69023 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:04.533785 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fc39a-44fe-47b0-8b06-4c8786fd0ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:04.534434 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fc39a-44fe-47b0-8b06-4c8786fd0ccb service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:04.534722 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fc39a-44fe-47b0-8b06-4c8786fd0ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:04.534999 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fc39a-44fe-47b0-8b06-4c8786fd0ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:04.539562 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:04.543788 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494fc39a-44fe-47b0-8b06-4c8786fd0ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:04.545649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494fc39a-44fe-47b0-8b06-4c8786fd0ccb service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:04.554910 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1248/2490] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:04.607388 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:04.632766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1243/2491] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:04.637600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fc39a-44fe-47b0-8b06-4c8786fd0ccb service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:04.648146 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0989e0-7a9e-4146-ab06-452396e0d682 None None] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:04.648432 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0989e0-7a9e-4146-ab06-452396e0d682 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:04.648732 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0989e0-7a9e-4146-ab06-452396e0d682 None None] PATH_INFO: `/` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:04.652312 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fc39a-44fe-47b0-8b06-4c8786fd0ccb service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:04.655423 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1244/2492] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 14:00:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:00:04.657026 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8712d-05ad-46de-8deb-dc877e28ae48 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:04.657334 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8712d-05ad-46de-8deb-dc877e28ae48 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:04.657611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8712d-05ad-46de-8deb-dc877e28ae48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:04.658290 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a9ac9-63fc-48d3-a34c-56d5c14e13e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:04.659066 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a9ac9-63fc-48d3-a34c-56d5c14e13e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:04.659481 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a9ac9-63fc-48d3-a34c-56d5c14e13e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:04.659867 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a9ac9-63fc-48d3-a34c-56d5c14e13e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:04.660673 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a9ac9-63fc-48d3-a34c-56d5c14e13e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:04.662861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a9ac9-63fc-48d3-a34c-56d5c14e13e5 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:04.683202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-40f8712d-05ad-46de-8deb-dc877e28ae48 None None] MFA Rules not processed for user `1994043a81bb454297c208839794a479`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:04.686444 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-40f8712d-05ad-46de-8deb-dc877e28ae48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:04.705180 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1249/2493] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:04 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:00:04.706982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1245/2494] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 14:00:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 14:00:04.707311 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a9ac9-63fc-48d3-a34c-56d5c14e13e5 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:04.720001 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8712d-05ad-46de-8deb-dc877e28ae48 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:04.740302 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8712d-05ad-46de-8deb-dc877e28ae48 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:04.806118 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a9ac9-63fc-48d3-a34c-56d5c14e13e5 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:04.812400 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aba24f-9591-41db-ba65-abcd01ae6899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:04.814863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aba24f-9591-41db-ba65-abcd01ae6899 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:04.815146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aba24f-9591-41db-ba65-abcd01ae6899 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:04.815424 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aba24f-9591-41db-ba65-abcd01ae6899 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:04.816130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aba24f-9591-41db-ba65-abcd01ae6899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:04.819245 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aba24f-9591-41db-ba65-abcd01ae6899 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:04.830168 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a7bcd-049d-47f2-bab6-199ce0e295f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:04.831313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a7bcd-049d-47f2-bab6-199ce0e295f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:04.832170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a7bcd-049d-47f2-bab6-199ce0e295f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:04.832459 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a7bcd-049d-47f2-bab6-199ce0e295f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:04.845598 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1250/2495] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:04 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:04.849868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aba24f-9591-41db-ba65-abcd01ae6899 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:04.864458 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aba24f-9591-41db-ba65-abcd01ae6899 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:04.886171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e88a7-1f33-41ea-84d6-973e99b0533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:04.887041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e88a7-1f33-41ea-84d6-973e99b0533f admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:04.887323 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e88a7-1f33-41ea-84d6-973e99b0533f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:04.887702 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e88a7-1f33-41ea-84d6-973e99b0533f admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:04.888834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e88a7-1f33-41ea-84d6-973e99b0533f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:04.891138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e88a7-1f33-41ea-84d6-973e99b0533f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:04.909401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1251/2496] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 14:00:04.910864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e88a7-1f33-41ea-84d6-973e99b0533f admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:04.925346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e88a7-1f33-41ea-84d6-973e99b0533f admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:04.932638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c98e8-263e-4930-aef9-7d6617bac4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:04.933817 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c98e8-263e-4930-aef9-7d6617bac4d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:04.934500 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c98e8-263e-4930-aef9-7d6617bac4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:04.934500 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c98e8-263e-4930-aef9-7d6617bac4d6 admin admin] PATH_INFO: `/v3/projects/56aef6889f594cd480d54ad537ce701a/users/65f5b6e6204a468fb24cc41535c62441/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:04.966695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c98e8-263e-4930-aef9-7d6617bac4d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56aef6889f594cd480d54ad537ce701a, user_id=65f5b6e6204a468fb24cc41535c62441, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:04.970391 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c98e8-263e-4930-aef9-7d6617bac4d6 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:04.983236 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a7bcd-049d-47f2-bab6-199ce0e295f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:04.987193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a7bcd-049d-47f2-bab6-199ce0e295f5 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:04.988406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1252/2497] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:04 2022] PUT /identity/v3/projects/56aef6889f594cd480d54ad537ce701a/users/65f5b6e6204a468fb24cc41535c62441/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:04.992295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c98e8-263e-4930-aef9-7d6617bac4d6 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:05.000851 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1246/2498] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 14:00:05.071540 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c98e8-263e-4930-aef9-7d6617bac4d6 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:05.076934 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d83fc-1d3c-4734-9b8a-83082d090655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:05.077632 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d83fc-1d3c-4734-9b8a-83082d090655 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:05.077975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d83fc-1d3c-4734-9b8a-83082d090655 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:05.078250 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d83fc-1d3c-4734-9b8a-83082d090655 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:05.078961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d83fc-1d3c-4734-9b8a-83082d090655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:05.080608 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d83fc-1d3c-4734-9b8a-83082d090655 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:05.091397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1253/2499] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:05.095559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a7bcd-049d-47f2-bab6-199ce0e295f5 service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:05.106637 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a7bcd-049d-47f2-bab6-199ce0e295f5 service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:05.112111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43825b-8cc4-4c00-abc5-8bdc7159c6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:05.112990 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43825b-8cc4-4c00-abc5-8bdc7159c6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:05.113291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43825b-8cc4-4c00-abc5-8bdc7159c6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:05.113578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43825b-8cc4-4c00-abc5-8bdc7159c6aa admin admin] PATH_INFO: `/v3/projects/56aef6889f594cd480d54ad537ce701a/users/65f5b6e6204a468fb24cc41535c62441/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:05.115754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43825b-8cc4-4c00-abc5-8bdc7159c6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=56aef6889f594cd480d54ad537ce701a, user_id=65f5b6e6204a468fb24cc41535c62441, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:05.118736 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43825b-8cc4-4c00-abc5-8bdc7159c6aa admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:05.130282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1247/2500] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:05 2022] PUT /identity/v3/projects/56aef6889f594cd480d54ad537ce701a/users/65f5b6e6204a468fb24cc41535c62441/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:05.894738 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f654288-b4e4-402c-8879-3a6a7e98b8fe None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:05.895283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f654288-b4e4-402c-8879-3a6a7e98b8fe None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:05.895283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f654288-b4e4-402c-8879-3a6a7e98b8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:05.926593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-6f654288-b4e4-402c-8879-3a6a7e98b8fe None None] MFA Rules not processed for user `65f5b6e6204a468fb24cc41535c62441`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:05.927880 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-6f654288-b4e4-402c-8879-3a6a7e98b8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:05.938231 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:06.007527 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1254/2501] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 14:00:06.018884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4e7ff-7cb6-4fb0-8722-0f24ae39effc None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:06.019192 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4e7ff-7cb6-4fb0-8722-0f24ae39effc None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:06.019463 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4e7ff-7cb6-4fb0-8722-0f24ae39effc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:06.037531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-98b4e7ff-7cb6-4fb0-8722-0f24ae39effc None None] MFA Rules not processed for user `54ac98c13bf3441dae28640a2c8f8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:06.038747 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-98b4e7ff-7cb6-4fb0-8722-0f24ae39effc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:06.095831 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1248/2502] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 14:00:06.107838 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f654288-b4e4-402c-8879-3a6a7e98b8fe None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:06.109021 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-6f654288-b4e4-402c-8879-3a6a7e98b8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:06.194638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f654288-b4e4-402c-8879-3a6a7e98b8fe None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:06.200694 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587ff30-9a52-4840-abe8-19ef40bec877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994043a81bb454297c208839794a479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:06.201381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587ff30-9a52-4840-abe8-19ef40bec877 service nova] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:06.201889 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587ff30-9a52-4840-abe8-19ef40bec877 service nova] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:06.201994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587ff30-9a52-4840-abe8-19ef40bec877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:06.212072 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587ff30-9a52-4840-abe8-19ef40bec877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:06.213831 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587ff30-9a52-4840-abe8-19ef40bec877 service nova] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:06.223851 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1255/2503] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 14:00:07.164697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71679bc5-c0c3-47d1-a59a-48e996f50e9a None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:07.165170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71679bc5-c0c3-47d1-a59a-48e996f50e9a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:07.165289 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71679bc5-c0c3-47d1-a59a-48e996f50e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:07.196649 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-71679bc5-c0c3-47d1-a59a-48e996f50e9a None None] MFA Rules not processed for user `135410329e56486c8ccb65b1f2d87aca`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:07.196649 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-71679bc5-c0c3-47d1-a59a-48e996f50e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:07.212146 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:07.274508 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1249/2504] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 14:00:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:07.287428 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587ff30-9a52-4840-abe8-19ef40bec877 service nova] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:07.290395 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-3587ff30-9a52-4840-abe8-19ef40bec877 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:07.380747 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587ff30-9a52-4840-abe8-19ef40bec877 service nova] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:07.388020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b0289-5e77-47b5-9fc2-94f7f917f669 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e517dc43cc6d401e820c65ad4c941386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:07.388771 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b0289-5e77-47b5-9fc2-94f7f917f669 service swift] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:07.389118 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b0289-5e77-47b5-9fc2-94f7f917f669 service swift] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:07.389476 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b0289-5e77-47b5-9fc2-94f7f917f669 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:07.400797 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b0289-5e77-47b5-9fc2-94f7f917f669 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:07.403068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b0289-5e77-47b5-9fc2-94f7f917f669 service swift] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:07.415072 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1256/2505] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 14:00:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 14:00:08.588675 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71679bc5-c0c3-47d1-a59a-48e996f50e9a None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:08.592477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-71679bc5-c0c3-47d1-a59a-48e996f50e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:08.655571 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71679bc5-c0c3-47d1-a59a-48e996f50e9a None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:08.659333 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7ad38-4a57-4eac-9321-550bfcf3dffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:08.660091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7ad38-4a57-4eac-9321-550bfcf3dffb service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:08.660451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7ad38-4a57-4eac-9321-550bfcf3dffb service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:08.660810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7ad38-4a57-4eac-9321-550bfcf3dffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:08.662749 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-60e7ad38-4a57-4eac-9321-550bfcf3dffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:08.740544 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7ad38-4a57-4eac-9321-550bfcf3dffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:08.742142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7ad38-4a57-4eac-9321-550bfcf3dffb service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:08.753345 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1250/2506] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 14:00:12.949160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b0289-5e77-47b5-9fc2-94f7f917f669 service swift] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:12.950782 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-4c0b0289-5e77-47b5-9fc2-94f7f917f669 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:12.999039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:13.044873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7ad38-4a57-4eac-9321-550bfcf3dffb service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:13.047738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-60e7ad38-4a57-4eac-9321-550bfcf3dffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:13.069130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7ad38-4a57-4eac-9321-550bfcf3dffb service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:13.075180 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b0289-5e77-47b5-9fc2-94f7f917f669 service swift] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:13.080360 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2fe8d-182d-4486-801d-3e8d35ec201f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0db68b7fda4da29eb13689f3fd7b5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:13.081045 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2fe8d-182d-4486-801d-3e8d35ec201f service placement] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:13.081376 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2fe8d-182d-4486-801d-3e8d35ec201f service placement] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:13.084280 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2fe8d-182d-4486-801d-3e8d35ec201f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:13.085199 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8bf6e-0aa9-477f-9a2f-69c8f3999588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:13.086155 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8bf6e-0aa9-477f-9a2f-69c8f3999588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:13.086436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8bf6e-0aa9-477f-9a2f-69c8f3999588 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:13.086648 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-f0e2fe8d-182d-4486-801d-3e8d35ec201f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:13.086773 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8bf6e-0aa9-477f-9a2f-69c8f3999588 admin admin] PATH_INFO: `/v3/users/63cf85b13c87481095acb4d3a84156cc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:13.087983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8bf6e-0aa9-477f-9a2f-69c8f3999588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63cf85b13c87481095acb4d3a84156cc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:13.089956 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8bf6e-0aa9-477f-9a2f-69c8f3999588 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:13.101125 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2fe8d-182d-4486-801d-3e8d35ec201f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:13.103270 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2fe8d-182d-4486-801d-3e8d35ec201f service placement] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:13.115494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1257/2507] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:13.168419 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-3ab8bf6e-0aa9-477f-9a2f-69c8f3999588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63cf85b13c87481095acb4d3a84156cc'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:13.219143 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-3ab8bf6e-0aa9-477f-9a2f-69c8f3999588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63cf85b13c87481095acb4d3a84156cc'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:13.220130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-3ab8bf6e-0aa9-477f-9a2f-69c8f3999588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63cf85b13c87481095acb4d3a84156cc'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:13.221153 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-3ab8bf6e-0aa9-477f-9a2f-69c8f3999588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63cf85b13c87481095acb4d3a84156cc'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:13.224904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:13.257833 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-3ab8bf6e-0aa9-477f-9a2f-69c8f3999588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63cf85b13c87481095acb4d3a84156cc'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:13.274143 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1251/2508] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:13 2022] DELETE /identity/v3/users/63cf85b13c87481095acb4d3a84156cc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:13.530435 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2fe8d-182d-4486-801d-3e8d35ec201f service placement] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:13.542291 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2fe8d-182d-4486-801d-3e8d35ec201f service placement] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:13.617683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1999eae-9a61-4aaa-902e-ccd52a793535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:13.618879 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1999eae-9a61-4aaa-902e-ccd52a793535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:13.619331 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1999eae-9a61-4aaa-902e-ccd52a793535 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:13.619681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1999eae-9a61-4aaa-902e-ccd52a793535 admin admin] PATH_INFO: `/v3/projects/8714a3fc5c744e2e9a5def18919b7a0d` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:13.621177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1999eae-9a61-4aaa-902e-ccd52a793535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8714a3fc5c744e2e9a5def18919b7a0d)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:13.623386 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1999eae-9a61-4aaa-902e-ccd52a793535 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:13.685694 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b1999eae-9a61-4aaa-902e-ccd52a793535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8714a3fc5c744e2e9a5def18919b7a0d', 'request_id': 'req-b1999eae-9a61-4aaa-902e-ccd52a793535'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:13.691937 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b1999eae-9a61-4aaa-902e-ccd52a793535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8714a3fc5c744e2e9a5def18919b7a0d', 'request_id': 'req-b1999eae-9a61-4aaa-902e-ccd52a793535'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:13.700489 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b1999eae-9a61-4aaa-902e-ccd52a793535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8714a3fc5c744e2e9a5def18919b7a0d', 'request_id': 'req-b1999eae-9a61-4aaa-902e-ccd52a793535'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:13.713009 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b1999eae-9a61-4aaa-902e-ccd52a793535 admin admin] The token cache is being invalidate because project 8714a3fc5c744e2e9a5def18919b7a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:13.713692 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b1999eae-9a61-4aaa-902e-ccd52a793535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:13.714601 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b1999eae-9a61-4aaa-902e-ccd52a793535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:13.717106 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1258/2509] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:13 2022] DELETE /identity/v3/projects/8714a3fc5c744e2e9a5def18919b7a0d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:13.722678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844abca3-c71d-4cee-93f6-a151a632e85d None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:13.722969 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844abca3-c71d-4cee-93f6-a151a632e85d None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:13.723251 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844abca3-c71d-4cee-93f6-a151a632e85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:13.744998 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-844abca3-c71d-4cee-93f6-a151a632e85d None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:13.746147 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-844abca3-c71d-4cee-93f6-a151a632e85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:13.811572 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1252/2510] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:13.819745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a01d4-4bc4-49ca-98cc-fb038142c157 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:13.820036 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a01d4-4bc4-49ca-98cc-fb038142c157 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:13.820322 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a01d4-4bc4-49ca-98cc-fb038142c157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:13.842052 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-c00a01d4-4bc4-49ca-98cc-fb038142c157 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:13.844452 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-c00a01d4-4bc4-49ca-98cc-fb038142c157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:13.854150 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1259/2511] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:13.858486 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844abca3-c71d-4cee-93f6-a151a632e85d None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:13.870298 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844abca3-c71d-4cee-93f6-a151a632e85d None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:13.874950 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893efbc8-9fff-453e-8f90-c4f9830269e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:13.875616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893efbc8-9fff-453e-8f90-c4f9830269e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:13.875899 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893efbc8-9fff-453e-8f90-c4f9830269e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:13.876176 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893efbc8-9fff-453e-8f90-c4f9830269e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:13.876897 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893efbc8-9fff-453e-8f90-c4f9830269e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:00:13.877206 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893efbc8-9fff-453e-8f90-c4f9830269e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:13.878860 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893efbc8-9fff-453e-8f90-c4f9830269e7 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:13.892103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1253/2512] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:00:13.896628 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a01d4-4bc4-49ca-98cc-fb038142c157 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:13.908136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a01d4-4bc4-49ca-98cc-fb038142c157 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:13.912816 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47906793-7e55-4832-afc7-1b7e362ffa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:13.913502 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47906793-7e55-4832-afc7-1b7e362ffa66 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:13.913953 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47906793-7e55-4832-afc7-1b7e362ffa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:13.914229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47906793-7e55-4832-afc7-1b7e362ffa66 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:13.914933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47906793-7e55-4832-afc7-1b7e362ffa66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:13.916823 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47906793-7e55-4832-afc7-1b7e362ffa66 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:13.947181 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1260/2513] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:13 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:13.949824 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893efbc8-9fff-453e-8f90-c4f9830269e7 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:13.961035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893efbc8-9fff-453e-8f90-c4f9830269e7 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:14.028921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5f036-7f23-44c0-8859-70a1f76988c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:14.029783 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5f036-7f23-44c0-8859-70a1f76988c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:14.030155 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5f036-7f23-44c0-8859-70a1f76988c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:14.030362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5f036-7f23-44c0-8859-70a1f76988c4 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:14.031195 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5f036-7f23-44c0-8859-70a1f76988c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:14.033110 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5f036-7f23-44c0-8859-70a1f76988c4 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:14.055074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1254/2514] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:13 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:14.059302 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47906793-7e55-4832-afc7-1b7e362ffa66 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:14.071712 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47906793-7e55-4832-afc7-1b7e362ffa66 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:14.076575 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde0478-75f1-495e-b67f-ae6e5b78d240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:14.077255 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde0478-75f1-495e-b67f-ae6e5b78d240 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:14.078142 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde0478-75f1-495e-b67f-ae6e5b78d240 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:14.078425 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde0478-75f1-495e-b67f-ae6e5b78d240 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:14.079156 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde0478-75f1-495e-b67f-ae6e5b78d240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:14.080803 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde0478-75f1-495e-b67f-ae6e5b78d240 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:14.092833 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1261/2515] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:14.096850 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5f036-7f23-44c0-8859-70a1f76988c4 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:14.106897 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5f036-7f23-44c0-8859-70a1f76988c4 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:14.112049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaccc16-db70-4286-8e8f-69d00dab251b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:14.112703 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaccc16-db70-4286-8e8f-69d00dab251b admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:14.112988 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaccc16-db70-4286-8e8f-69d00dab251b admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:14.113313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaccc16-db70-4286-8e8f-69d00dab251b admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:14.114035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaccc16-db70-4286-8e8f-69d00dab251b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:14.115987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaccc16-db70-4286-8e8f-69d00dab251b admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:14.127636 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1255/2516] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 14:00:14.131842 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde0478-75f1-495e-b67f-ae6e5b78d240 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:14.137240 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:14.144749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde0478-75f1-495e-b67f-ae6e5b78d240 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:14.151510 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe491458-b708-4de4-a861-d23a2dc0615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:14.152730 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe491458-b708-4de4-a861-d23a2dc0615a admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:14.153405 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe491458-b708-4de4-a861-d23a2dc0615a admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:14.153871 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe491458-b708-4de4-a861-d23a2dc0615a admin admin] PATH_INFO: `/v3/projects/4535964e1e864bc6aec290cf2d4a6cec/users/9b6f208ca63e46f7a82961121ecb6589/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:14.170136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe491458-b708-4de4-a861-d23a2dc0615a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4535964e1e864bc6aec290cf2d4a6cec, user_id=9b6f208ca63e46f7a82961121ecb6589, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:14.173391 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe491458-b708-4de4-a861-d23a2dc0615a admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:14.188333 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1262/2517] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:14 2022] PUT /identity/v3/projects/4535964e1e864bc6aec290cf2d4a6cec/users/9b6f208ca63e46f7a82961121ecb6589/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:14.198114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b116a7-706e-41b3-9e7b-af48e7425224 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:14.198661 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b116a7-706e-41b3-9e7b-af48e7425224 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:14.199107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b116a7-706e-41b3-9e7b-af48e7425224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:14.226724 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-44b116a7-706e-41b3-9e7b-af48e7425224 None None] MFA Rules not processed for user `9b6f208ca63e46f7a82961121ecb6589`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:14.227936 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-44b116a7-706e-41b3-9e7b-af48e7425224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:14.293693 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:14.329603 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1256/2518] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 14:00:14.333692 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe491458-b708-4de4-a861-d23a2dc0615a admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:14.421490 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe491458-b708-4de4-a861-d23a2dc0615a admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:14.426464 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267575fb-ba5a-459f-9cb9-0b096eb5e98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:14.427125 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267575fb-ba5a-459f-9cb9-0b096eb5e98a admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:14.427407 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267575fb-ba5a-459f-9cb9-0b096eb5e98a admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:14.427681 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267575fb-ba5a-459f-9cb9-0b096eb5e98a admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:14.428370 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267575fb-ba5a-459f-9cb9-0b096eb5e98a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:14.430314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267575fb-ba5a-459f-9cb9-0b096eb5e98a admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:14.461312 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1263/2519] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:14 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:14.463510 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b116a7-706e-41b3-9e7b-af48e7425224 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:14.474323 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b116a7-706e-41b3-9e7b-af48e7425224 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:14.569375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e3ccc-a7cf-4f74-9212-63b61cb1b2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:14.569909 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e3ccc-a7cf-4f74-9212-63b61cb1b2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:14.570198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e3ccc-a7cf-4f74-9212-63b61cb1b2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:14.570481 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e3ccc-a7cf-4f74-9212-63b61cb1b2a9 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:14.571190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e3ccc-a7cf-4f74-9212-63b61cb1b2a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:14.573161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e3ccc-a7cf-4f74-9212-63b61cb1b2a9 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:14.599132 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1257/2520] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:14 2022] POST /identity/v3/users => generated 295 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:14.604547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267575fb-ba5a-459f-9cb9-0b096eb5e98a admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:14.616889 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267575fb-ba5a-459f-9cb9-0b096eb5e98a admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:14.624312 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9b7c9-fb0f-4bce-9fae-8da84db5b3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:14.625316 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9b7c9-fb0f-4bce-9fae-8da84db5b3ce admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:14.625695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9b7c9-fb0f-4bce-9fae-8da84db5b3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:14.626022 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9b7c9-fb0f-4bce-9fae-8da84db5b3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:14.626945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9b7c9-fb0f-4bce-9fae-8da84db5b3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:14.628673 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9b7c9-fb0f-4bce-9fae-8da84db5b3ce admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:14.650815 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1264/2521] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 14:00:14.655254 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e3ccc-a7cf-4f74-9212-63b61cb1b2a9 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:14.666351 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e3ccc-a7cf-4f74-9212-63b61cb1b2a9 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:14.674442 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1406e-1257-46be-bf39-0b6c54c505f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:14.677917 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1406e-1257-46be-bf39-0b6c54c505f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:14.678226 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1406e-1257-46be-bf39-0b6c54c505f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:14.678507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1406e-1257-46be-bf39-0b6c54c505f9 admin admin] PATH_INFO: `/v3/projects/263e973d4370421dba0a874aa03629c8/users/cd7a9749ad374a0aa7f3c73c29049e9b/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:14.700306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1406e-1257-46be-bf39-0b6c54c505f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=263e973d4370421dba0a874aa03629c8, user_id=cd7a9749ad374a0aa7f3c73c29049e9b, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:14.703340 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1406e-1257-46be-bf39-0b6c54c505f9 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:14.722859 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1258/2522] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:14 2022] PUT /identity/v3/projects/263e973d4370421dba0a874aa03629c8/users/cd7a9749ad374a0aa7f3c73c29049e9b/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:14.726914 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9b7c9-fb0f-4bce-9fae-8da84db5b3ce admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:14.737897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9b7c9-fb0f-4bce-9fae-8da84db5b3ce admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:14.803160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b24755-37a4-408f-91b4-38cd16b464a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:14.803850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24755-37a4-408f-91b4-38cd16b464a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:14.804141 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24755-37a4-408f-91b4-38cd16b464a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:14.804420 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24755-37a4-408f-91b4-38cd16b464a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:14.805145 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b24755-37a4-408f-91b4-38cd16b464a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:14.806797 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b24755-37a4-408f-91b4-38cd16b464a5 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:14.821477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1265/2523] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 14:00:14.822692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1406e-1257-46be-bf39-0b6c54c505f9 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:14.836473 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1406e-1257-46be-bf39-0b6c54c505f9 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:14.841674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c71e9e-cfb5-4867-b9ab-dba07cddb076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:14.842621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c71e9e-cfb5-4867-b9ab-dba07cddb076 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:14.842854 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c71e9e-cfb5-4867-b9ab-dba07cddb076 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:14.843162 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c71e9e-cfb5-4867-b9ab-dba07cddb076 admin admin] PATH_INFO: `/v3/projects/263e973d4370421dba0a874aa03629c8/users/cd7a9749ad374a0aa7f3c73c29049e9b/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:14.845135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c71e9e-cfb5-4867-b9ab-dba07cddb076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=263e973d4370421dba0a874aa03629c8, user_id=cd7a9749ad374a0aa7f3c73c29049e9b, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:14.848000 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c71e9e-cfb5-4867-b9ab-dba07cddb076 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:14.859663 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1259/2524] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:14 2022] PUT /identity/v3/projects/263e973d4370421dba0a874aa03629c8/users/cd7a9749ad374a0aa7f3c73c29049e9b/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:14.871446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1286baa-0c15-4898-bf91-fe9c451f99a6 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:14.871848 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1286baa-0c15-4898-bf91-fe9c451f99a6 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:14.872142 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1286baa-0c15-4898-bf91-fe9c451f99a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:14.912070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-e1286baa-0c15-4898-bf91-fe9c451f99a6 None None] MFA Rules not processed for user `cd7a9749ad374a0aa7f3c73c29049e9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:14.913495 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e1286baa-0c15-4898-bf91-fe9c451f99a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:14.959666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:14.994699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1266/2525] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:15.005829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c71e9e-cfb5-4867-b9ab-dba07cddb076 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:15.007536 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-71c71e9e-cfb5-4867-b9ab-dba07cddb076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:15.071988 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c71e9e-cfb5-4867-b9ab-dba07cddb076 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:15.075978 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499e039-1b91-483c-9690-88fe0c588ae5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:15.076724 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499e039-1b91-483c-9690-88fe0c588ae5 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:15.077022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499e039-1b91-483c-9690-88fe0c588ae5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:15.077330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499e039-1b91-483c-9690-88fe0c588ae5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:15.131904 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:15.147419 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499e039-1b91-483c-9690-88fe0c588ae5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:15.148862 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499e039-1b91-483c-9690-88fe0c588ae5 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:15.159341 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1260/2526] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:17.748259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1286baa-0c15-4898-bf91-fe9c451f99a6 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:17.757865 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1286baa-0c15-4898-bf91-fe9c451f99a6 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:17.761458 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e7752-7a23-4597-a79f-48598d30f5d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:17.762094 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e7752-7a23-4597-a79f-48598d30f5d9 service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:17.762373 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e7752-7a23-4597-a79f-48598d30f5d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:17.762646 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e7752-7a23-4597-a79f-48598d30f5d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:17.776325 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e7752-7a23-4597-a79f-48598d30f5d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:17.778270 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e7752-7a23-4597-a79f-48598d30f5d9 service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:17.789809 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1267/2527] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:21.811322 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80befd1a-adce-4987-86f7-f3f22e697161 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:21.811880 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80befd1a-adce-4987-86f7-f3f22e697161 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:21.811880 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80befd1a-adce-4987-86f7-f3f22e697161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:21.833927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-80befd1a-adce-4987-86f7-f3f22e697161 None None] MFA Rules not processed for user `135410329e56486c8ccb65b1f2d87aca`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:21.835640 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-80befd1a-adce-4987-86f7-f3f22e697161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:21.907696 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1261/2528] 10.222.0.45 () {58 vars in 967 bytes} [Thu May 26 14:00:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:21.923256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e7752-7a23-4597-a79f-48598d30f5d9 service cinder] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:21.924716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-919e7752-7a23-4597-a79f-48598d30f5d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:22.024577 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e7752-7a23-4597-a79f-48598d30f5d9 service cinder] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:22.031177 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d294f-7108-426e-bdac-a383e1e0ba80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e517dc43cc6d401e820c65ad4c941386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:22.031831 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d294f-7108-426e-bdac-a383e1e0ba80 service swift] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:22.032146 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d294f-7108-426e-bdac-a383e1e0ba80 service swift] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:22.032429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d294f-7108-426e-bdac-a383e1e0ba80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:22.041067 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d294f-7108-426e-bdac-a383e1e0ba80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:22.042941 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d294f-7108-426e-bdac-a383e1e0ba80 service swift] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:22.052241 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1268/2529] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 14:00:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 14:00:27.711511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80befd1a-adce-4987-86f7-f3f22e697161 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:27.714524 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-80befd1a-adce-4987-86f7-f3f22e697161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:27.727872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80befd1a-adce-4987-86f7-f3f22e697161 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:27.732601 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c28aa-4f2e-4550-ba84-ec2ba537ab1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:27.734488 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c28aa-4f2e-4550-ba84-ec2ba537ab1a service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:27.734770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c28aa-4f2e-4550-ba84-ec2ba537ab1a service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:27.735040 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c28aa-4f2e-4550-ba84-ec2ba537ab1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:27.736817 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-639c28aa-4f2e-4550-ba84-ec2ba537ab1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:27.810512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c28aa-4f2e-4550-ba84-ec2ba537ab1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:27.811973 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c28aa-4f2e-4550-ba84-ec2ba537ab1a service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:27.823133 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1262/2530] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:30.358454 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d294f-7108-426e-bdac-a383e1e0ba80 service swift] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:30.427268 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d294f-7108-426e-bdac-a383e1e0ba80 service swift] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:30.432489 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f999e-885b-42b9-b932-1c924dd05eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:30.432958 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f999e-885b-42b9-b932-1c924dd05eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:30.433240 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f999e-885b-42b9-b932-1c924dd05eec admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:30.433606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f999e-885b-42b9-b932-1c924dd05eec admin admin] PATH_INFO: `/v3/users/9b6f208ca63e46f7a82961121ecb6589` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:30.434894 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f999e-885b-42b9-b932-1c924dd05eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6f208ca63e46f7a82961121ecb6589)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:30.437637 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f999e-885b-42b9-b932-1c924dd05eec admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:30.492421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ee5f999e-885b-42b9-b932-1c924dd05eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6f208ca63e46f7a82961121ecb6589'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:30.493095 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ee5f999e-885b-42b9-b932-1c924dd05eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6f208ca63e46f7a82961121ecb6589'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:30.493733 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ee5f999e-885b-42b9-b932-1c924dd05eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6f208ca63e46f7a82961121ecb6589'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:30.500380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:30.505826 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ee5f999e-885b-42b9-b932-1c924dd05eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6f208ca63e46f7a82961121ecb6589'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:30.515359 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ee5f999e-885b-42b9-b932-1c924dd05eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6f208ca63e46f7a82961121ecb6589'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:30.536928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1269/2531] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:30 2022] DELETE /identity/v3/users/9b6f208ca63e46f7a82961121ecb6589 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:30.541401 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1c201-52b3-4974-82de-9ee899b32972 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:30.542066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1c201-52b3-4974-82de-9ee899b32972 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:30.542066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1c201-52b3-4974-82de-9ee899b32972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:30.564864 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-cda1c201-52b3-4974-82de-9ee899b32972 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:30.566552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-cda1c201-52b3-4974-82de-9ee899b32972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:30.652400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1263/2532] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:30.692452 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f999e-885b-42b9-b932-1c924dd05eec admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:30.694276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ee5f999e-885b-42b9-b932-1c924dd05eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:30.755902 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f999e-885b-42b9-b932-1c924dd05eec admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:30.760351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c3538-893f-4d29-af7c-ba0d5d212ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:30.761110 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c3538-893f-4d29-af7c-ba0d5d212ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:30.761500 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c3538-893f-4d29-af7c-ba0d5d212ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:30.761848 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c3538-893f-4d29-af7c-ba0d5d212ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:30.784807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c3538-893f-4d29-af7c-ba0d5d212ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:30.789065 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c3538-893f-4d29-af7c-ba0d5d212ab3 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:30.803592 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1270/2533] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:31.374348 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1c201-52b3-4974-82de-9ee899b32972 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:31.375997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-cda1c201-52b3-4974-82de-9ee899b32972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:31.400683 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1c201-52b3-4974-82de-9ee899b32972 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:31.405999 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5239cc2-411c-45b6-93bf-9009d8e6aeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:31.407171 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5239cc2-411c-45b6-93bf-9009d8e6aeb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:31.407517 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5239cc2-411c-45b6-93bf-9009d8e6aeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:31.407798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5239cc2-411c-45b6-93bf-9009d8e6aeb0 admin admin] PATH_INFO: `/v3/projects/4535964e1e864bc6aec290cf2d4a6cec` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:31.409050 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5239cc2-411c-45b6-93bf-9009d8e6aeb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4535964e1e864bc6aec290cf2d4a6cec)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:31.411119 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5239cc2-411c-45b6-93bf-9009d8e6aeb0 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:31.435746 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:31.465690 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-e5239cc2-411c-45b6-93bf-9009d8e6aeb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4535964e1e864bc6aec290cf2d4a6cec', 'request_id': 'req-e5239cc2-411c-45b6-93bf-9009d8e6aeb0'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:31.472695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-e5239cc2-411c-45b6-93bf-9009d8e6aeb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4535964e1e864bc6aec290cf2d4a6cec', 'request_id': 'req-e5239cc2-411c-45b6-93bf-9009d8e6aeb0'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:31.479623 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-e5239cc2-411c-45b6-93bf-9009d8e6aeb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4535964e1e864bc6aec290cf2d4a6cec', 'request_id': 'req-e5239cc2-411c-45b6-93bf-9009d8e6aeb0'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:31.496786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-e5239cc2-411c-45b6-93bf-9009d8e6aeb0 admin admin] The token cache is being invalidate because project 4535964e1e864bc6aec290cf2d4a6cec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:31.497163 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-e5239cc2-411c-45b6-93bf-9009d8e6aeb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:31.498856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-e5239cc2-411c-45b6-93bf-9009d8e6aeb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:31.500680 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1264/2534] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:31 2022] DELETE /identity/v3/projects/4535964e1e864bc6aec290cf2d4a6cec => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:31.504926 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c3538-893f-4d29-af7c-ba0d5d212ab3 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:31.516977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c3538-893f-4d29-af7c-ba0d5d212ab3 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:31.584214 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142f524-1b88-4228-95e1-6de3d1e4a00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:31.585089 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142f524-1b88-4228-95e1-6de3d1e4a00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:31.585476 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142f524-1b88-4228-95e1-6de3d1e4a00c admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:31.586068 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142f524-1b88-4228-95e1-6de3d1e4a00c admin admin] PATH_INFO: `/v3/users/cd7a9749ad374a0aa7f3c73c29049e9b` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:31.587303 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142f524-1b88-4228-95e1-6de3d1e4a00c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd7a9749ad374a0aa7f3c73c29049e9b)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:31.588847 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142f524-1b88-4228-95e1-6de3d1e4a00c admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:31.634664 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-a142f524-1b88-4228-95e1-6de3d1e4a00c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd7a9749ad374a0aa7f3c73c29049e9b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:31.635301 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-a142f524-1b88-4228-95e1-6de3d1e4a00c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd7a9749ad374a0aa7f3c73c29049e9b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:31.635887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-a142f524-1b88-4228-95e1-6de3d1e4a00c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd7a9749ad374a0aa7f3c73c29049e9b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:31.644443 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-a142f524-1b88-4228-95e1-6de3d1e4a00c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd7a9749ad374a0aa7f3c73c29049e9b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:31.652800 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-a142f524-1b88-4228-95e1-6de3d1e4a00c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd7a9749ad374a0aa7f3c73c29049e9b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:31.661659 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:31.677695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1271/2535] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:31 2022] DELETE /identity/v3/users/cd7a9749ad374a0aa7f3c73c29049e9b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:31.945333 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5239cc2-411c-45b6-93bf-9009d8e6aeb0 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:31.946892 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e5239cc2-411c-45b6-93bf-9009d8e6aeb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:31.960721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5239cc2-411c-45b6-93bf-9009d8e6aeb0 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:32.017510 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062bbaf-2650-4d1e-b412-1a2ce9c58778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:32.018365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062bbaf-2650-4d1e-b412-1a2ce9c58778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:32.018647 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062bbaf-2650-4d1e-b412-1a2ce9c58778 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:32.018923 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062bbaf-2650-4d1e-b412-1a2ce9c58778 admin admin] PATH_INFO: `/v3/projects/263e973d4370421dba0a874aa03629c8` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:32.020085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062bbaf-2650-4d1e-b412-1a2ce9c58778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=263e973d4370421dba0a874aa03629c8)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:32.022030 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062bbaf-2650-4d1e-b412-1a2ce9c58778 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:32.068001 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-e062bbaf-2650-4d1e-b412-1a2ce9c58778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '263e973d4370421dba0a874aa03629c8', 'request_id': 'req-e062bbaf-2650-4d1e-b412-1a2ce9c58778'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:32.074536 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-e062bbaf-2650-4d1e-b412-1a2ce9c58778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '263e973d4370421dba0a874aa03629c8', 'request_id': 'req-e062bbaf-2650-4d1e-b412-1a2ce9c58778'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:32.079957 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-e062bbaf-2650-4d1e-b412-1a2ce9c58778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '263e973d4370421dba0a874aa03629c8', 'request_id': 'req-e062bbaf-2650-4d1e-b412-1a2ce9c58778'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:32.095396 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-e062bbaf-2650-4d1e-b412-1a2ce9c58778 admin admin] The token cache is being invalidate because project 263e973d4370421dba0a874aa03629c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:32.095699 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-e062bbaf-2650-4d1e-b412-1a2ce9c58778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:32.096360 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-e062bbaf-2650-4d1e-b412-1a2ce9c58778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:32.097941 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1265/2536] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:31 2022] DELETE /identity/v3/projects/263e973d4370421dba0a874aa03629c8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:32.102816 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76ba34-226e-4ae9-a37e-63dce608dd4f None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:32.103006 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76ba34-226e-4ae9-a37e-63dce608dd4f None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:32.103322 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76ba34-226e-4ae9-a37e-63dce608dd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:32.121986 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-ab76ba34-226e-4ae9-a37e-63dce608dd4f None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:32.123195 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ab76ba34-226e-4ae9-a37e-63dce608dd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:32.205431 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1272/2537] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:32.210238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd821e0-5ab4-4026-8ebb-a7fe972224d9 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:32.210696 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd821e0-5ab4-4026-8ebb-a7fe972224d9 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:32.211076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd821e0-5ab4-4026-8ebb-a7fe972224d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:32.240202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-1dd821e0-5ab4-4026-8ebb-a7fe972224d9 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:32.241566 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1dd821e0-5ab4-4026-8ebb-a7fe972224d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:32.251288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1266/2538] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:32.255793 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76ba34-226e-4ae9-a37e-63dce608dd4f None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:32.266527 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76ba34-226e-4ae9-a37e-63dce608dd4f None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:32.271652 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25025c19-e6a4-4fef-84b3-db91387512f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:32.272324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25025c19-e6a4-4fef-84b3-db91387512f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:32.272608 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25025c19-e6a4-4fef-84b3-db91387512f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:32.272890 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25025c19-e6a4-4fef-84b3-db91387512f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:32.273652 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25025c19-e6a4-4fef-84b3-db91387512f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:00:32.273961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25025c19-e6a4-4fef-84b3-db91387512f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:32.275770 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25025c19-e6a4-4fef-84b3-db91387512f8 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:32.289392 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1273/2539] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:00:32.294020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd821e0-5ab4-4026-8ebb-a7fe972224d9 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:32.307351 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd821e0-5ab4-4026-8ebb-a7fe972224d9 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:32.314564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe4641-5bca-4eb5-a56f-4adb689e75c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:32.315419 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe4641-5bca-4eb5-a56f-4adb689e75c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:32.315719 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe4641-5bca-4eb5-a56f-4adb689e75c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:32.316108 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe4641-5bca-4eb5-a56f-4adb689e75c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:32.316885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe4641-5bca-4eb5-a56f-4adb689e75c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:32.319862 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe4641-5bca-4eb5-a56f-4adb689e75c4 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:32.382752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1267/2540] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:32 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:00:32.387606 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25025c19-e6a4-4fef-84b3-db91387512f8 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:32.410743 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25025c19-e6a4-4fef-84b3-db91387512f8 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:32.478803 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823e136-7207-44d4-a522-d4e1dc2f1cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:32.479836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823e136-7207-44d4-a522-d4e1dc2f1cff admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:32.480129 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823e136-7207-44d4-a522-d4e1dc2f1cff admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:32.480409 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823e136-7207-44d4-a522-d4e1dc2f1cff admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:32.481109 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823e136-7207-44d4-a522-d4e1dc2f1cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:32.483654 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823e136-7207-44d4-a522-d4e1dc2f1cff admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:32.505069 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1274/2541] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:32 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:32.509020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe4641-5bca-4eb5-a56f-4adb689e75c4 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:32.519981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe4641-5bca-4eb5-a56f-4adb689e75c4 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:32.524793 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725689f1-c3e0-4815-861a-a90e12de6e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:32.525540 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725689f1-c3e0-4815-861a-a90e12de6e48 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:32.525824 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725689f1-c3e0-4815-861a-a90e12de6e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:32.526100 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725689f1-c3e0-4815-861a-a90e12de6e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:32.526849 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725689f1-c3e0-4815-861a-a90e12de6e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:32.528445 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725689f1-c3e0-4815-861a-a90e12de6e48 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:32.531565 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:32.544983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1268/2542] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:32.546136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823e136-7207-44d4-a522-d4e1dc2f1cff admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:32.556846 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823e136-7207-44d4-a522-d4e1dc2f1cff admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:32.562628 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461727f-cd93-41f9-ac83-5daee1ca28e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:32.563365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461727f-cd93-41f9-ac83-5daee1ca28e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:32.563897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461727f-cd93-41f9-ac83-5daee1ca28e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:32.564182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461727f-cd93-41f9-ac83-5daee1ca28e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:32.564987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461727f-cd93-41f9-ac83-5daee1ca28e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:32.566826 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461727f-cd93-41f9-ac83-5daee1ca28e5 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:32.581449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1275/2543] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:32.583096 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725689f1-c3e0-4815-861a-a90e12de6e48 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:32.593773 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725689f1-c3e0-4815-861a-a90e12de6e48 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:32.598603 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21054ae-e958-4210-b939-60c7729a744c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:32.599611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21054ae-e958-4210-b939-60c7729a744c admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:32.599964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21054ae-e958-4210-b939-60c7729a744c admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:32.600315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21054ae-e958-4210-b939-60c7729a744c admin admin] PATH_INFO: `/v3/projects/b2143c815e61419fa034fc838c8e76af/users/4f50584464cb4277a149a8c50f51d469/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:32.623994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21054ae-e958-4210-b939-60c7729a744c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2143c815e61419fa034fc838c8e76af, user_id=4f50584464cb4277a149a8c50f51d469, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:32.627086 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21054ae-e958-4210-b939-60c7729a744c admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:32.645172 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1269/2544] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:32 2022] PUT /identity/v3/projects/b2143c815e61419fa034fc838c8e76af/users/4f50584464cb4277a149a8c50f51d469/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:32.656716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1d409-50b0-4d99-98eb-07021b390187 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:32.657097 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1d409-50b0-4d99-98eb-07021b390187 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:32.657655 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1d409-50b0-4d99-98eb-07021b390187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:32.690612 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-89a1d409-50b0-4d99-98eb-07021b390187 None None] MFA Rules not processed for user `4f50584464cb4277a149a8c50f51d469`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:32.691874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-89a1d409-50b0-4d99-98eb-07021b390187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:32.736600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:32.758405 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1276/2545] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 14:00:32.762987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21054ae-e958-4210-b939-60c7729a744c admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:32.826441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21054ae-e958-4210-b939-60c7729a744c admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:32.831232 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c50bd3-f9cc-416f-8cdf-e26b4f867e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:32.831886 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50bd3-f9cc-416f-8cdf-e26b4f867e27 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:32.832174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50bd3-f9cc-416f-8cdf-e26b4f867e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:32.832451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50bd3-f9cc-416f-8cdf-e26b4f867e27 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:32.833130 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c50bd3-f9cc-416f-8cdf-e26b4f867e27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:32.835061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c50bd3-f9cc-416f-8cdf-e26b4f867e27 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:32.860564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1270/2546] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:32 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:32.864654 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1d409-50b0-4d99-98eb-07021b390187 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:32.875561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1d409-50b0-4d99-98eb-07021b390187 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:32.930640 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5476886-222e-4e03-b03c-e5164c89f0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:32.931305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5476886-222e-4e03-b03c-e5164c89f0b8 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:32.931591 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5476886-222e-4e03-b03c-e5164c89f0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:32.931872 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5476886-222e-4e03-b03c-e5164c89f0b8 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:32.932571 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5476886-222e-4e03-b03c-e5164c89f0b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:32.934665 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5476886-222e-4e03-b03c-e5164c89f0b8 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:32.953683 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1277/2547] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:32 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:32.957825 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c50bd3-f9cc-416f-8cdf-e26b4f867e27 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:32.968557 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c50bd3-f9cc-416f-8cdf-e26b4f867e27 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:32.973321 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba94ddc-ea3b-4b72-979c-8910280e6766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:32.974000 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba94ddc-ea3b-4b72-979c-8910280e6766 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:32.974312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba94ddc-ea3b-4b72-979c-8910280e6766 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:32.974588 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba94ddc-ea3b-4b72-979c-8910280e6766 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:32.975305 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba94ddc-ea3b-4b72-979c-8910280e6766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:32.976899 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba94ddc-ea3b-4b72-979c-8910280e6766 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:32.987921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1271/2548] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:32.992054 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5476886-222e-4e03-b03c-e5164c89f0b8 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:33.002099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5476886-222e-4e03-b03c-e5164c89f0b8 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:33.006732 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00777d2-99db-48d8-a201-f7ed221fe07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:33.007597 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00777d2-99db-48d8-a201-f7ed221fe07d admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:33.007879 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00777d2-99db-48d8-a201-f7ed221fe07d admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:33.008154 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00777d2-99db-48d8-a201-f7ed221fe07d admin admin] PATH_INFO: `/v3/projects/a83f94efb8544d628f67a1f726c73b35/users/28ac005eba5843968c87c3c296c13165/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:33.024199 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00777d2-99db-48d8-a201-f7ed221fe07d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83f94efb8544d628f67a1f726c73b35, user_id=28ac005eba5843968c87c3c296c13165, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:33.026903 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00777d2-99db-48d8-a201-f7ed221fe07d admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:33.039993 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1278/2549] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:32 2022] PUT /identity/v3/projects/a83f94efb8544d628f67a1f726c73b35/users/28ac005eba5843968c87c3c296c13165/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:33.043942 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba94ddc-ea3b-4b72-979c-8910280e6766 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:33.054463 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba94ddc-ea3b-4b72-979c-8910280e6766 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:33.109964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec40f2b-9d41-4bc4-a0cc-14080b712504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:33.110541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec40f2b-9d41-4bc4-a0cc-14080b712504 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:33.110824 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec40f2b-9d41-4bc4-a0cc-14080b712504 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:33.111100 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec40f2b-9d41-4bc4-a0cc-14080b712504 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:33.111844 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec40f2b-9d41-4bc4-a0cc-14080b712504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:33.113504 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec40f2b-9d41-4bc4-a0cc-14080b712504 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:33.123754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1272/2550] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:33.127907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00777d2-99db-48d8-a201-f7ed221fe07d admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:33.138047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00777d2-99db-48d8-a201-f7ed221fe07d admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:33.143762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bb612-1bef-4908-b064-369eb31cfecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:33.144651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bb612-1bef-4908-b064-369eb31cfecf admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:33.144932 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bb612-1bef-4908-b064-369eb31cfecf admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:33.145207 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bb612-1bef-4908-b064-369eb31cfecf admin admin] PATH_INFO: `/v3/projects/a83f94efb8544d628f67a1f726c73b35/users/28ac005eba5843968c87c3c296c13165/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:33.147228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bb612-1bef-4908-b064-369eb31cfecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83f94efb8544d628f67a1f726c73b35, user_id=28ac005eba5843968c87c3c296c13165, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:33.151105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bb612-1bef-4908-b064-369eb31cfecf admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:33.162958 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1279/2551] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:33 2022] PUT /identity/v3/projects/a83f94efb8544d628f67a1f726c73b35/users/28ac005eba5843968c87c3c296c13165/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:33.173629 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4463a-ca4c-459b-8f16-44efecf75ffb None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:33.173921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4463a-ca4c-459b-8f16-44efecf75ffb None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:33.174198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4463a-ca4c-459b-8f16-44efecf75ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:33.201990 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-44a4463a-ca4c-459b-8f16-44efecf75ffb None None] MFA Rules not processed for user `28ac005eba5843968c87c3c296c13165`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:33.203196 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-44a4463a-ca4c-459b-8f16-44efecf75ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:33.237662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:33.276205 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1273/2552] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:33.289136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bb612-1bef-4908-b064-369eb31cfecf admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:33.290994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7d0bb612-1bef-4908-b064-369eb31cfecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:33.347978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bb612-1bef-4908-b064-369eb31cfecf admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:33.351808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8070e5-106e-490b-aa50-697381e9f3c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:33.352433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8070e5-106e-490b-aa50-697381e9f3c7 service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:33.352712 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8070e5-106e-490b-aa50-697381e9f3c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:33.352985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8070e5-106e-490b-aa50-697381e9f3c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:33.362020 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8070e5-106e-490b-aa50-697381e9f3c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:33.363367 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8070e5-106e-490b-aa50-697381e9f3c7 service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:33.372863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1280/2553] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:33.766327 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4463a-ca4c-459b-8f16-44efecf75ffb None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:33.777530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4463a-ca4c-459b-8f16-44efecf75ffb None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:33.783203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e6275-164e-470e-8b3a-0bc639bc7a3e tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ac005eba5843968c87c3c296c13165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83f94efb8544d628f67a1f726c73b35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:33.784052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e6275-164e-470e-8b3a-0bc639bc7a3e tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:33.784400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e6275-164e-470e-8b3a-0bc639bc7a3e tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:33.784809 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e6275-164e-470e-8b3a-0bc639bc7a3e tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:33.785814 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e6275-164e-470e-8b3a-0bc639bc7a3e tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:00:33.786239 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e6275-164e-470e-8b3a-0bc639bc7a3e tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:33.793052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e6275-164e-470e-8b3a-0bc639bc7a3e tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:33.806886 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1274/2554] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:00:33.811749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8070e5-106e-490b-aa50-697381e9f3c7 service cinder] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:33.822169 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8070e5-106e-490b-aa50-697381e9f3c7 service cinder] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:33.828864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce228752-47f4-4ad2-845a-381c5f82e938 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ac005eba5843968c87c3c296c13165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83f94efb8544d628f67a1f726c73b35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:33.829710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce228752-47f4-4ad2-845a-381c5f82e938 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:33.830082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce228752-47f4-4ad2-845a-381c5f82e938 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:33.833042 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce228752-47f4-4ad2-845a-381c5f82e938 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:33.839536 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce228752-47f4-4ad2-845a-381c5f82e938 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:33.839536 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce228752-47f4-4ad2-845a-381c5f82e938 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:33.884876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1281/2555] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:33 2022] POST /identity/v3/projects => generated 355 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:33.887685 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e6275-164e-470e-8b3a-0bc639bc7a3e tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:33.899353 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e6275-164e-470e-8b3a-0bc639bc7a3e tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:33.995753 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b905fe-407e-4310-9236-89057c221c54 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ac005eba5843968c87c3c296c13165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83f94efb8544d628f67a1f726c73b35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:33.996438 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b905fe-407e-4310-9236-89057c221c54 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:33.996728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b905fe-407e-4310-9236-89057c221c54 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:33.997041 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b905fe-407e-4310-9236-89057c221c54 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:33.998742 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b905fe-407e-4310-9236-89057c221c54 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:00:33.999265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b905fe-407e-4310-9236-89057c221c54 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:34.000973 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b905fe-407e-4310-9236-89057c221c54 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:34.022248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1275/2556] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:00:34.061619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce228752-47f4-4ad2-845a-381c5f82e938 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:34.074420 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce228752-47f4-4ad2-845a-381c5f82e938 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:34.089628 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3fbca-10d2-4761-a926-5345585a56d6 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ac005eba5843968c87c3c296c13165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83f94efb8544d628f67a1f726c73b35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:34.090808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3fbca-10d2-4761-a926-5345585a56d6 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:34.091586 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3fbca-10d2-4761-a926-5345585a56d6 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:34.092132 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3fbca-10d2-4761-a926-5345585a56d6 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] PATH_INFO: `/v3/projects/c4de39f5cb5847f1931cfa969138e38d` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:34.093728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3fbca-10d2-4761-a926-5345585a56d6 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c4de39f5cb5847f1931cfa969138e38d)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:34.096031 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3fbca-10d2-4761-a926-5345585a56d6 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:34.119952 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:34.166348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-73f3fbca-10d2-4761-a926-5345585a56d6 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4de39f5cb5847f1931cfa969138e38d', 'request_id': 'req-73f3fbca-10d2-4761-a926-5345585a56d6'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:34.173033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-73f3fbca-10d2-4761-a926-5345585a56d6 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4de39f5cb5847f1931cfa969138e38d', 'request_id': 'req-73f3fbca-10d2-4761-a926-5345585a56d6'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:34.180118 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-73f3fbca-10d2-4761-a926-5345585a56d6 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4de39f5cb5847f1931cfa969138e38d', 'request_id': 'req-73f3fbca-10d2-4761-a926-5345585a56d6'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:34.191433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-73f3fbca-10d2-4761-a926-5345585a56d6 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] The token cache is being invalidate because project c4de39f5cb5847f1931cfa969138e38d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:34.191917 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-73f3fbca-10d2-4761-a926-5345585a56d6 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:34.192706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-73f3fbca-10d2-4761-a926-5345585a56d6 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:34.194674 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1282/2557] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:34 2022] DELETE /identity/v3/projects/c4de39f5cb5847f1931cfa969138e38d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:34.390133 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b905fe-407e-4310-9236-89057c221c54 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:34.392542 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e2b905fe-407e-4310-9236-89057c221c54 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:34.471867 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b905fe-407e-4310-9236-89057c221c54 tempest-VolumeQuotaClassesTest-1426552878 tempest-VolumeQuotaClassesTest-1426552878-project-admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:34.523046 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:34.529173 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfc436-ddce-41de-a236-26dd4e395e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:34.530587 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfc436-ddce-41de-a236-26dd4e395e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:34.530872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfc436-ddce-41de-a236-26dd4e395e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:34.531146 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfc436-ddce-41de-a236-26dd4e395e27 admin admin] PATH_INFO: `/v3/users/4f50584464cb4277a149a8c50f51d469` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:34.532324 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfc436-ddce-41de-a236-26dd4e395e27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f50584464cb4277a149a8c50f51d469)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:34.534288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfc436-ddce-41de-a236-26dd4e395e27 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:34.580135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-90bfc436-ddce-41de-a236-26dd4e395e27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f50584464cb4277a149a8c50f51d469'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:34.591579 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-90bfc436-ddce-41de-a236-26dd4e395e27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f50584464cb4277a149a8c50f51d469'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:34.592732 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-90bfc436-ddce-41de-a236-26dd4e395e27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f50584464cb4277a149a8c50f51d469'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:34.593356 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-90bfc436-ddce-41de-a236-26dd4e395e27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f50584464cb4277a149a8c50f51d469'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:34.600919 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-90bfc436-ddce-41de-a236-26dd4e395e27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f50584464cb4277a149a8c50f51d469'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:34.615161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1276/2558] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:34 2022] DELETE /identity/v3/users/4f50584464cb4277a149a8c50f51d469 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:34.620260 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba94f5-557a-409d-911b-43f1e35c7a6a None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:34.620878 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba94f5-557a-409d-911b-43f1e35c7a6a None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:34.621019 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba94f5-557a-409d-911b-43f1e35c7a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:34.638607 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-04ba94f5-557a-409d-911b-43f1e35c7a6a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:34.639796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-04ba94f5-557a-409d-911b-43f1e35c7a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:34.703286 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1283/2559] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:34.712781 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfc436-ddce-41de-a236-26dd4e395e27 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:34.714208 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-90bfc436-ddce-41de-a236-26dd4e395e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:34.775599 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfc436-ddce-41de-a236-26dd4e395e27 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:34.779266 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6077db-a768-4632-a290-c77ee100159b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:34.780518 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6077db-a768-4632-a290-c77ee100159b service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:34.780798 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6077db-a768-4632-a290-c77ee100159b service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:34.781072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6077db-a768-4632-a290-c77ee100159b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:34.790480 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6077db-a768-4632-a290-c77ee100159b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:34.791900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6077db-a768-4632-a290-c77ee100159b service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:34.801889 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1277/2560] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:35.163538 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba94f5-557a-409d-911b-43f1e35c7a6a None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:35.174752 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba94f5-557a-409d-911b-43f1e35c7a6a None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:35.178531 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870bb83-b78b-451c-87f3-c2cbb1b3f72b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:35.179265 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870bb83-b78b-451c-87f3-c2cbb1b3f72b service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:35.179609 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870bb83-b78b-451c-87f3-c2cbb1b3f72b service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:35.180112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870bb83-b78b-451c-87f3-c2cbb1b3f72b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:35.182311 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-f870bb83-b78b-451c-87f3-c2cbb1b3f72b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:35.196712 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870bb83-b78b-451c-87f3-c2cbb1b3f72b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:35.198275 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870bb83-b78b-451c-87f3-c2cbb1b3f72b service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:35.210246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1284/2561] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:35.211341 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6077db-a768-4632-a290-c77ee100159b service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:35.212842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-2d6077db-a768-4632-a290-c77ee100159b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:35.228289 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6077db-a768-4632-a290-c77ee100159b service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:35.237581 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c757b-f451-4edc-981d-efe53ec75f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:35.238464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c757b-f451-4edc-981d-efe53ec75f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:35.238764 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c757b-f451-4edc-981d-efe53ec75f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:35.239204 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c757b-f451-4edc-981d-efe53ec75f44 admin admin] PATH_INFO: `/v3/projects/b2143c815e61419fa034fc838c8e76af` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:35.240607 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c757b-f451-4edc-981d-efe53ec75f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2143c815e61419fa034fc838c8e76af)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:35.243400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c757b-f451-4edc-981d-efe53ec75f44 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:35.296421 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-514c757b-f451-4edc-981d-efe53ec75f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2143c815e61419fa034fc838c8e76af', 'request_id': 'req-514c757b-f451-4edc-981d-efe53ec75f44'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:35.302581 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-514c757b-f451-4edc-981d-efe53ec75f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2143c815e61419fa034fc838c8e76af', 'request_id': 'req-514c757b-f451-4edc-981d-efe53ec75f44'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:35.308170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-514c757b-f451-4edc-981d-efe53ec75f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2143c815e61419fa034fc838c8e76af', 'request_id': 'req-514c757b-f451-4edc-981d-efe53ec75f44'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:35.321551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-514c757b-f451-4edc-981d-efe53ec75f44 admin admin] The token cache is being invalidate because project b2143c815e61419fa034fc838c8e76af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:35.321845 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-514c757b-f451-4edc-981d-efe53ec75f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:35.322470 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-514c757b-f451-4edc-981d-efe53ec75f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:35.324400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1278/2562] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:35 2022] DELETE /identity/v3/projects/b2143c815e61419fa034fc838c8e76af => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:35.328984 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870bb83-b78b-451c-87f3-c2cbb1b3f72b service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:35.338753 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870bb83-b78b-451c-87f3-c2cbb1b3f72b service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:35.399586 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451d9f8-54b0-4e93-a418-4fd29644669e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:35.400466 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451d9f8-54b0-4e93-a418-4fd29644669e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:35.400751 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451d9f8-54b0-4e93-a418-4fd29644669e admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:35.401028 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451d9f8-54b0-4e93-a418-4fd29644669e admin admin] PATH_INFO: `/v3/users/28ac005eba5843968c87c3c296c13165` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:35.402256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451d9f8-54b0-4e93-a418-4fd29644669e admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ac005eba5843968c87c3c296c13165)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:35.404173 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451d9f8-54b0-4e93-a418-4fd29644669e admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:35.440767 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:35.455774 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5451d9f8-54b0-4e93-a418-4fd29644669e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ac005eba5843968c87c3c296c13165'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:35.456489 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5451d9f8-54b0-4e93-a418-4fd29644669e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ac005eba5843968c87c3c296c13165'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:35.457131 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5451d9f8-54b0-4e93-a418-4fd29644669e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ac005eba5843968c87c3c296c13165'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:35.464212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5451d9f8-54b0-4e93-a418-4fd29644669e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ac005eba5843968c87c3c296c13165'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:35.471520 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-5451d9f8-54b0-4e93-a418-4fd29644669e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ac005eba5843968c87c3c296c13165'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:35.488966 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1285/2563] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:35 2022] DELETE /identity/v3/users/28ac005eba5843968c87c3c296c13165 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:35.769085 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c757b-f451-4edc-981d-efe53ec75f44 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:35.771010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-514c757b-f451-4edc-981d-efe53ec75f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:35.782336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:35.787964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c757b-f451-4edc-981d-efe53ec75f44 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:35.854737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eed753-c25c-4869-a1cf-96aa3933aadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:35.855599 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eed753-c25c-4869-a1cf-96aa3933aadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:35.855883 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eed753-c25c-4869-a1cf-96aa3933aadf admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:35.856157 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eed753-c25c-4869-a1cf-96aa3933aadf admin admin] PATH_INFO: `/v3/projects/a83f94efb8544d628f67a1f726c73b35` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:35.857357 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eed753-c25c-4869-a1cf-96aa3933aadf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a83f94efb8544d628f67a1f726c73b35)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:35.859289 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eed753-c25c-4869-a1cf-96aa3933aadf admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:35.905910 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-20eed753-c25c-4869-a1cf-96aa3933aadf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83f94efb8544d628f67a1f726c73b35', 'request_id': 'req-20eed753-c25c-4869-a1cf-96aa3933aadf'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:35.912400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-20eed753-c25c-4869-a1cf-96aa3933aadf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83f94efb8544d628f67a1f726c73b35', 'request_id': 'req-20eed753-c25c-4869-a1cf-96aa3933aadf'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:35.918148 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-20eed753-c25c-4869-a1cf-96aa3933aadf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83f94efb8544d628f67a1f726c73b35', 'request_id': 'req-20eed753-c25c-4869-a1cf-96aa3933aadf'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:35.932591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-20eed753-c25c-4869-a1cf-96aa3933aadf admin admin] The token cache is being invalidate because project a83f94efb8544d628f67a1f726c73b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:35.932888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-20eed753-c25c-4869-a1cf-96aa3933aadf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:35.933541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-20eed753-c25c-4869-a1cf-96aa3933aadf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:35.935187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1279/2564] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:35 2022] DELETE /identity/v3/projects/a83f94efb8544d628f67a1f726c73b35 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:35.940604 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f96cea-a4bd-4bb0-9d50-937daf6b2fb4 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:35.941082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f96cea-a4bd-4bb0-9d50-937daf6b2fb4 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:35.941480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f96cea-a4bd-4bb0-9d50-937daf6b2fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:35.959917 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-f6f96cea-a4bd-4bb0-9d50-937daf6b2fb4 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:35.961188 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-f6f96cea-a4bd-4bb0-9d50-937daf6b2fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:36.022157 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1286/2565] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:36.029725 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375f33b-cd26-43c2-9c11-558a80e4fb8c None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:36.030011 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375f33b-cd26-43c2-9c11-558a80e4fb8c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:36.030314 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375f33b-cd26-43c2-9c11-558a80e4fb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:36.048248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-1375f33b-cd26-43c2-9c11-558a80e4fb8c None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:36.049484 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1375f33b-cd26-43c2-9c11-558a80e4fb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:36.058636 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1280/2566] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:36.063871 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f96cea-a4bd-4bb0-9d50-937daf6b2fb4 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:36.074844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f96cea-a4bd-4bb0-9d50-937daf6b2fb4 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:36.080827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8189ac-849a-49c6-8042-5f2674cea27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:36.081437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8189ac-849a-49c6-8042-5f2674cea27f admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:36.081798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8189ac-849a-49c6-8042-5f2674cea27f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:36.082153 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8189ac-849a-49c6-8042-5f2674cea27f admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:36.082963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8189ac-849a-49c6-8042-5f2674cea27f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:00:36.083499 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8189ac-849a-49c6-8042-5f2674cea27f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:36.085164 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8189ac-849a-49c6-8042-5f2674cea27f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:36.097930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1287/2567] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:00:36.109552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375f33b-cd26-43c2-9c11-558a80e4fb8c None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:36.122106 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375f33b-cd26-43c2-9c11-558a80e4fb8c None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:36.128974 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece03107-b141-4df5-8e7b-309df3247ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:36.130762 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece03107-b141-4df5-8e7b-309df3247ccd admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:36.131246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece03107-b141-4df5-8e7b-309df3247ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:36.131745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece03107-b141-4df5-8e7b-309df3247ccd admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:36.132652 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece03107-b141-4df5-8e7b-309df3247ccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:36.135039 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece03107-b141-4df5-8e7b-309df3247ccd admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:36.171924 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1281/2568] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:36 2022] POST /identity/v3/projects => generated 393 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:36.173509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8189ac-849a-49c6-8042-5f2674cea27f admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:36.186687 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8189ac-849a-49c6-8042-5f2674cea27f admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:36.270496 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936c3be-7179-4118-ba62-fae875b82ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:36.271183 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936c3be-7179-4118-ba62-fae875b82ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:36.271472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936c3be-7179-4118-ba62-fae875b82ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:36.271753 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936c3be-7179-4118-ba62-fae875b82ef6 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:36.272856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936c3be-7179-4118-ba62-fae875b82ef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:36.274819 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936c3be-7179-4118-ba62-fae875b82ef6 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:36.309545 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1288/2569] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:36 2022] POST /identity/v3/users => generated 297 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:36.313737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece03107-b141-4df5-8e7b-309df3247ccd admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:36.330641 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece03107-b141-4df5-8e7b-309df3247ccd admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:36.337864 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b951df-17a1-4318-b31c-d2099cf8faa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:36.339038 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b951df-17a1-4318-b31c-d2099cf8faa3 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:36.339683 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b951df-17a1-4318-b31c-d2099cf8faa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:36.340155 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b951df-17a1-4318-b31c-d2099cf8faa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:36.342042 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b951df-17a1-4318-b31c-d2099cf8faa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:36.343940 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b951df-17a1-4318-b31c-d2099cf8faa3 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:36.378131 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1282/2570] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:36.382318 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936c3be-7179-4118-ba62-fae875b82ef6 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:36.396903 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936c3be-7179-4118-ba62-fae875b82ef6 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:36.403312 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0c331-aa7a-45ab-94a8-595c244ec328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:36.404222 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0c331-aa7a-45ab-94a8-595c244ec328 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:36.404704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0c331-aa7a-45ab-94a8-595c244ec328 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:36.405128 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0c331-aa7a-45ab-94a8-595c244ec328 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:36.406052 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0c331-aa7a-45ab-94a8-595c244ec328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:36.408057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0c331-aa7a-45ab-94a8-595c244ec328 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:36.427254 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1289/2571] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:36.440199 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b951df-17a1-4318-b31c-d2099cf8faa3 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:36.453412 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b951df-17a1-4318-b31c-d2099cf8faa3 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:36.458900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4979c8-c3ce-4266-a8e5-2f6ceb691f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:36.459800 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4979c8-c3ce-4266-a8e5-2f6ceb691f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:36.460083 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4979c8-c3ce-4266-a8e5-2f6ceb691f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:36.460359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4979c8-c3ce-4266-a8e5-2f6ceb691f1d admin admin] PATH_INFO: `/v3/projects/e130640db45245caa679ebaefee40e63/users/107d359903384d7c8ecf7845c0ff4a87/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:36.479976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4979c8-c3ce-4266-a8e5-2f6ceb691f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e130640db45245caa679ebaefee40e63, user_id=107d359903384d7c8ecf7845c0ff4a87, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:36.483356 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4979c8-c3ce-4266-a8e5-2f6ceb691f1d admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:36.499213 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1283/2572] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:36 2022] PUT /identity/v3/projects/e130640db45245caa679ebaefee40e63/users/107d359903384d7c8ecf7845c0ff4a87/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:36.510482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c7497-141e-433c-bdc9-1a19d4119c03 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:36.510780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c7497-141e-433c-bdc9-1a19d4119c03 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:36.511067 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c7497-141e-433c-bdc9-1a19d4119c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:36.539139 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-e67c7497-141e-433c-bdc9-1a19d4119c03 None None] MFA Rules not processed for user `107d359903384d7c8ecf7845c0ff4a87`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:36.540738 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e67c7497-141e-433c-bdc9-1a19d4119c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:36.545632 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:36.615007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1290/2573] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:36.619396 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4979c8-c3ce-4266-a8e5-2f6ceb691f1d admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:36.653046 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:36.693795 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4979c8-c3ce-4266-a8e5-2f6ceb691f1d admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:36.698388 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994d4a3-c32e-47b6-9212-6ba01bca3ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:36.699038 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994d4a3-c32e-47b6-9212-6ba01bca3ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:36.699316 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994d4a3-c32e-47b6-9212-6ba01bca3ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:36.699589 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994d4a3-c32e-47b6-9212-6ba01bca3ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:36.700267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994d4a3-c32e-47b6-9212-6ba01bca3ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:36.702264 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994d4a3-c32e-47b6-9212-6ba01bca3ea6 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:36.727318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1284/2574] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:36 2022] POST /identity/v3/projects => generated 391 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:36.731450 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c7497-141e-433c-bdc9-1a19d4119c03 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:36.743149 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c7497-141e-433c-bdc9-1a19d4119c03 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:36.804645 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb19c32-ecc6-462b-a409-6813c907e57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:36.805226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb19c32-ecc6-462b-a409-6813c907e57b admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:36.805535 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb19c32-ecc6-462b-a409-6813c907e57b admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:36.805816 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb19c32-ecc6-462b-a409-6813c907e57b admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:36.806524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb19c32-ecc6-462b-a409-6813c907e57b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:36.808461 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb19c32-ecc6-462b-a409-6813c907e57b admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:36.832112 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1291/2575] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:36 2022] POST /identity/v3/users => generated 302 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:36.836906 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994d4a3-c32e-47b6-9212-6ba01bca3ea6 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:36.848279 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994d4a3-c32e-47b6-9212-6ba01bca3ea6 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:36.853102 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8114d-8bc9-4a7a-b762-9c35b658fc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:36.853887 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8114d-8bc9-4a7a-b762-9c35b658fc08 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:36.854256 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8114d-8bc9-4a7a-b762-9c35b658fc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:36.854686 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8114d-8bc9-4a7a-b762-9c35b658fc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:36.855489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8114d-8bc9-4a7a-b762-9c35b658fc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:36.857170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8114d-8bc9-4a7a-b762-9c35b658fc08 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:36.869806 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1285/2576] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:36.874236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb19c32-ecc6-462b-a409-6813c907e57b admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:36.884956 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb19c32-ecc6-462b-a409-6813c907e57b admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:36.889869 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358ea42-6bec-4e00-ab77-bd7516635311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:36.890776 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358ea42-6bec-4e00-ab77-bd7516635311 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:36.891059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358ea42-6bec-4e00-ab77-bd7516635311 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:36.891366 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358ea42-6bec-4e00-ab77-bd7516635311 admin admin] PATH_INFO: `/v3/projects/81d2243cc64e40e089e4d2b16a3d9ae3/users/036763ebceea4a159d4159425db6d05a/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:36.909890 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358ea42-6bec-4e00-ab77-bd7516635311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d2243cc64e40e089e4d2b16a3d9ae3, user_id=036763ebceea4a159d4159425db6d05a, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:36.912682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358ea42-6bec-4e00-ab77-bd7516635311 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:36.927776 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1292/2577] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:36 2022] PUT /identity/v3/projects/81d2243cc64e40e089e4d2b16a3d9ae3/users/036763ebceea4a159d4159425db6d05a/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:36.931792 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8114d-8bc9-4a7a-b762-9c35b658fc08 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:36.942198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8114d-8bc9-4a7a-b762-9c35b658fc08 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:37.002179 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2b385-c40c-44ee-9bd2-c3dd56bcb193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:37.003534 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2b385-c40c-44ee-9bd2-c3dd56bcb193 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:37.003824 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2b385-c40c-44ee-9bd2-c3dd56bcb193 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:37.004107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2b385-c40c-44ee-9bd2-c3dd56bcb193 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:37.004843 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2b385-c40c-44ee-9bd2-c3dd56bcb193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:37.006492 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2b385-c40c-44ee-9bd2-c3dd56bcb193 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:37.017034 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1286/2578] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:37.021027 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358ea42-6bec-4e00-ab77-bd7516635311 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:37.036524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358ea42-6bec-4e00-ab77-bd7516635311 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:37.042825 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376809c0-75b1-4af4-a2e4-0bb228f29286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:37.043727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376809c0-75b1-4af4-a2e4-0bb228f29286 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:37.044162 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376809c0-75b1-4af4-a2e4-0bb228f29286 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:37.044447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376809c0-75b1-4af4-a2e4-0bb228f29286 admin admin] PATH_INFO: `/v3/projects/81d2243cc64e40e089e4d2b16a3d9ae3/users/036763ebceea4a159d4159425db6d05a/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:37.047191 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376809c0-75b1-4af4-a2e4-0bb228f29286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d2243cc64e40e089e4d2b16a3d9ae3, user_id=036763ebceea4a159d4159425db6d05a, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:37.049922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376809c0-75b1-4af4-a2e4-0bb228f29286 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:37.061770 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1293/2579] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:37 2022] PUT /identity/v3/projects/81d2243cc64e40e089e4d2b16a3d9ae3/users/036763ebceea4a159d4159425db6d05a/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:37.072559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf424c-5f5c-43ca-b00e-b7be9fde6b55 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:37.072887 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf424c-5f5c-43ca-b00e-b7be9fde6b55 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:37.073128 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf424c-5f5c-43ca-b00e-b7be9fde6b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:37.112819 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-6cbf424c-5f5c-43ca-b00e-b7be9fde6b55 None None] MFA Rules not processed for user `036763ebceea4a159d4159425db6d05a`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:37.114134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6cbf424c-5f5c-43ca-b00e-b7be9fde6b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:37.190831 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1287/2580] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:37 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:37.202531 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376809c0-75b1-4af4-a2e4-0bb228f29286 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:37.204710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-376809c0-75b1-4af4-a2e4-0bb228f29286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:37.283005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376809c0-75b1-4af4-a2e4-0bb228f29286 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:37.286961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba570a73-2f3d-4375-8dda-3f61d92a4411 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:37.287611 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba570a73-2f3d-4375-8dda-3f61d92a4411 service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:37.287907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba570a73-2f3d-4375-8dda-3f61d92a4411 service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:37.288169 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba570a73-2f3d-4375-8dda-3f61d92a4411 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:37.300621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba570a73-2f3d-4375-8dda-3f61d92a4411 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:37.302246 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba570a73-2f3d-4375-8dda-3f61d92a4411 service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:37.308242 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:37.323733 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1294/2581] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:37.378055 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf424c-5f5c-43ca-b00e-b7be9fde6b55 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:37.379507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6cbf424c-5f5c-43ca-b00e-b7be9fde6b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:37.393496 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf424c-5f5c-43ca-b00e-b7be9fde6b55 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:37.397452 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490fe63-0242-47e6-b686-754357a3e00b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:37.398097 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490fe63-0242-47e6-b686-754357a3e00b service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:37.398383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490fe63-0242-47e6-b686-754357a3e00b service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:37.398658 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490fe63-0242-47e6-b686-754357a3e00b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:37.421984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:37.486784 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490fe63-0242-47e6-b686-754357a3e00b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:37.489358 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490fe63-0242-47e6-b686-754357a3e00b service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:37.514197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1288/2582] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:39.302069 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba570a73-2f3d-4375-8dda-3f61d92a4411 service cinder] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:39.304353 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ba570a73-2f3d-4375-8dda-3f61d92a4411 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:39.372518 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490fe63-0242-47e6-b686-754357a3e00b service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:39.376519 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-0490fe63-0242-47e6-b686-754357a3e00b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:39.404690 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba570a73-2f3d-4375-8dda-3f61d92a4411 service cinder] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:39.409871 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931beedb-0c28-41df-a91e-fbd54c29c287 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0db68b7fda4da29eb13689f3fd7b5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:39.410522 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931beedb-0c28-41df-a91e-fbd54c29c287 service placement] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:39.410809 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931beedb-0c28-41df-a91e-fbd54c29c287 service placement] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:39.411090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931beedb-0c28-41df-a91e-fbd54c29c287 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:39.413012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-931beedb-0c28-41df-a91e-fbd54c29c287 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:39.427655 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931beedb-0c28-41df-a91e-fbd54c29c287 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:39.429898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931beedb-0c28-41df-a91e-fbd54c29c287 service placement] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:39.442671 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1295/2583] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:39.463832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490fe63-0242-47e6-b686-754357a3e00b service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:39.470704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613c9cb-80b8-4b1e-a940-633c5eb8a64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:39.475790 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613c9cb-80b8-4b1e-a940-633c5eb8a64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:39.476282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613c9cb-80b8-4b1e-a940-633c5eb8a64d admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:39.476614 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613c9cb-80b8-4b1e-a940-633c5eb8a64d admin admin] PATH_INFO: `/v3/users/000330dc3f1a4b38b58686ee37b3b78c` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:39.478032 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613c9cb-80b8-4b1e-a940-633c5eb8a64d admin admin] RBAC: Authorizing `identity:delete_user(user_id=000330dc3f1a4b38b58686ee37b3b78c)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:39.480170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613c9cb-80b8-4b1e-a940-633c5eb8a64d admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:39.532236 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6613c9cb-80b8-4b1e-a940-633c5eb8a64d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '000330dc3f1a4b38b58686ee37b3b78c'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:39.544111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6613c9cb-80b8-4b1e-a940-633c5eb8a64d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '000330dc3f1a4b38b58686ee37b3b78c'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:39.545645 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6613c9cb-80b8-4b1e-a940-633c5eb8a64d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '000330dc3f1a4b38b58686ee37b3b78c'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:39.546360 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6613c9cb-80b8-4b1e-a940-633c5eb8a64d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '000330dc3f1a4b38b58686ee37b3b78c'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:39.554018 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6613c9cb-80b8-4b1e-a940-633c5eb8a64d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '000330dc3f1a4b38b58686ee37b3b78c'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:39.568893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1289/2584] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:39 2022] DELETE /identity/v3/users/000330dc3f1a4b38b58686ee37b3b78c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:39.746677 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931beedb-0c28-41df-a91e-fbd54c29c287 service placement] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:39.758235 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931beedb-0c28-41df-a91e-fbd54c29c287 service placement] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:39.822924 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07c371-4c8d-4c70-af0e-d1375aadbc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:39.824079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07c371-4c8d-4c70-af0e-d1375aadbc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:39.824352 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07c371-4c8d-4c70-af0e-d1375aadbc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:39.824630 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07c371-4c8d-4c70-af0e-d1375aadbc0f admin admin] PATH_INFO: `/v3/projects/8ae6a45905d645b4b5da8bfa917955a6` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:39.825836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07c371-4c8d-4c70-af0e-d1375aadbc0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae6a45905d645b4b5da8bfa917955a6)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:39.827782 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07c371-4c8d-4c70-af0e-d1375aadbc0f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:39.877530 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cb07c371-4c8d-4c70-af0e-d1375aadbc0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae6a45905d645b4b5da8bfa917955a6', 'request_id': 'req-cb07c371-4c8d-4c70-af0e-d1375aadbc0f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:39.883897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cb07c371-4c8d-4c70-af0e-d1375aadbc0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae6a45905d645b4b5da8bfa917955a6', 'request_id': 'req-cb07c371-4c8d-4c70-af0e-d1375aadbc0f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:39.891798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cb07c371-4c8d-4c70-af0e-d1375aadbc0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae6a45905d645b4b5da8bfa917955a6', 'request_id': 'req-cb07c371-4c8d-4c70-af0e-d1375aadbc0f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:39.902022 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cb07c371-4c8d-4c70-af0e-d1375aadbc0f admin admin] The token cache is being invalidate because project 8ae6a45905d645b4b5da8bfa917955a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:39.902306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cb07c371-4c8d-4c70-af0e-d1375aadbc0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:39.902919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cb07c371-4c8d-4c70-af0e-d1375aadbc0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:39.904962 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1296/2585] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:39 2022] DELETE /identity/v3/projects/8ae6a45905d645b4b5da8bfa917955a6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:39.909916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37100a-32ee-4025-9e29-72d4ec37bb50 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:39.910206 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37100a-32ee-4025-9e29-72d4ec37bb50 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:39.910533 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37100a-32ee-4025-9e29-72d4ec37bb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:39.936138 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-2a37100a-32ee-4025-9e29-72d4ec37bb50 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:39.937381 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-2a37100a-32ee-4025-9e29-72d4ec37bb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:39.977826 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:40.002046 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1290/2586] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:40.011622 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09332d-320f-4cfa-970f-3b0f24d8f5eb None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:40.012045 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09332d-320f-4cfa-970f-3b0f24d8f5eb None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:40.012400 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09332d-320f-4cfa-970f-3b0f24d8f5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:40.032335 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-dd09332d-320f-4cfa-970f-3b0f24d8f5eb None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:40.033633 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-dd09332d-320f-4cfa-970f-3b0f24d8f5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:40.042009 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1297/2587] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:40.046062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37100a-32ee-4025-9e29-72d4ec37bb50 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:40.056228 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37100a-32ee-4025-9e29-72d4ec37bb50 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:40.060938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e50250-a3cd-41d2-a787-b5492469deb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:40.061656 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e50250-a3cd-41d2-a787-b5492469deb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:40.061940 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e50250-a3cd-41d2-a787-b5492469deb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:40.062213 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e50250-a3cd-41d2-a787-b5492469deb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:40.062984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e50250-a3cd-41d2-a787-b5492469deb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:00:40.063288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e50250-a3cd-41d2-a787-b5492469deb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:40.064914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e50250-a3cd-41d2-a787-b5492469deb1 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:40.077455 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1291/2588] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:00:40.081857 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09332d-320f-4cfa-970f-3b0f24d8f5eb None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:40.091023 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09332d-320f-4cfa-970f-3b0f24d8f5eb None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:40.096243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ab211-6bec-4ef8-8a74-9432477b4318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:40.096888 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ab211-6bec-4ef8-8a74-9432477b4318 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:40.097172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ab211-6bec-4ef8-8a74-9432477b4318 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:40.097481 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ab211-6bec-4ef8-8a74-9432477b4318 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:40.098203 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ab211-6bec-4ef8-8a74-9432477b4318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:40.100084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ab211-6bec-4ef8-8a74-9432477b4318 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:40.109859 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:40.127103 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1298/2589] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:40 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:40.131370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e50250-a3cd-41d2-a787-b5492469deb1 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:40.142240 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e50250-a3cd-41d2-a787-b5492469deb1 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:40.207598 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddd5b3-39ad-4192-a0a4-250331e460c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:40.208289 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddd5b3-39ad-4192-a0a4-250331e460c0 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:40.208639 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddd5b3-39ad-4192-a0a4-250331e460c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:40.208987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddd5b3-39ad-4192-a0a4-250331e460c0 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:40.209929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddd5b3-39ad-4192-a0a4-250331e460c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:40.212057 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddd5b3-39ad-4192-a0a4-250331e460c0 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:40.237610 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1292/2590] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:40 2022] POST /identity/v3/users => generated 283 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:40.242277 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ab211-6bec-4ef8-8a74-9432477b4318 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:40.253541 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ab211-6bec-4ef8-8a74-9432477b4318 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:40.260152 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12703ce-0a45-493e-affc-af0537e5cae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:40.260822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12703ce-0a45-493e-affc-af0537e5cae0 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:40.261192 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12703ce-0a45-493e-affc-af0537e5cae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:40.261507 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12703ce-0a45-493e-affc-af0537e5cae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:40.262999 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12703ce-0a45-493e-affc-af0537e5cae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:40.265326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12703ce-0a45-493e-affc-af0537e5cae0 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:40.281080 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1299/2591] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:40.282325 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddd5b3-39ad-4192-a0a4-250331e460c0 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:40.293526 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddd5b3-39ad-4192-a0a4-250331e460c0 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:40.299507 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b273e9c-6597-48da-b339-85f41cacab99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:40.300332 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b273e9c-6597-48da-b339-85f41cacab99 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:40.300624 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b273e9c-6597-48da-b339-85f41cacab99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:40.300905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b273e9c-6597-48da-b339-85f41cacab99 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:40.302452 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b273e9c-6597-48da-b339-85f41cacab99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:40.304659 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b273e9c-6597-48da-b339-85f41cacab99 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:40.320900 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1293/2592] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:40.325140 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12703ce-0a45-493e-affc-af0537e5cae0 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:40.345221 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12703ce-0a45-493e-affc-af0537e5cae0 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:40.351394 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad50eb1-78ef-4618-b057-57f934cc0fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:40.352411 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad50eb1-78ef-4618-b057-57f934cc0fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:40.352765 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad50eb1-78ef-4618-b057-57f934cc0fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:40.353151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad50eb1-78ef-4618-b057-57f934cc0fd5 admin admin] PATH_INFO: `/v3/projects/04c3912b6b37491595f1e63ed729e64c/users/7a470c6f90964cc3a01ee2227cddc108/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:40.374617 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad50eb1-78ef-4618-b057-57f934cc0fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c3912b6b37491595f1e63ed729e64c, user_id=7a470c6f90964cc3a01ee2227cddc108, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:40.377559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad50eb1-78ef-4618-b057-57f934cc0fd5 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:40.394874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1300/2593] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:40 2022] PUT /identity/v3/projects/04c3912b6b37491595f1e63ed729e64c/users/7a470c6f90964cc3a01ee2227cddc108/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:40.404860 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240d4b6-8c5c-4344-a5b4-837f81766a1c None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:40.405328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240d4b6-8c5c-4344-a5b4-837f81766a1c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:40.405440 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240d4b6-8c5c-4344-a5b4-837f81766a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:40.437207 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a240d4b6-8c5c-4344-a5b4-837f81766a1c None None] MFA Rules not processed for user `7a470c6f90964cc3a01ee2227cddc108`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:40.438490 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a240d4b6-8c5c-4344-a5b4-837f81766a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:40.507263 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1294/2594] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:40.511688 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad50eb1-78ef-4618-b057-57f934cc0fd5 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:40.586232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad50eb1-78ef-4618-b057-57f934cc0fd5 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:40.591223 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6a491-6e52-4f34-954f-20ad8d12ed36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:40.591986 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6a491-6e52-4f34-954f-20ad8d12ed36 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:40.592335 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6a491-6e52-4f34-954f-20ad8d12ed36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:40.592676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6a491-6e52-4f34-954f-20ad8d12ed36 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:40.593680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6a491-6e52-4f34-954f-20ad8d12ed36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:40.596015 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6a491-6e52-4f34-954f-20ad8d12ed36 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:40.626071 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1301/2595] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:40 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:40.630314 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240d4b6-8c5c-4344-a5b4-837f81766a1c None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:40.641752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240d4b6-8c5c-4344-a5b4-837f81766a1c None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:40.693584 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:40.719460 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef340b74-586a-401d-a639-f4362c36d944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:40.720118 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef340b74-586a-401d-a639-f4362c36d944 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:40.720436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef340b74-586a-401d-a639-f4362c36d944 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:40.720712 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef340b74-586a-401d-a639-f4362c36d944 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:40.721437 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef340b74-586a-401d-a639-f4362c36d944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:40.723353 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef340b74-586a-401d-a639-f4362c36d944 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:40.743150 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1295/2596] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:40 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:40.747117 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6a491-6e52-4f34-954f-20ad8d12ed36 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:40.757908 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6a491-6e52-4f34-954f-20ad8d12ed36 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:40.762463 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78614f-6df3-4716-ba3a-70543b130bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:40.763230 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78614f-6df3-4716-ba3a-70543b130bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:40.764094 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78614f-6df3-4716-ba3a-70543b130bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:40.764378 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78614f-6df3-4716-ba3a-70543b130bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:40.765096 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78614f-6df3-4716-ba3a-70543b130bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:40.767619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78614f-6df3-4716-ba3a-70543b130bd3 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:40.779047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1302/2597] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:40.783440 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef340b74-586a-401d-a639-f4362c36d944 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:40.793611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef340b74-586a-401d-a639-f4362c36d944 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:40.798901 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e19c8d-e5b5-4980-89b8-62470d7a2431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:40.799781 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e19c8d-e5b5-4980-89b8-62470d7a2431 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:40.800062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e19c8d-e5b5-4980-89b8-62470d7a2431 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:40.800333 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e19c8d-e5b5-4980-89b8-62470d7a2431 admin admin] PATH_INFO: `/v3/projects/02666af8782a45b086c87ca7eb06978c/users/e1394253a64240b590838401cbd78eb0/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:40.816001 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e19c8d-e5b5-4980-89b8-62470d7a2431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02666af8782a45b086c87ca7eb06978c, user_id=e1394253a64240b590838401cbd78eb0, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:40.818711 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e19c8d-e5b5-4980-89b8-62470d7a2431 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:40.833053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1296/2598] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:40 2022] PUT /identity/v3/projects/02666af8782a45b086c87ca7eb06978c/users/e1394253a64240b590838401cbd78eb0/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:40.837103 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78614f-6df3-4716-ba3a-70543b130bd3 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:40.849773 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78614f-6df3-4716-ba3a-70543b130bd3 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:40.914399 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538d0d3-eaf9-4fa1-b90a-28708d5ccd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:40.915039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538d0d3-eaf9-4fa1-b90a-28708d5ccd0a admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:40.915322 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538d0d3-eaf9-4fa1-b90a-28708d5ccd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:40.915601 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538d0d3-eaf9-4fa1-b90a-28708d5ccd0a admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:40.916318 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538d0d3-eaf9-4fa1-b90a-28708d5ccd0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:40.917925 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538d0d3-eaf9-4fa1-b90a-28708d5ccd0a admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:40.930657 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1303/2599] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:40.934804 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e19c8d-e5b5-4980-89b8-62470d7a2431 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:40.945586 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e19c8d-e5b5-4980-89b8-62470d7a2431 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:40.950177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751a584-77bf-4c53-b81b-8abd61296d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:40.951053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751a584-77bf-4c53-b81b-8abd61296d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:40.951334 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751a584-77bf-4c53-b81b-8abd61296d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:40.951610 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751a584-77bf-4c53-b81b-8abd61296d1b admin admin] PATH_INFO: `/v3/projects/02666af8782a45b086c87ca7eb06978c/users/e1394253a64240b590838401cbd78eb0/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:40.953626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751a584-77bf-4c53-b81b-8abd61296d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=02666af8782a45b086c87ca7eb06978c, user_id=e1394253a64240b590838401cbd78eb0, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:40.956222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751a584-77bf-4c53-b81b-8abd61296d1b admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:40.967190 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1297/2600] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:40 2022] PUT /identity/v3/projects/02666af8782a45b086c87ca7eb06978c/users/e1394253a64240b590838401cbd78eb0/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:40.978549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e909e6-eeb1-48a6-b911-535442e7597e None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:40.978765 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e909e6-eeb1-48a6-b911-535442e7597e None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:40.979069 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e909e6-eeb1-48a6-b911-535442e7597e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:41.009348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-57e909e6-eeb1-48a6-b911-535442e7597e None None] MFA Rules not processed for user `e1394253a64240b590838401cbd78eb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:41.010686 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-57e909e6-eeb1-48a6-b911-535442e7597e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:41.025840 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:41.064171 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751a584-77bf-4c53-b81b-8abd61296d1b admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:41.065923 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-7751a584-77bf-4c53-b81b-8abd61296d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:41.087374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1304/2601] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:40 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:41.098720 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e909e6-eeb1-48a6-b911-535442e7597e None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:41.100122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-57e909e6-eeb1-48a6-b911-535442e7597e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:41.131572 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751a584-77bf-4c53-b81b-8abd61296d1b admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:41.136288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd5cca-5478-4f80-8f8a-23ee33d9b4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:41.137174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd5cca-5478-4f80-8f8a-23ee33d9b4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:41.137491 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd5cca-5478-4f80-8f8a-23ee33d9b4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:41.137765 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd5cca-5478-4f80-8f8a-23ee33d9b4fb admin admin] PATH_INFO: `/v3/users/107d359903384d7c8ecf7845c0ff4a87` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:41.139109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd5cca-5478-4f80-8f8a-23ee33d9b4fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=107d359903384d7c8ecf7845c0ff4a87)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:41.141073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd5cca-5478-4f80-8f8a-23ee33d9b4fb admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:41.158909 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e909e6-eeb1-48a6-b911-535442e7597e None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:41.163334 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a5675-e724-4264-8ed7-b5bb2998fd5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:41.164074 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a5675-e724-4264-8ed7-b5bb2998fd5e service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:41.164368 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a5675-e724-4264-8ed7-b5bb2998fd5e service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:41.165046 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a5675-e724-4264-8ed7-b5bb2998fd5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:41.177118 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a5675-e724-4264-8ed7-b5bb2998fd5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:41.178570 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a5675-e724-4264-8ed7-b5bb2998fd5e service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:41.187917 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1305/2602] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:41 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 14:00:41.190579 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6ebd5cca-5478-4f80-8f8a-23ee33d9b4fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '107d359903384d7c8ecf7845c0ff4a87'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:41.203527 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6ebd5cca-5478-4f80-8f8a-23ee33d9b4fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '107d359903384d7c8ecf7845c0ff4a87'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:41.204257 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6ebd5cca-5478-4f80-8f8a-23ee33d9b4fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '107d359903384d7c8ecf7845c0ff4a87'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:41.205019 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6ebd5cca-5478-4f80-8f8a-23ee33d9b4fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '107d359903384d7c8ecf7845c0ff4a87'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:41.212208 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-6ebd5cca-5478-4f80-8f8a-23ee33d9b4fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '107d359903384d7c8ecf7845c0ff4a87'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:41.229451 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1298/2603] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:41 2022] DELETE /identity/v3/users/107d359903384d7c8ecf7845c0ff4a87 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:41.234411 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5a471-e353-457f-8a43-d464414ba4d7 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:41.234699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5a471-e353-457f-8a43-d464414ba4d7 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:41.234970 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5a471-e353-457f-8a43-d464414ba4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:41.253771 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-e2a5a471-e353-457f-8a43-d464414ba4d7 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:41.254971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e2a5a471-e353-457f-8a43-d464414ba4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:41.317550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1306/2604] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:41.327436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd5cca-5478-4f80-8f8a-23ee33d9b4fb admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:41.328851 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6ebd5cca-5478-4f80-8f8a-23ee33d9b4fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:41.340579 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:41.400813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd5cca-5478-4f80-8f8a-23ee33d9b4fb admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:41.405531 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07e796-5441-4747-9ef7-d541c01f287d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:41.406228 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07e796-5441-4747-9ef7-d541c01f287d service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:41.406457 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07e796-5441-4747-9ef7-d541c01f287d service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:41.406744 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07e796-5441-4747-9ef7-d541c01f287d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:41.418006 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07e796-5441-4747-9ef7-d541c01f287d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:41.419453 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07e796-5441-4747-9ef7-d541c01f287d service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:41.429866 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1299/2605] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:41.660728 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5a471-e353-457f-8a43-d464414ba4d7 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:41.662374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e2a5a471-e353-457f-8a43-d464414ba4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:41.683448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5a471-e353-457f-8a43-d464414ba4d7 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:41.732584 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10dd44-54f8-45fa-87fb-34762eee6bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:41.738016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10dd44-54f8-45fa-87fb-34762eee6bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:41.738646 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10dd44-54f8-45fa-87fb-34762eee6bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:41.738962 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10dd44-54f8-45fa-87fb-34762eee6bf7 admin admin] PATH_INFO: `/v3/users/7a470c6f90964cc3a01ee2227cddc108` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:41.740826 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10dd44-54f8-45fa-87fb-34762eee6bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a470c6f90964cc3a01ee2227cddc108)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:41.743183 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10dd44-54f8-45fa-87fb-34762eee6bf7 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:41.765952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07e796-5441-4747-9ef7-d541c01f287d service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:41.767382 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-4d07e796-5441-4747-9ef7-d541c01f287d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:41.791560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07e796-5441-4747-9ef7-d541c01f287d service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:41.807393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85bf91-29e6-4642-97f5-23f8cbbe8d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:41.808522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85bf91-29e6-4642-97f5-23f8cbbe8d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:41.808915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85bf91-29e6-4642-97f5-23f8cbbe8d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:41.809175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85bf91-29e6-4642-97f5-23f8cbbe8d87 admin admin] PATH_INFO: `/v3/projects/e130640db45245caa679ebaefee40e63` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:41.810899 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85bf91-29e6-4642-97f5-23f8cbbe8d87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e130640db45245caa679ebaefee40e63)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:41.813088 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85bf91-29e6-4642-97f5-23f8cbbe8d87 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:41.859182 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8b10dd44-54f8-45fa-87fb-34762eee6bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a470c6f90964cc3a01ee2227cddc108'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:41.859862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8b10dd44-54f8-45fa-87fb-34762eee6bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a470c6f90964cc3a01ee2227cddc108'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:41.861792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8b10dd44-54f8-45fa-87fb-34762eee6bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a470c6f90964cc3a01ee2227cddc108'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:41.863704 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:41.881434 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8b10dd44-54f8-45fa-87fb-34762eee6bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a470c6f90964cc3a01ee2227cddc108'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:41.900984 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8b10dd44-54f8-45fa-87fb-34762eee6bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a470c6f90964cc3a01ee2227cddc108'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:41.911700 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-9f85bf91-29e6-4642-97f5-23f8cbbe8d87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e130640db45245caa679ebaefee40e63', 'request_id': 'req-9f85bf91-29e6-4642-97f5-23f8cbbe8d87'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:41.924893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-9f85bf91-29e6-4642-97f5-23f8cbbe8d87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e130640db45245caa679ebaefee40e63', 'request_id': 'req-9f85bf91-29e6-4642-97f5-23f8cbbe8d87'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:41.932691 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-9f85bf91-29e6-4642-97f5-23f8cbbe8d87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e130640db45245caa679ebaefee40e63', 'request_id': 'req-9f85bf91-29e6-4642-97f5-23f8cbbe8d87'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:41.938412 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1307/2606] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:41 2022] DELETE /identity/v3/users/7a470c6f90964cc3a01ee2227cddc108 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:41.940343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15384e29-dd38-470e-98fd-f23b7e9480a1 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:41.940863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15384e29-dd38-470e-98fd-f23b7e9480a1 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:41.940988 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15384e29-dd38-470e-98fd-f23b7e9480a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:41.955420 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-9f85bf91-29e6-4642-97f5-23f8cbbe8d87 admin admin] The token cache is being invalidate because project e130640db45245caa679ebaefee40e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:41.956094 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-9f85bf91-29e6-4642-97f5-23f8cbbe8d87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:41.956989 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-9f85bf91-29e6-4642-97f5-23f8cbbe8d87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:41.961504 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1300/2607] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:41 2022] DELETE /identity/v3/projects/e130640db45245caa679ebaefee40e63 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:41.961861 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-15384e29-dd38-470e-98fd-f23b7e9480a1 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:41.963104 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-15384e29-dd38-470e-98fd-f23b7e9480a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:41.967397 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85bf91-29e6-4642-97f5-23f8cbbe8d87 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:41.971257 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9f85bf91-29e6-4642-97f5-23f8cbbe8d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:42.053314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1308/2608] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:42.062187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15384e29-dd38-470e-98fd-f23b7e9480a1 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:42.063767 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-15384e29-dd38-470e-98fd-f23b7e9480a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:42.080945 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85bf91-29e6-4642-97f5-23f8cbbe8d87 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:42.086733 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840648ab-4825-4124-b407-ed44f5eca762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:42.087506 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840648ab-4825-4124-b407-ed44f5eca762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:42.087785 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840648ab-4825-4124-b407-ed44f5eca762 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:42.088059 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840648ab-4825-4124-b407-ed44f5eca762 admin admin] PATH_INFO: `/v3/users/036763ebceea4a159d4159425db6d05a` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:42.089403 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840648ab-4825-4124-b407-ed44f5eca762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=036763ebceea4a159d4159425db6d05a)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:42.091606 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840648ab-4825-4124-b407-ed44f5eca762 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:42.135104 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15384e29-dd38-470e-98fd-f23b7e9480a1 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:42.140982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b53849-cb78-4f4b-b309-c7ce2ec8567f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:42.141752 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b53849-cb78-4f4b-b309-c7ce2ec8567f service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:42.142041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b53849-cb78-4f4b-b309-c7ce2ec8567f service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:42.142428 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b53849-cb78-4f4b-b309-c7ce2ec8567f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:42.146209 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:42.153652 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b53849-cb78-4f4b-b309-c7ce2ec8567f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:42.155379 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b53849-cb78-4f4b-b309-c7ce2ec8567f service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:42.156146 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-840648ab-4825-4124-b407-ed44f5eca762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036763ebceea4a159d4159425db6d05a'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.166325 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1309/2609] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:42.180782 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-840648ab-4825-4124-b407-ed44f5eca762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036763ebceea4a159d4159425db6d05a'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.182186 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-840648ab-4825-4124-b407-ed44f5eca762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036763ebceea4a159d4159425db6d05a'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.183372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-840648ab-4825-4124-b407-ed44f5eca762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036763ebceea4a159d4159425db6d05a'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.194810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-840648ab-4825-4124-b407-ed44f5eca762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036763ebceea4a159d4159425db6d05a'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.215372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1301/2610] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:41 2022] DELETE /identity/v3/users/036763ebceea4a159d4159425db6d05a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:42.534905 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b53849-cb78-4f4b-b309-c7ce2ec8567f service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:42.536435 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-10b53849-cb78-4f4b-b309-c7ce2ec8567f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:42.550369 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b53849-cb78-4f4b-b309-c7ce2ec8567f service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:42.591100 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840648ab-4825-4124-b407-ed44f5eca762 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:42.593140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-840648ab-4825-4124-b407-ed44f5eca762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:42.644595 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a530a12-065f-48d8-89bc-9e0ba62e13ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:42.645495 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a530a12-065f-48d8-89bc-9e0ba62e13ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:42.645885 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a530a12-065f-48d8-89bc-9e0ba62e13ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:42.646150 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a530a12-065f-48d8-89bc-9e0ba62e13ff admin admin] PATH_INFO: `/v3/projects/04c3912b6b37491595f1e63ed729e64c` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:42.647329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a530a12-065f-48d8-89bc-9e0ba62e13ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=04c3912b6b37491595f1e63ed729e64c)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:42.649375 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a530a12-065f-48d8-89bc-9e0ba62e13ff admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:42.662869 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:42.688696 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840648ab-4825-4124-b407-ed44f5eca762 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:42.703997 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3a530a12-065f-48d8-89bc-9e0ba62e13ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04c3912b6b37491595f1e63ed729e64c', 'request_id': 'req-3a530a12-065f-48d8-89bc-9e0ba62e13ff'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.710405 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3a530a12-065f-48d8-89bc-9e0ba62e13ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04c3912b6b37491595f1e63ed729e64c', 'request_id': 'req-3a530a12-065f-48d8-89bc-9e0ba62e13ff'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.719126 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3a530a12-065f-48d8-89bc-9e0ba62e13ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04c3912b6b37491595f1e63ed729e64c', 'request_id': 'req-3a530a12-065f-48d8-89bc-9e0ba62e13ff'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.733508 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3a530a12-065f-48d8-89bc-9e0ba62e13ff admin admin] The token cache is being invalidate because project 04c3912b6b37491595f1e63ed729e64c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:42.733808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3a530a12-065f-48d8-89bc-9e0ba62e13ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.734468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3a530a12-065f-48d8-89bc-9e0ba62e13ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.736441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1310/2611] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:42 2022] DELETE /identity/v3/projects/04c3912b6b37491595f1e63ed729e64c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:42.740734 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a530a12-065f-48d8-89bc-9e0ba62e13ff admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:42.743537 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-3a530a12-065f-48d8-89bc-9e0ba62e13ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:42.759769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a2158-424e-4393-82d4-434b7941fdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:42.760638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a2158-424e-4393-82d4-434b7941fdce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:42.760919 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a2158-424e-4393-82d4-434b7941fdce admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:42.761585 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a2158-424e-4393-82d4-434b7941fdce admin admin] PATH_INFO: `/v3/projects/81d2243cc64e40e089e4d2b16a3d9ae3` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:42.762432 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a2158-424e-4393-82d4-434b7941fdce admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d2243cc64e40e089e4d2b16a3d9ae3)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:42.764689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a2158-424e-4393-82d4-434b7941fdce admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:42.817707 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f37a2158-424e-4393-82d4-434b7941fdce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d2243cc64e40e089e4d2b16a3d9ae3', 'request_id': 'req-f37a2158-424e-4393-82d4-434b7941fdce'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.824139 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f37a2158-424e-4393-82d4-434b7941fdce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d2243cc64e40e089e4d2b16a3d9ae3', 'request_id': 'req-f37a2158-424e-4393-82d4-434b7941fdce'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.830692 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a530a12-065f-48d8-89bc-9e0ba62e13ff admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:42.830961 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f37a2158-424e-4393-82d4-434b7941fdce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d2243cc64e40e089e4d2b16a3d9ae3', 'request_id': 'req-f37a2158-424e-4393-82d4-434b7941fdce'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.832797 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:42.848840 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f37a2158-424e-4393-82d4-434b7941fdce admin admin] The token cache is being invalidate because project 81d2243cc64e40e089e4d2b16a3d9ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:42.849499 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f37a2158-424e-4393-82d4-434b7941fdce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.850141 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f37a2158-424e-4393-82d4-434b7941fdce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.852350 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1302/2612] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:42 2022] DELETE /identity/v3/projects/81d2243cc64e40e089e4d2b16a3d9ae3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:42.858906 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634c2cc-dcfd-49ad-a78c-b5f84336a8f3 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:42.859193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634c2cc-dcfd-49ad-a78c-b5f84336a8f3 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:42.859515 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634c2cc-dcfd-49ad-a78c-b5f84336a8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:42.879178 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-6634c2cc-dcfd-49ad-a78c-b5f84336a8f3 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:42.880380 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6634c2cc-dcfd-49ad-a78c-b5f84336a8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:42.899325 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f38de5-8bc0-4c59-8c71-cb482856759c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:42.899917 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38de5-8bc0-4c59-8c71-cb482856759c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:42.900206 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38de5-8bc0-4c59-8c71-cb482856759c admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:42.900484 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38de5-8bc0-4c59-8c71-cb482856759c admin admin] PATH_INFO: `/v3/users/e1394253a64240b590838401cbd78eb0` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:42.901763 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f38de5-8bc0-4c59-8c71-cb482856759c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1394253a64240b590838401cbd78eb0)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:42.903767 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f38de5-8bc0-4c59-8c71-cb482856759c admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:42.944449 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1303/2613] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:42.950625 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b5f38de5-8bc0-4c59-8c71-cb482856759c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1394253a64240b590838401cbd78eb0'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.951317 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b5f38de5-8bc0-4c59-8c71-cb482856759c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1394253a64240b590838401cbd78eb0'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.952027 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b5f38de5-8bc0-4c59-8c71-cb482856759c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1394253a64240b590838401cbd78eb0'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.953185 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a7c5d-b5c2-40b3-8a7c-4fb25466c739 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:42.953504 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a7c5d-b5c2-40b3-8a7c-4fb25466c739 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:42.953784 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a7c5d-b5c2-40b3-8a7c-4fb25466c739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:42.954096 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:42.960296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b5f38de5-8bc0-4c59-8c71-cb482856759c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1394253a64240b590838401cbd78eb0'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.968593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b5f38de5-8bc0-4c59-8c71-cb482856759c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1394253a64240b590838401cbd78eb0'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:42.972805 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-3c1a7c5d-b5c2-40b3-8a7c-4fb25466c739 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:42.974043 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-3c1a7c5d-b5c2-40b3-8a7c-4fb25466c739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:42.984872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1304/2614] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 14:00:42.989094 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a7c5d-b5c2-40b3-8a7c-4fb25466c739 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:42.993133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1311/2615] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:42 2022] DELETE /identity/v3/users/e1394253a64240b590838401cbd78eb0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:42.999390 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a7c5d-b5c2-40b3-8a7c-4fb25466c739 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:43.086124 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b75f1b-ae49-435d-b857-1f3bef2c4769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:43.086757 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75f1b-ae49-435d-b857-1f3bef2c4769 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:43.087092 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75f1b-ae49-435d-b857-1f3bef2c4769 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:43.087367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75f1b-ae49-435d-b857-1f3bef2c4769 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:43.088114 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b75f1b-ae49-435d-b857-1f3bef2c4769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:00:43.088427 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b75f1b-ae49-435d-b857-1f3bef2c4769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:43.090092 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b75f1b-ae49-435d-b857-1f3bef2c4769 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:43.103222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1305/2616] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:00:43.107981 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f38de5-8bc0-4c59-8c71-cb482856759c admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:43.140587 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f38de5-8bc0-4c59-8c71-cb482856759c admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:43.183045 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a06f7-6d08-46ed-b388-ea5255088d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:43.184283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a06f7-6d08-46ed-b388-ea5255088d2b admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:43.184511 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a06f7-6d08-46ed-b388-ea5255088d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:43.185362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a06f7-6d08-46ed-b388-ea5255088d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:43.185601 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a06f7-6d08-46ed-b388-ea5255088d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:43.187511 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a06f7-6d08-46ed-b388-ea5255088d2b admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:43.228693 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1312/2617] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:43 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:43.233040 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b75f1b-ae49-435d-b857-1f3bef2c4769 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:43.245212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b75f1b-ae49-435d-b857-1f3bef2c4769 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:43.319822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a06f7-6d08-46ed-b388-ea5255088d2b admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:43.321663 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-2a2a06f7-6d08-46ed-b388-ea5255088d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:43.331766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71686968-0d90-4abc-b282-16168075124b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:43.332463 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71686968-0d90-4abc-b282-16168075124b admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:43.332826 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71686968-0d90-4abc-b282-16168075124b admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:43.333705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71686968-0d90-4abc-b282-16168075124b admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:43.334414 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71686968-0d90-4abc-b282-16168075124b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:43.336732 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71686968-0d90-4abc-b282-16168075124b admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:43.380495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1306/2618] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:43 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:43.383628 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71686968-0d90-4abc-b282-16168075124b admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:43.399074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71686968-0d90-4abc-b282-16168075124b admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:43.405915 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb70c13-388c-4e5a-9b71-2901e482481d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:43.406657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70c13-388c-4e5a-9b71-2901e482481d admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:43.406952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70c13-388c-4e5a-9b71-2901e482481d admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:43.407374 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70c13-388c-4e5a-9b71-2901e482481d admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:43.408135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb70c13-388c-4e5a-9b71-2901e482481d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:43.410004 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb70c13-388c-4e5a-9b71-2901e482481d admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:43.421538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:43.439287 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1307/2619] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 14:00:43.443736 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb70c13-388c-4e5a-9b71-2901e482481d admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:43.463253 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb70c13-388c-4e5a-9b71-2901e482481d admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:43.472821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e5dbd-72a9-4e15-9713-472cede65537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:43.473679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e5dbd-72a9-4e15-9713-472cede65537 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:43.474095 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e5dbd-72a9-4e15-9713-472cede65537 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:43.474476 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e5dbd-72a9-4e15-9713-472cede65537 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:43.475901 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e5dbd-72a9-4e15-9713-472cede65537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:43.479917 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e5dbd-72a9-4e15-9713-472cede65537 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:43.484560 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a06f7-6d08-46ed-b388-ea5255088d2b admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:43.493124 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1308/2620] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:43.497337 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e5dbd-72a9-4e15-9713-472cede65537 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:43.499571 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c41830-3946-4f2b-9f51-99f1c25c7936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:43.500495 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c41830-3946-4f2b-9f51-99f1c25c7936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:43.500780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c41830-3946-4f2b-9f51-99f1c25c7936 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:43.501057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c41830-3946-4f2b-9f51-99f1c25c7936 admin admin] PATH_INFO: `/v3/projects/02666af8782a45b086c87ca7eb06978c` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:43.502477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c41830-3946-4f2b-9f51-99f1c25c7936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02666af8782a45b086c87ca7eb06978c)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:43.504794 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c41830-3946-4f2b-9f51-99f1c25c7936 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:43.509732 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e5dbd-72a9-4e15-9713-472cede65537 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:43.518927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d33fc9-b5ff-4601-9b48-4769acdbcb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:43.521460 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d33fc9-b5ff-4601-9b48-4769acdbcb6a admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:43.521752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d33fc9-b5ff-4601-9b48-4769acdbcb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:43.522035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d33fc9-b5ff-4601-9b48-4769acdbcb6a admin admin] PATH_INFO: `/v3/projects/c422e034fbc4456f83c54ee263a1fe3b/users/143be9a7b7544bba84b6db0b96a47e1b/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:43.540606 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d33fc9-b5ff-4601-9b48-4769acdbcb6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c422e034fbc4456f83c54ee263a1fe3b, user_id=143be9a7b7544bba84b6db0b96a47e1b, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:43.544266 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d33fc9-b5ff-4601-9b48-4769acdbcb6a admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:43.567777 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1309/2621] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:43 2022] PUT /identity/v3/projects/c422e034fbc4456f83c54ee263a1fe3b/users/143be9a7b7544bba84b6db0b96a47e1b/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:43.579627 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8367cb-9589-4863-b703-91920f7c719e None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:43.579841 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8367cb-9589-4863-b703-91920f7c719e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:43.580135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8367cb-9589-4863-b703-91920f7c719e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:43.603137 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-48c41830-3946-4f2b-9f51-99f1c25c7936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02666af8782a45b086c87ca7eb06978c', 'request_id': 'req-48c41830-3946-4f2b-9f51-99f1c25c7936'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:43.609752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-2b8367cb-9589-4863-b703-91920f7c719e None None] MFA Rules not processed for user `143be9a7b7544bba84b6db0b96a47e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:43.610988 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-2b8367cb-9589-4863-b703-91920f7c719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:43.611377 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-48c41830-3946-4f2b-9f51-99f1c25c7936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02666af8782a45b086c87ca7eb06978c', 'request_id': 'req-48c41830-3946-4f2b-9f51-99f1c25c7936'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:43.625116 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-48c41830-3946-4f2b-9f51-99f1c25c7936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02666af8782a45b086c87ca7eb06978c', 'request_id': 'req-48c41830-3946-4f2b-9f51-99f1c25c7936'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:43.641210 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-48c41830-3946-4f2b-9f51-99f1c25c7936 admin admin] The token cache is being invalidate because project 02666af8782a45b086c87ca7eb06978c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:43.641684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-48c41830-3946-4f2b-9f51-99f1c25c7936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:43.642541 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-48c41830-3946-4f2b-9f51-99f1c25c7936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:43.644757 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1313/2622] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:43 2022] DELETE /identity/v3/projects/02666af8782a45b086c87ca7eb06978c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:43.649551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11693e9-61b0-41f1-8ac5-6417a40391fb None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:43.649841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11693e9-61b0-41f1-8ac5-6417a40391fb None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:43.650148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11693e9-61b0-41f1-8ac5-6417a40391fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:43.669072 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-e11693e9-61b0-41f1-8ac5-6417a40391fb None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:43.675773 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e11693e9-61b0-41f1-8ac5-6417a40391fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:43.703063 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:43.707711 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1310/2623] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:43.734482 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8367cb-9589-4863-b703-91920f7c719e None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:43.743731 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1314/2624] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 14:00:43.744072 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-2b8367cb-9589-4863-b703-91920f7c719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:43.747199 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81fac3-bc91-497c-9baa-b71b1d7605a7 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:43.748052 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81fac3-bc91-497c-9baa-b71b1d7605a7 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:43.748349 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81fac3-bc91-497c-9baa-b71b1d7605a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:43.768544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-8f81fac3-bc91-497c-9baa-b71b1d7605a7 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:43.769990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8f81fac3-bc91-497c-9baa-b71b1d7605a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:43.780041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1315/2625] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:43.785324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81fac3-bc91-497c-9baa-b71b1d7605a7 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:43.795981 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81fac3-bc91-497c-9baa-b71b1d7605a7 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:43.801072 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa583d6-2cef-448c-9048-4be0c8fb835a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:43.801805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa583d6-2cef-448c-9048-4be0c8fb835a admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:43.802071 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa583d6-2cef-448c-9048-4be0c8fb835a admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:43.802343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa583d6-2cef-448c-9048-4be0c8fb835a admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:43.803418 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa583d6-2cef-448c-9048-4be0c8fb835a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:00:43.803418 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa583d6-2cef-448c-9048-4be0c8fb835a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:43.805447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa583d6-2cef-448c-9048-4be0c8fb835a admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:43.819544 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1316/2626] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:00:43.823895 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa583d6-2cef-448c-9048-4be0c8fb835a admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:43.837099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa583d6-2cef-448c-9048-4be0c8fb835a admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:43.842759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcdf34-4593-41c9-a7f4-234bb3a069a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:43.843639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcdf34-4593-41c9-a7f4-234bb3a069a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:43.844084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcdf34-4593-41c9-a7f4-234bb3a069a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:43.844528 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcdf34-4593-41c9-a7f4-234bb3a069a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:43.845441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8367cb-9589-4863-b703-91920f7c719e None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:43.845809 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcdf34-4593-41c9-a7f4-234bb3a069a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:43.847878 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcdf34-4593-41c9-a7f4-234bb3a069a9 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:43.849038 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ae3d6-41a3-46ca-91ec-eb5744ca11bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:43.850098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ae3d6-41a3-46ca-91ec-eb5744ca11bf service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:43.850098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ae3d6-41a3-46ca-91ec-eb5744ca11bf service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:43.850330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ae3d6-41a3-46ca-91ec-eb5744ca11bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:43.859508 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ae3d6-41a3-46ca-91ec-eb5744ca11bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:43.860961 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ae3d6-41a3-46ca-91ec-eb5744ca11bf service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:43.870444 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1311/2627] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:43.885370 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1317/2628] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:43 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:00:43.886421 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ae3d6-41a3-46ca-91ec-eb5744ca11bf service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:43.897612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ae3d6-41a3-46ca-91ec-eb5744ca11bf service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:43.954430 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:43.963484 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba475e40-02f3-4d4b-a7e3-81e8ac446aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:43.964417 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba475e40-02f3-4d4b-a7e3-81e8ac446aad admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:43.964875 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba475e40-02f3-4d4b-a7e3-81e8ac446aad admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:43.965467 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba475e40-02f3-4d4b-a7e3-81e8ac446aad admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:43.967326 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba475e40-02f3-4d4b-a7e3-81e8ac446aad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:43.969579 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba475e40-02f3-4d4b-a7e3-81e8ac446aad admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:43.992493 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1312/2629] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:43 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:43.996566 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcdf34-4593-41c9-a7f4-234bb3a069a9 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:44.008987 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcdf34-4593-41c9-a7f4-234bb3a069a9 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:44.014840 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba8d52-8fd9-46ef-94b7-d6a9ff0a634a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:44.015529 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba8d52-8fd9-46ef-94b7-d6a9ff0a634a admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:44.015818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba8d52-8fd9-46ef-94b7-d6a9ff0a634a admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:44.016100 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba8d52-8fd9-46ef-94b7-d6a9ff0a634a admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:44.016830 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba8d52-8fd9-46ef-94b7-d6a9ff0a634a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:44.018613 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba8d52-8fd9-46ef-94b7-d6a9ff0a634a admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:44.032844 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1318/2630] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:44.037089 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba475e40-02f3-4d4b-a7e3-81e8ac446aad admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:44.048257 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba475e40-02f3-4d4b-a7e3-81e8ac446aad admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:44.052980 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c8031-254f-42f2-a022-1d207775be04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:44.053695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c8031-254f-42f2-a022-1d207775be04 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:44.053980 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c8031-254f-42f2-a022-1d207775be04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:44.054288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c8031-254f-42f2-a022-1d207775be04 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:44.055014 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c8031-254f-42f2-a022-1d207775be04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:44.057022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c8031-254f-42f2-a022-1d207775be04 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:44.068543 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1313/2631] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 14:00:44.072667 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba8d52-8fd9-46ef-94b7-d6a9ff0a634a admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:44.083359 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba8d52-8fd9-46ef-94b7-d6a9ff0a634a admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:44.088834 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d560399-a0ee-47e4-bc57-183a8961d7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:44.089635 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d560399-a0ee-47e4-bc57-183a8961d7e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:44.089942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d560399-a0ee-47e4-bc57-183a8961d7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:44.090203 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d560399-a0ee-47e4-bc57-183a8961d7e4 admin admin] PATH_INFO: `/v3/projects/535d59a2d7ce437bbd21537acad1b679/users/9ed6c173ab534db5b8fa6abf5041129d/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:44.110582 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d560399-a0ee-47e4-bc57-183a8961d7e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535d59a2d7ce437bbd21537acad1b679, user_id=9ed6c173ab534db5b8fa6abf5041129d, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:44.112232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d560399-a0ee-47e4-bc57-183a8961d7e4 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:44.144178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1319/2632] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:44 2022] PUT /identity/v3/projects/535d59a2d7ce437bbd21537acad1b679/users/9ed6c173ab534db5b8fa6abf5041129d/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:44.145917 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624e24a-a80f-4e97-ab36-40562bcd6ca9 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:44.146189 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624e24a-a80f-4e97-ab36-40562bcd6ca9 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:44.146562 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624e24a-a80f-4e97-ab36-40562bcd6ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:44.180135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-b624e24a-a80f-4e97-ab36-40562bcd6ca9 None None] MFA Rules not processed for user `9ed6c173ab534db5b8fa6abf5041129d`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:44.181794 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-b624e24a-a80f-4e97-ab36-40562bcd6ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:44.256264 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1314/2633] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:44.260842 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d560399-a0ee-47e4-bc57-183a8961d7e4 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:44.323515 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d560399-a0ee-47e4-bc57-183a8961d7e4 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:44.328489 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a761373-0e61-415d-be8c-2e867ead2eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:44.329178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a761373-0e61-415d-be8c-2e867ead2eae admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:44.329496 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a761373-0e61-415d-be8c-2e867ead2eae admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:44.329775 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a761373-0e61-415d-be8c-2e867ead2eae admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:44.330467 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a761373-0e61-415d-be8c-2e867ead2eae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:44.332356 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a761373-0e61-415d-be8c-2e867ead2eae admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:44.359772 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1320/2634] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:44 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:44.366768 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624e24a-a80f-4e97-ab36-40562bcd6ca9 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:44.377842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624e24a-a80f-4e97-ab36-40562bcd6ca9 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:44.434301 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb8ba3-ab0b-4f35-9298-0c1730aef33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:44.434974 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb8ba3-ab0b-4f35-9298-0c1730aef33e admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:44.435261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb8ba3-ab0b-4f35-9298-0c1730aef33e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:44.435538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb8ba3-ab0b-4f35-9298-0c1730aef33e admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:44.436234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb8ba3-ab0b-4f35-9298-0c1730aef33e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:44.438180 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb8ba3-ab0b-4f35-9298-0c1730aef33e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:44.459944 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1315/2635] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:44 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:44.461173 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a761373-0e61-415d-be8c-2e867ead2eae admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:44.471855 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a761373-0e61-415d-be8c-2e867ead2eae admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:44.476616 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474d7a3-3159-443c-b81e-aa6e46adc58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:44.477411 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474d7a3-3159-443c-b81e-aa6e46adc58d admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:44.477932 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474d7a3-3159-443c-b81e-aa6e46adc58d admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:44.478151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474d7a3-3159-443c-b81e-aa6e46adc58d admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:44.478873 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474d7a3-3159-443c-b81e-aa6e46adc58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:44.480446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474d7a3-3159-443c-b81e-aa6e46adc58d admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:44.492373 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1321/2636] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:44.496579 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb8ba3-ab0b-4f35-9298-0c1730aef33e admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:44.506618 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb8ba3-ab0b-4f35-9298-0c1730aef33e admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:44.511242 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93932e-acc3-448f-9401-e09dcc3e57d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:44.512078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93932e-acc3-448f-9401-e09dcc3e57d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:44.512363 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93932e-acc3-448f-9401-e09dcc3e57d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:44.512670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93932e-acc3-448f-9401-e09dcc3e57d7 admin admin] PATH_INFO: `/v3/projects/b2a1376ea20e4f97ba264927801bc98c/users/940e890cdfb0415ea99ebfb4f1a61aa9/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:44.528619 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93932e-acc3-448f-9401-e09dcc3e57d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a1376ea20e4f97ba264927801bc98c, user_id=940e890cdfb0415ea99ebfb4f1a61aa9, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:44.531856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93932e-acc3-448f-9401-e09dcc3e57d7 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:44.545111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1316/2637] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:44 2022] PUT /identity/v3/projects/b2a1376ea20e4f97ba264927801bc98c/users/940e890cdfb0415ea99ebfb4f1a61aa9/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:44.549114 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474d7a3-3159-443c-b81e-aa6e46adc58d admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:44.559343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474d7a3-3159-443c-b81e-aa6e46adc58d admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:44.594709 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:44.626466 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017dcdf-1388-4760-8806-8e1428632b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:44.627169 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017dcdf-1388-4760-8806-8e1428632b71 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:44.627479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017dcdf-1388-4760-8806-8e1428632b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:44.627763 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017dcdf-1388-4760-8806-8e1428632b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:44.628489 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017dcdf-1388-4760-8806-8e1428632b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:44.630128 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017dcdf-1388-4760-8806-8e1428632b71 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:44.640738 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1322/2638] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:44.644551 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93932e-acc3-448f-9401-e09dcc3e57d7 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:44.655208 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93932e-acc3-448f-9401-e09dcc3e57d7 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:44.659852 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35676a9-212b-4058-bc3c-62f9970f4bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:44.660724 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35676a9-212b-4058-bc3c-62f9970f4bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:44.661023 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35676a9-212b-4058-bc3c-62f9970f4bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:44.661336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35676a9-212b-4058-bc3c-62f9970f4bd9 admin admin] PATH_INFO: `/v3/projects/b2a1376ea20e4f97ba264927801bc98c/users/940e890cdfb0415ea99ebfb4f1a61aa9/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:44.663284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35676a9-212b-4058-bc3c-62f9970f4bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a1376ea20e4f97ba264927801bc98c, user_id=940e890cdfb0415ea99ebfb4f1a61aa9, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:44.665985 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35676a9-212b-4058-bc3c-62f9970f4bd9 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:44.676969 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1317/2639] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:44 2022] PUT /identity/v3/projects/b2a1376ea20e4f97ba264927801bc98c/users/940e890cdfb0415ea99ebfb4f1a61aa9/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:44.689167 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b560-72ff-4b6d-8171-b6fa265d90d3 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:44.689723 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b560-72ff-4b6d-8171-b6fa265d90d3 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:44.689891 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b560-72ff-4b6d-8171-b6fa265d90d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:44.719558 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-b837b560-72ff-4b6d-8171-b6fa265d90d3 None None] MFA Rules not processed for user `940e890cdfb0415ea99ebfb4f1a61aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:44.720782 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-b837b560-72ff-4b6d-8171-b6fa265d90d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:44.790398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1323/2640] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:44.801737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35676a9-212b-4058-bc3c-62f9970f4bd9 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:44.820368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:44.861925 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35676a9-212b-4058-bc3c-62f9970f4bd9 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:44.865838 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b403f-1e26-4371-9774-737735b0b074 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:44.866747 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b403f-1e26-4371-9774-737735b0b074 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:44.867029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b403f-1e26-4371-9774-737735b0b074 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:44.867301 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b403f-1e26-4371-9774-737735b0b074 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:44.877354 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b403f-1e26-4371-9774-737735b0b074 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:44.878796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b403f-1e26-4371-9774-737735b0b074 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:44.890552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1318/2641] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:44.918719 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837b560-72ff-4b6d-8171-b6fa265d90d3 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:44.985231 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837b560-72ff-4b6d-8171-b6fa265d90d3 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:44.989805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f943c-4e7d-43e4-9dbd-80220ecc7250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:44.990665 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f943c-4e7d-43e4-9dbd-80220ecc7250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:44.990948 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f943c-4e7d-43e4-9dbd-80220ecc7250 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:44.991504 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f943c-4e7d-43e4-9dbd-80220ecc7250 admin admin] PATH_INFO: `/v3/users/9ed6c173ab534db5b8fa6abf5041129d` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:44.992695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f943c-4e7d-43e4-9dbd-80220ecc7250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ed6c173ab534db5b8fa6abf5041129d)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:44.994619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f943c-4e7d-43e4-9dbd-80220ecc7250 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:45.047346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-973f943c-4e7d-43e4-9dbd-80220ecc7250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ed6c173ab534db5b8fa6abf5041129d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:45.048325 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-973f943c-4e7d-43e4-9dbd-80220ecc7250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ed6c173ab534db5b8fa6abf5041129d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:45.048963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-973f943c-4e7d-43e4-9dbd-80220ecc7250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ed6c173ab534db5b8fa6abf5041129d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:45.057067 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-973f943c-4e7d-43e4-9dbd-80220ecc7250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ed6c173ab534db5b8fa6abf5041129d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:45.059060 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:45.066535 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-973f943c-4e7d-43e4-9dbd-80220ecc7250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ed6c173ab534db5b8fa6abf5041129d'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:45.087000 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1324/2642] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:44 2022] DELETE /identity/v3/users/9ed6c173ab534db5b8fa6abf5041129d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:45.091407 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9157d-b6e5-4d2e-a76b-ae4f6e9cdd39 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:45.091693 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9157d-b6e5-4d2e-a76b-ae4f6e9cdd39 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:45.091973 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9157d-b6e5-4d2e-a76b-ae4f6e9cdd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:45.110480 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-6ce9157d-b6e5-4d2e-a76b-ae4f6e9cdd39 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:45.111739 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6ce9157d-b6e5-4d2e-a76b-ae4f6e9cdd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:45.175812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1319/2643] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:45.186249 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f943c-4e7d-43e4-9dbd-80220ecc7250 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:45.187784 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-973f943c-4e7d-43e4-9dbd-80220ecc7250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:45.256295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f943c-4e7d-43e4-9dbd-80220ecc7250 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:45.260744 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e937d40-353f-4433-96d2-f2d67496c849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:45.261608 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e937d40-353f-4433-96d2-f2d67496c849 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:45.261893 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e937d40-353f-4433-96d2-f2d67496c849 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:45.262171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e937d40-353f-4433-96d2-f2d67496c849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:45.272613 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e937d40-353f-4433-96d2-f2d67496c849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:45.274248 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e937d40-353f-4433-96d2-f2d67496c849 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:45.284836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1325/2644] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:45.603227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9157d-b6e5-4d2e-a76b-ae4f6e9cdd39 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:45.604735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6ce9157d-b6e5-4d2e-a76b-ae4f6e9cdd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:45.620706 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9157d-b6e5-4d2e-a76b-ae4f6e9cdd39 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:45.626483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2e5b0-817a-40d6-bd87-2bb4438e6b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:45.627418 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2e5b0-817a-40d6-bd87-2bb4438e6b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:45.627706 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2e5b0-817a-40d6-bd87-2bb4438e6b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:45.627981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2e5b0-817a-40d6-bd87-2bb4438e6b4e admin admin] PATH_INFO: `/v3/projects/535d59a2d7ce437bbd21537acad1b679` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:45.629241 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2e5b0-817a-40d6-bd87-2bb4438e6b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=535d59a2d7ce437bbd21537acad1b679)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:45.631174 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2e5b0-817a-40d6-bd87-2bb4438e6b4e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:45.689282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-2df2e5b0-817a-40d6-bd87-2bb4438e6b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535d59a2d7ce437bbd21537acad1b679', 'request_id': 'req-2df2e5b0-817a-40d6-bd87-2bb4438e6b4e'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:45.695516 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-2df2e5b0-817a-40d6-bd87-2bb4438e6b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535d59a2d7ce437bbd21537acad1b679', 'request_id': 'req-2df2e5b0-817a-40d6-bd87-2bb4438e6b4e'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:45.701172 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-2df2e5b0-817a-40d6-bd87-2bb4438e6b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535d59a2d7ce437bbd21537acad1b679', 'request_id': 'req-2df2e5b0-817a-40d6-bd87-2bb4438e6b4e'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:45.715175 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-2df2e5b0-817a-40d6-bd87-2bb4438e6b4e admin admin] The token cache is being invalidate because project 535d59a2d7ce437bbd21537acad1b679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:45.715981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-2df2e5b0-817a-40d6-bd87-2bb4438e6b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:45.717127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-2df2e5b0-817a-40d6-bd87-2bb4438e6b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:45.718974 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1320/2645] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:45 2022] DELETE /identity/v3/projects/535d59a2d7ce437bbd21537acad1b679 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:45.722973 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e937d40-353f-4433-96d2-f2d67496c849 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:45.733539 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e937d40-353f-4433-96d2-f2d67496c849 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:45.790776 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338a6e5-b90b-4a52-8d3f-cd8de0fe2015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:45.791657 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338a6e5-b90b-4a52-8d3f-cd8de0fe2015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:45.791938 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338a6e5-b90b-4a52-8d3f-cd8de0fe2015 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:45.792217 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338a6e5-b90b-4a52-8d3f-cd8de0fe2015 admin admin] PATH_INFO: `/v3/users/940e890cdfb0415ea99ebfb4f1a61aa9` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:45.793511 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338a6e5-b90b-4a52-8d3f-cd8de0fe2015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=940e890cdfb0415ea99ebfb4f1a61aa9)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:45.796021 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338a6e5-b90b-4a52-8d3f-cd8de0fe2015 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:45.842144 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c338a6e5-b90b-4a52-8d3f-cd8de0fe2015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '940e890cdfb0415ea99ebfb4f1a61aa9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:45.842780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c338a6e5-b90b-4a52-8d3f-cd8de0fe2015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '940e890cdfb0415ea99ebfb4f1a61aa9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:45.843382 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c338a6e5-b90b-4a52-8d3f-cd8de0fe2015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '940e890cdfb0415ea99ebfb4f1a61aa9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:45.850318 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c338a6e5-b90b-4a52-8d3f-cd8de0fe2015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '940e890cdfb0415ea99ebfb4f1a61aa9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:45.857881 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c338a6e5-b90b-4a52-8d3f-cd8de0fe2015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '940e890cdfb0415ea99ebfb4f1a61aa9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:45.869385 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:45.877377 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1326/2646] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:45 2022] DELETE /identity/v3/users/940e890cdfb0415ea99ebfb4f1a61aa9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:46.145996 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2e5b0-817a-40d6-bd87-2bb4438e6b4e admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:46.147417 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-2df2e5b0-817a-40d6-bd87-2bb4438e6b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:46.165655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2e5b0-817a-40d6-bd87-2bb4438e6b4e admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:46.217835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:46.237051 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab880c-df68-486f-bd5d-447cd80ca196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:46.237999 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab880c-df68-486f-bd5d-447cd80ca196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:46.238284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab880c-df68-486f-bd5d-447cd80ca196 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:46.238558 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab880c-df68-486f-bd5d-447cd80ca196 admin admin] PATH_INFO: `/v3/projects/b2a1376ea20e4f97ba264927801bc98c` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:46.239739 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab880c-df68-486f-bd5d-447cd80ca196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2a1376ea20e4f97ba264927801bc98c)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:46.241937 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab880c-df68-486f-bd5d-447cd80ca196 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:46.296023 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-19ab880c-df68-486f-bd5d-447cd80ca196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2a1376ea20e4f97ba264927801bc98c', 'request_id': 'req-19ab880c-df68-486f-bd5d-447cd80ca196'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:46.303799 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-19ab880c-df68-486f-bd5d-447cd80ca196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2a1376ea20e4f97ba264927801bc98c', 'request_id': 'req-19ab880c-df68-486f-bd5d-447cd80ca196'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:46.310119 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-19ab880c-df68-486f-bd5d-447cd80ca196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2a1376ea20e4f97ba264927801bc98c', 'request_id': 'req-19ab880c-df68-486f-bd5d-447cd80ca196'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:46.322573 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-19ab880c-df68-486f-bd5d-447cd80ca196 admin admin] The token cache is being invalidate because project b2a1376ea20e4f97ba264927801bc98c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:46.322887 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-19ab880c-df68-486f-bd5d-447cd80ca196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:46.323493 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-19ab880c-df68-486f-bd5d-447cd80ca196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:46.325118 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1321/2647] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:46 2022] DELETE /identity/v3/projects/b2a1376ea20e4f97ba264927801bc98c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:46.330652 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7af24e-d682-4f30-8d3c-05915e3725aa None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:46.330939 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7af24e-d682-4f30-8d3c-05915e3725aa None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:46.331220 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7af24e-d682-4f30-8d3c-05915e3725aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:46.349507 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-dd7af24e-d682-4f30-8d3c-05915e3725aa None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:46.350703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-dd7af24e-d682-4f30-8d3c-05915e3725aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:46.412429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1327/2648] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:46.420504 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464753a-beea-449a-aaff-a82a86f7a087 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:46.420791 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464753a-beea-449a-aaff-a82a86f7a087 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:46.421067 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464753a-beea-449a-aaff-a82a86f7a087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:46.441967 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-f464753a-beea-449a-aaff-a82a86f7a087 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:46.443308 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f464753a-beea-449a-aaff-a82a86f7a087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:46.452792 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1322/2649] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:46.458570 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7af24e-d682-4f30-8d3c-05915e3725aa None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:46.470511 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7af24e-d682-4f30-8d3c-05915e3725aa None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:46.476808 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234196ed-78fe-4da6-abad-f08dfe1dce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:46.477642 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234196ed-78fe-4da6-abad-f08dfe1dce4f admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:46.478405 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234196ed-78fe-4da6-abad-f08dfe1dce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:46.478405 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234196ed-78fe-4da6-abad-f08dfe1dce4f admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:46.479360 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234196ed-78fe-4da6-abad-f08dfe1dce4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:00:46.479721 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234196ed-78fe-4da6-abad-f08dfe1dce4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:46.482103 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234196ed-78fe-4da6-abad-f08dfe1dce4f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:46.497308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1328/2650] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:00:46.500788 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464753a-beea-449a-aaff-a82a86f7a087 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:46.510406 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464753a-beea-449a-aaff-a82a86f7a087 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:46.517567 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e49d36-fb96-40e9-9298-7504550ad0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:46.518523 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e49d36-fb96-40e9-9298-7504550ad0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:46.518877 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e49d36-fb96-40e9-9298-7504550ad0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:46.519222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e49d36-fb96-40e9-9298-7504550ad0f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:46.519983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e49d36-fb96-40e9-9298-7504550ad0f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:46.521991 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e49d36-fb96-40e9-9298-7504550ad0f5 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:46.549308 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1323/2651] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:46 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:46.552370 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234196ed-78fe-4da6-abad-f08dfe1dce4f admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:46.563457 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234196ed-78fe-4da6-abad-f08dfe1dce4f admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:46.631337 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187246d-8310-4c56-90e6-02fbb095d94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:46.632444 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187246d-8310-4c56-90e6-02fbb095d94e admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:46.632801 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187246d-8310-4c56-90e6-02fbb095d94e admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:46.633390 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187246d-8310-4c56-90e6-02fbb095d94e admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:46.633805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187246d-8310-4c56-90e6-02fbb095d94e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:46.635731 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187246d-8310-4c56-90e6-02fbb095d94e admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:46.665449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1329/2652] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:46 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:46.665966 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e49d36-fb96-40e9-9298-7504550ad0f5 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:46.678920 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e49d36-fb96-40e9-9298-7504550ad0f5 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:46.691681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9019d-e5f9-4f23-9e08-30027cc2d138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:46.692388 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9019d-e5f9-4f23-9e08-30027cc2d138 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:46.692911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9019d-e5f9-4f23-9e08-30027cc2d138 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:46.693281 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9019d-e5f9-4f23-9e08-30027cc2d138 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:46.694287 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9019d-e5f9-4f23-9e08-30027cc2d138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:46.696096 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9019d-e5f9-4f23-9e08-30027cc2d138 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:46.717319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1324/2653] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:46.719091 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187246d-8310-4c56-90e6-02fbb095d94e admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:46.730381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187246d-8310-4c56-90e6-02fbb095d94e admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:46.735899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be206c0-9507-468d-918a-71fe4a91c6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:46.736675 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be206c0-9507-468d-918a-71fe4a91c6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:46.736863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be206c0-9507-468d-918a-71fe4a91c6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:46.737119 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be206c0-9507-468d-918a-71fe4a91c6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:46.737929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be206c0-9507-468d-918a-71fe4a91c6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:46.739505 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be206c0-9507-468d-918a-71fe4a91c6d6 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:46.752303 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1330/2654] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:46.758230 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9019d-e5f9-4f23-9e08-30027cc2d138 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:46.771246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9019d-e5f9-4f23-9e08-30027cc2d138 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:46.787685 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a666954-b510-4927-9335-653fdbde2768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:46.788565 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a666954-b510-4927-9335-653fdbde2768 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:46.788850 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a666954-b510-4927-9335-653fdbde2768 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:46.789127 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a666954-b510-4927-9335-653fdbde2768 admin admin] PATH_INFO: `/v3/projects/25f002e3ee644812a5af65932e05ba19/users/3d59cb4d719e43acbc19b9fd4ee596df/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:46.806688 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a666954-b510-4927-9335-653fdbde2768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f002e3ee644812a5af65932e05ba19, user_id=3d59cb4d719e43acbc19b9fd4ee596df, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:46.809326 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a666954-b510-4927-9335-653fdbde2768 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:46.823752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1325/2655] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:46 2022] PUT /identity/v3/projects/25f002e3ee644812a5af65932e05ba19/users/3d59cb4d719e43acbc19b9fd4ee596df/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:46.833940 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582acb5-9e01-4c22-8ffc-21374c713c36 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:46.834367 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582acb5-9e01-4c22-8ffc-21374c713c36 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:46.834652 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582acb5-9e01-4c22-8ffc-21374c713c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:46.862383 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-7582acb5-9e01-4c22-8ffc-21374c713c36 None None] MFA Rules not processed for user `3d59cb4d719e43acbc19b9fd4ee596df`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:46.863609 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7582acb5-9e01-4c22-8ffc-21374c713c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:46.923543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:46.944284 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1331/2656] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:46.948961 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a666954-b510-4927-9335-653fdbde2768 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:47.025181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a666954-b510-4927-9335-653fdbde2768 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:47.030070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cab32-599e-4d08-970f-9330fc22d8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:47.030749 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cab32-599e-4d08-970f-9330fc22d8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:47.031035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cab32-599e-4d08-970f-9330fc22d8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:47.031313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cab32-599e-4d08-970f-9330fc22d8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:47.032062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cab32-599e-4d08-970f-9330fc22d8a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:47.034067 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cab32-599e-4d08-970f-9330fc22d8a7 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:47.048581 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:47.066703 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1326/2657] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:46 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:47.068012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582acb5-9e01-4c22-8ffc-21374c713c36 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:47.083504 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582acb5-9e01-4c22-8ffc-21374c713c36 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:47.149517 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267b170-a79e-4a34-bc3d-c0a506a489d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:47.150193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267b170-a79e-4a34-bc3d-c0a506a489d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:47.150520 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267b170-a79e-4a34-bc3d-c0a506a489d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:47.150797 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267b170-a79e-4a34-bc3d-c0a506a489d1 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:47.151441 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267b170-a79e-4a34-bc3d-c0a506a489d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:47.154221 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267b170-a79e-4a34-bc3d-c0a506a489d1 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:47.181587 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1332/2658] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:47 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:00:47.185577 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cab32-599e-4d08-970f-9330fc22d8a7 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:47.196637 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cab32-599e-4d08-970f-9330fc22d8a7 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:47.204818 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c42523-281e-4668-9ceb-6055080463b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:47.205727 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c42523-281e-4668-9ceb-6055080463b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:47.206075 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c42523-281e-4668-9ceb-6055080463b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:47.206321 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c42523-281e-4668-9ceb-6055080463b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:47.207057 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c42523-281e-4668-9ceb-6055080463b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:47.208872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c42523-281e-4668-9ceb-6055080463b2 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:47.223395 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1327/2659] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 14:00:47.228526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267b170-a79e-4a34-bc3d-c0a506a489d1 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:47.244863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267b170-a79e-4a34-bc3d-c0a506a489d1 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:47.249805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3152539-a3e6-49d0-97fd-531a44fcea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:47.250695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152539-a3e6-49d0-97fd-531a44fcea4f admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:47.250978 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152539-a3e6-49d0-97fd-531a44fcea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:47.251253 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152539-a3e6-49d0-97fd-531a44fcea4f admin admin] PATH_INFO: `/v3/projects/ec56d4c1d9564bf0b5b19d3e7168970a/users/44bbf29462c34be2be4a23fc02884e69/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:47.267276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3152539-a3e6-49d0-97fd-531a44fcea4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec56d4c1d9564bf0b5b19d3e7168970a, user_id=44bbf29462c34be2be4a23fc02884e69, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:47.269972 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3152539-a3e6-49d0-97fd-531a44fcea4f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:47.287109 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1333/2660] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:47 2022] PUT /identity/v3/projects/ec56d4c1d9564bf0b5b19d3e7168970a/users/44bbf29462c34be2be4a23fc02884e69/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:47.298651 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c42523-281e-4668-9ceb-6055080463b2 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:47.311081 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c42523-281e-4668-9ceb-6055080463b2 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:47.396633 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2eff5-659b-4167-aa0a-2f2075cc775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:47.397416 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2eff5-659b-4167-aa0a-2f2075cc775d admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:47.397706 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2eff5-659b-4167-aa0a-2f2075cc775d admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:47.397988 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2eff5-659b-4167-aa0a-2f2075cc775d admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:47.398721 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2eff5-659b-4167-aa0a-2f2075cc775d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:47.400342 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2eff5-659b-4167-aa0a-2f2075cc775d admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:47.411436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1328/2661] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 14:00:47.415596 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3152539-a3e6-49d0-97fd-531a44fcea4f admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:47.427215 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3152539-a3e6-49d0-97fd-531a44fcea4f admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:47.432624 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efe90a-bfdb-4567-a39b-e098ca0d7c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:47.433549 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efe90a-bfdb-4567-a39b-e098ca0d7c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:47.433836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efe90a-bfdb-4567-a39b-e098ca0d7c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:47.434117 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efe90a-bfdb-4567-a39b-e098ca0d7c38 admin admin] PATH_INFO: `/v3/projects/ec56d4c1d9564bf0b5b19d3e7168970a/users/44bbf29462c34be2be4a23fc02884e69/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:47.436127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efe90a-bfdb-4567-a39b-e098ca0d7c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec56d4c1d9564bf0b5b19d3e7168970a, user_id=44bbf29462c34be2be4a23fc02884e69, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:47.438775 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efe90a-bfdb-4567-a39b-e098ca0d7c38 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:47.449144 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1334/2662] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:47 2022] PUT /identity/v3/projects/ec56d4c1d9564bf0b5b19d3e7168970a/users/44bbf29462c34be2be4a23fc02884e69/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:47.462235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747a56d-49fc-43dd-92cc-bff520b27382 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:47.462871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747a56d-49fc-43dd-92cc-bff520b27382 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:47.462871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747a56d-49fc-43dd-92cc-bff520b27382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:47.490247 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-b747a56d-49fc-43dd-92cc-bff520b27382 None None] MFA Rules not processed for user `44bbf29462c34be2be4a23fc02884e69`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:47.491730 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-b747a56d-49fc-43dd-92cc-bff520b27382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:47.566718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1329/2663] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:47.580957 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efe90a-bfdb-4567-a39b-e098ca0d7c38 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:47.583085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-10efe90a-bfdb-4567-a39b-e098ca0d7c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:47.642846 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efe90a-bfdb-4567-a39b-e098ca0d7c38 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:47.646845 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2690458-037d-4a98-bd8c-2e3371489f90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:47.647507 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2690458-037d-4a98-bd8c-2e3371489f90 service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:47.647796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2690458-037d-4a98-bd8c-2e3371489f90 service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:47.648197 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2690458-037d-4a98-bd8c-2e3371489f90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:47.658618 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2690458-037d-4a98-bd8c-2e3371489f90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:47.660047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2690458-037d-4a98-bd8c-2e3371489f90 service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:47.670550 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1335/2664] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:47.734559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747a56d-49fc-43dd-92cc-bff520b27382 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:47.803916 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747a56d-49fc-43dd-92cc-bff520b27382 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:47.809474 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad99a96-4e41-4f70-bea9-5fa4ed610473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:47.814024 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad99a96-4e41-4f70-bea9-5fa4ed610473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:47.814316 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad99a96-4e41-4f70-bea9-5fa4ed610473 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:47.814572 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad99a96-4e41-4f70-bea9-5fa4ed610473 admin admin] PATH_INFO: `/v3/users/3d59cb4d719e43acbc19b9fd4ee596df` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:47.818347 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad99a96-4e41-4f70-bea9-5fa4ed610473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d59cb4d719e43acbc19b9fd4ee596df)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:47.820552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad99a96-4e41-4f70-bea9-5fa4ed610473 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:47.827976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:47.898783 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-3ad99a96-4e41-4f70-bea9-5fa4ed610473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d59cb4d719e43acbc19b9fd4ee596df'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:47.915460 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-3ad99a96-4e41-4f70-bea9-5fa4ed610473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d59cb4d719e43acbc19b9fd4ee596df'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:47.916334 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-3ad99a96-4e41-4f70-bea9-5fa4ed610473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d59cb4d719e43acbc19b9fd4ee596df'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:47.917181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-3ad99a96-4e41-4f70-bea9-5fa4ed610473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d59cb4d719e43acbc19b9fd4ee596df'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:47.926762 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-3ad99a96-4e41-4f70-bea9-5fa4ed610473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d59cb4d719e43acbc19b9fd4ee596df'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:47.941308 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1330/2665] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:47 2022] DELETE /identity/v3/users/3d59cb4d719e43acbc19b9fd4ee596df => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:47.946483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a679a3-c71a-44af-989c-5c360cd6d113 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:47.946946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a679a3-c71a-44af-989c-5c360cd6d113 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:47.947057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a679a3-c71a-44af-989c-5c360cd6d113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:47.971333 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-62a679a3-c71a-44af-989c-5c360cd6d113 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:47.972684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-62a679a3-c71a-44af-989c-5c360cd6d113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:48.028344 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:48.047311 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1336/2666] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:48.057191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad99a96-4e41-4f70-bea9-5fa4ed610473 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:48.058662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-3ad99a96-4e41-4f70-bea9-5fa4ed610473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:48.116959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad99a96-4e41-4f70-bea9-5fa4ed610473 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:48.122954 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0256f35-9132-47a9-a16e-69066598a678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:48.123615 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0256f35-9132-47a9-a16e-69066598a678 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:48.123899 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0256f35-9132-47a9-a16e-69066598a678 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:48.124176 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0256f35-9132-47a9-a16e-69066598a678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:48.134106 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0256f35-9132-47a9-a16e-69066598a678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:48.135794 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0256f35-9132-47a9-a16e-69066598a678 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:48.146996 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1331/2667] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:48.554902 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a679a3-c71a-44af-989c-5c360cd6d113 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:48.556456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-62a679a3-c71a-44af-989c-5c360cd6d113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:48.573108 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a679a3-c71a-44af-989c-5c360cd6d113 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:48.578030 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042265d-fd91-4da6-ab0a-c955c032f37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:48.578904 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042265d-fd91-4da6-ab0a-c955c032f37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:48.579187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042265d-fd91-4da6-ab0a-c955c032f37a admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:48.579588 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042265d-fd91-4da6-ab0a-c955c032f37a admin admin] PATH_INFO: `/v3/users/54ac98c13bf3441dae28640a2c8f8a00` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:48.580818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042265d-fd91-4da6-ab0a-c955c032f37a admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ac98c13bf3441dae28640a2c8f8a00)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:48.582772 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042265d-fd91-4da6-ab0a-c955c032f37a admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:48.634963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0042265d-fd91-4da6-ab0a-c955c032f37a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ac98c13bf3441dae28640a2c8f8a00'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:48.635632 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0042265d-fd91-4da6-ab0a-c955c032f37a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ac98c13bf3441dae28640a2c8f8a00'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:48.636364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0042265d-fd91-4da6-ab0a-c955c032f37a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ac98c13bf3441dae28640a2c8f8a00'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:48.644792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0042265d-fd91-4da6-ab0a-c955c032f37a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ac98c13bf3441dae28640a2c8f8a00'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:48.655816 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0042265d-fd91-4da6-ab0a-c955c032f37a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ac98c13bf3441dae28640a2c8f8a00'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:48.666142 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0256f35-9132-47a9-a16e-69066598a678 service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:48.667695 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-d0256f35-9132-47a9-a16e-69066598a678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:48.692790 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1337/2668] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:48 2022] DELETE /identity/v3/users/54ac98c13bf3441dae28640a2c8f8a00 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:48.701758 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0256f35-9132-47a9-a16e-69066598a678 service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:48.764470 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be225621-4a8c-4634-9296-9eeb6a32aba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:48.765366 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be225621-4a8c-4634-9296-9eeb6a32aba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:48.765654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be225621-4a8c-4634-9296-9eeb6a32aba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:48.765951 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be225621-4a8c-4634-9296-9eeb6a32aba1 admin admin] PATH_INFO: `/v3/projects/25f002e3ee644812a5af65932e05ba19` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:48.767432 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be225621-4a8c-4634-9296-9eeb6a32aba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f002e3ee644812a5af65932e05ba19)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:48.769387 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be225621-4a8c-4634-9296-9eeb6a32aba1 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:48.803714 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:48.820173 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-be225621-4a8c-4634-9296-9eeb6a32aba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f002e3ee644812a5af65932e05ba19', 'request_id': 'req-be225621-4a8c-4634-9296-9eeb6a32aba1'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:48.826522 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-be225621-4a8c-4634-9296-9eeb6a32aba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f002e3ee644812a5af65932e05ba19', 'request_id': 'req-be225621-4a8c-4634-9296-9eeb6a32aba1'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:48.832044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-be225621-4a8c-4634-9296-9eeb6a32aba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f002e3ee644812a5af65932e05ba19', 'request_id': 'req-be225621-4a8c-4634-9296-9eeb6a32aba1'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:48.844645 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-be225621-4a8c-4634-9296-9eeb6a32aba1 admin admin] The token cache is being invalidate because project 25f002e3ee644812a5af65932e05ba19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:48.844948 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-be225621-4a8c-4634-9296-9eeb6a32aba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:48.845588 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-be225621-4a8c-4634-9296-9eeb6a32aba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:48.847145 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1332/2669] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:48 2022] DELETE /identity/v3/projects/25f002e3ee644812a5af65932e05ba19 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:48.851396 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042265d-fd91-4da6-ab0a-c955c032f37a admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:48.852937 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0042265d-fd91-4da6-ab0a-c955c032f37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:48.867117 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042265d-fd91-4da6-ab0a-c955c032f37a admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:48.875877 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be225621-4a8c-4634-9296-9eeb6a32aba1 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:48.877569 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-be225621-4a8c-4634-9296-9eeb6a32aba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:48.942136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb197c-fe36-4858-af5a-6e4d9a2a95be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:48.943072 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb197c-fe36-4858-af5a-6e4d9a2a95be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:48.943402 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb197c-fe36-4858-af5a-6e4d9a2a95be admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:48.943682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb197c-fe36-4858-af5a-6e4d9a2a95be admin admin] PATH_INFO: `/v3/users/44bbf29462c34be2be4a23fc02884e69` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:48.944907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb197c-fe36-4858-af5a-6e4d9a2a95be admin admin] RBAC: Authorizing `identity:delete_user(user_id=44bbf29462c34be2be4a23fc02884e69)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:48.946846 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb197c-fe36-4858-af5a-6e4d9a2a95be admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:48.955525 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be225621-4a8c-4634-9296-9eeb6a32aba1 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:48.960193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21209058-e399-4e76-b82b-095007982f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:48.961046 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21209058-e399-4e76-b82b-095007982f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:48.961370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21209058-e399-4e76-b82b-095007982f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:48.961650 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21209058-e399-4e76-b82b-095007982f9a admin admin] PATH_INFO: `/v3/projects/275a28c90eed4af58373eb2367cd1b4b` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:48.962832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21209058-e399-4e76-b82b-095007982f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=275a28c90eed4af58373eb2367cd1b4b)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:48.964725 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21209058-e399-4e76-b82b-095007982f9a admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:48.996635 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-21fb197c-fe36-4858-af5a-6e4d9a2a95be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44bbf29462c34be2be4a23fc02884e69'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:48.997405 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-21fb197c-fe36-4858-af5a-6e4d9a2a95be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44bbf29462c34be2be4a23fc02884e69'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:48.998047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-21fb197c-fe36-4858-af5a-6e4d9a2a95be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44bbf29462c34be2be4a23fc02884e69'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.005119 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-21fb197c-fe36-4858-af5a-6e4d9a2a95be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44bbf29462c34be2be4a23fc02884e69'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.008743 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:49.013543 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-21fb197c-fe36-4858-af5a-6e4d9a2a95be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44bbf29462c34be2be4a23fc02884e69'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.014128 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-21209058-e399-4e76-b82b-095007982f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '275a28c90eed4af58373eb2367cd1b4b', 'request_id': 'req-21209058-e399-4e76-b82b-095007982f9a'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.020544 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-21209058-e399-4e76-b82b-095007982f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '275a28c90eed4af58373eb2367cd1b4b', 'request_id': 'req-21209058-e399-4e76-b82b-095007982f9a'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.026052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-21209058-e399-4e76-b82b-095007982f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '275a28c90eed4af58373eb2367cd1b4b', 'request_id': 'req-21209058-e399-4e76-b82b-095007982f9a'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.034420 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1338/2670] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:48 2022] DELETE /identity/v3/users/44bbf29462c34be2be4a23fc02884e69 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:49.039386 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-21209058-e399-4e76-b82b-095007982f9a admin admin] The token cache is being invalidate because project 275a28c90eed4af58373eb2367cd1b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:49.039734 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-21209058-e399-4e76-b82b-095007982f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.040537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-21209058-e399-4e76-b82b-095007982f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.042200 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1333/2671] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:48 2022] DELETE /identity/v3/projects/275a28c90eed4af58373eb2367cd1b4b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:49.046200 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb197c-fe36-4858-af5a-6e4d9a2a95be admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:49.047609 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-21fb197c-fe36-4858-af5a-6e4d9a2a95be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:49.114429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb197c-fe36-4858-af5a-6e4d9a2a95be admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:49.119420 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf057f9e-17e5-4aa3-9813-0ab601e16775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:49.120289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf057f9e-17e5-4aa3-9813-0ab601e16775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:49.120603 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf057f9e-17e5-4aa3-9813-0ab601e16775 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:49.120888 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf057f9e-17e5-4aa3-9813-0ab601e16775 admin admin] PATH_INFO: `/v3/users/65f5b6e6204a468fb24cc41535c62441` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:49.122131 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf057f9e-17e5-4aa3-9813-0ab601e16775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65f5b6e6204a468fb24cc41535c62441)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:49.124075 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf057f9e-17e5-4aa3-9813-0ab601e16775 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:49.173541 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cf057f9e-17e5-4aa3-9813-0ab601e16775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65f5b6e6204a468fb24cc41535c62441'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.174222 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cf057f9e-17e5-4aa3-9813-0ab601e16775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65f5b6e6204a468fb24cc41535c62441'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.177638 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cf057f9e-17e5-4aa3-9813-0ab601e16775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65f5b6e6204a468fb24cc41535c62441'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.186190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cf057f9e-17e5-4aa3-9813-0ab601e16775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65f5b6e6204a468fb24cc41535c62441'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.195480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cf057f9e-17e5-4aa3-9813-0ab601e16775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65f5b6e6204a468fb24cc41535c62441'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.213908 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1339/2672] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:49 2022] DELETE /identity/v3/users/65f5b6e6204a468fb24cc41535c62441 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:49.314479 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21209058-e399-4e76-b82b-095007982f9a admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:49.316123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-21209058-e399-4e76-b82b-095007982f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:49.374637 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:49.392935 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21209058-e399-4e76-b82b-095007982f9a admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:49.394222 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf057f9e-17e5-4aa3-9813-0ab601e16775 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:49.395833 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-cf057f9e-17e5-4aa3-9813-0ab601e16775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:49.456927 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b124c9a-ac38-4297-9f35-03af1cb8bd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:49.457741 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b124c9a-ac38-4297-9f35-03af1cb8bd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:49.458128 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b124c9a-ac38-4297-9f35-03af1cb8bd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:49.458413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b124c9a-ac38-4297-9f35-03af1cb8bd6b admin admin] PATH_INFO: `/v3/projects/ec56d4c1d9564bf0b5b19d3e7168970a` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:49.459636 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b124c9a-ac38-4297-9f35-03af1cb8bd6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec56d4c1d9564bf0b5b19d3e7168970a)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:49.461572 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b124c9a-ac38-4297-9f35-03af1cb8bd6b admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:49.474034 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:49.478108 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf057f9e-17e5-4aa3-9813-0ab601e16775 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:49.483538 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0ff92-c5a4-4765-967c-13457aad4159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:49.484700 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0ff92-c5a4-4765-967c-13457aad4159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:49.484937 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0ff92-c5a4-4765-967c-13457aad4159 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:49.485451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0ff92-c5a4-4765-967c-13457aad4159 admin admin] PATH_INFO: `/v3/projects/56aef6889f594cd480d54ad537ce701a` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:49.487244 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0ff92-c5a4-4765-967c-13457aad4159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56aef6889f594cd480d54ad537ce701a)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:49.489153 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0ff92-c5a4-4765-967c-13457aad4159 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:49.508735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-8b124c9a-ac38-4297-9f35-03af1cb8bd6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec56d4c1d9564bf0b5b19d3e7168970a', 'request_id': 'req-8b124c9a-ac38-4297-9f35-03af1cb8bd6b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.515516 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-8b124c9a-ac38-4297-9f35-03af1cb8bd6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec56d4c1d9564bf0b5b19d3e7168970a', 'request_id': 'req-8b124c9a-ac38-4297-9f35-03af1cb8bd6b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.521577 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-8b124c9a-ac38-4297-9f35-03af1cb8bd6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec56d4c1d9564bf0b5b19d3e7168970a', 'request_id': 'req-8b124c9a-ac38-4297-9f35-03af1cb8bd6b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.534905 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-8b124c9a-ac38-4297-9f35-03af1cb8bd6b admin admin] The token cache is being invalidate because project ec56d4c1d9564bf0b5b19d3e7168970a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:49.535173 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-8b124c9a-ac38-4297-9f35-03af1cb8bd6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.535809 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-8b124c9a-ac38-4297-9f35-03af1cb8bd6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.537479 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1334/2673] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:49 2022] DELETE /identity/v3/projects/ec56d4c1d9564bf0b5b19d3e7168970a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:49.542136 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e9d9a-dcb9-4c34-a9ae-4bed963e7f1a None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:49.542426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e9d9a-dcb9-4c34-a9ae-4bed963e7f1a None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:49.542705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e9d9a-dcb9-4c34-a9ae-4bed963e7f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:49.543440 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e4c0ff92-c5a4-4765-967c-13457aad4159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56aef6889f594cd480d54ad537ce701a', 'request_id': 'req-e4c0ff92-c5a4-4765-967c-13457aad4159'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.550849 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e4c0ff92-c5a4-4765-967c-13457aad4159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56aef6889f594cd480d54ad537ce701a', 'request_id': 'req-e4c0ff92-c5a4-4765-967c-13457aad4159'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.558837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e4c0ff92-c5a4-4765-967c-13457aad4159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56aef6889f594cd480d54ad537ce701a', 'request_id': 'req-e4c0ff92-c5a4-4765-967c-13457aad4159'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.566980 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-499e9d9a-dcb9-4c34-a9ae-4bed963e7f1a None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:49.568703 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-499e9d9a-dcb9-4c34-a9ae-4bed963e7f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:49.572034 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e4c0ff92-c5a4-4765-967c-13457aad4159 admin admin] The token cache is being invalidate because project 56aef6889f594cd480d54ad537ce701a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:49.572326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e4c0ff92-c5a4-4765-967c-13457aad4159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.572985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-e4c0ff92-c5a4-4765-967c-13457aad4159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.574630 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1340/2674] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:49 2022] DELETE /identity/v3/projects/56aef6889f594cd480d54ad537ce701a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:49.578989 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0ff92-c5a4-4765-967c-13457aad4159 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:49.580236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e4c0ff92-c5a4-4765-967c-13457aad4159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:49.628954 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1335/2675] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 14:00:49.634612 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d8c40-91df-4bfc-9ab5-7bc3307c46ff None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:49.635399 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d8c40-91df-4bfc-9ab5-7bc3307c46ff None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:49.635684 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d8c40-91df-4bfc-9ab5-7bc3307c46ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:49.644766 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0ff92-c5a4-4765-967c-13457aad4159 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:49.649304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba14f9-2cd4-470d-ab49-becfff808ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:49.650200 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba14f9-2cd4-470d-ab49-becfff808ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:49.650477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba14f9-2cd4-470d-ab49-becfff808ced admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:49.650748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba14f9-2cd4-470d-ab49-becfff808ced admin admin] PATH_INFO: `/v3/users/143be9a7b7544bba84b6db0b96a47e1b` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:49.651931 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba14f9-2cd4-470d-ab49-becfff808ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=143be9a7b7544bba84b6db0b96a47e1b)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:49.653791 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-9f1d8c40-91df-4bfc-9ab5-7bc3307c46ff None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:49.653931 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba14f9-2cd4-470d-ab49-becfff808ced admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:49.654986 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9f1d8c40-91df-4bfc-9ab5-7bc3307c46ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:49.662913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1336/2676] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:49.664187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00155679-9f9b-4c59-99ae-ee79827c8f43 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:49.664478 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00155679-9f9b-4c59-99ae-ee79827c8f43 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:49.664755 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00155679-9f9b-4c59-99ae-ee79827c8f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:49.682859 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-00155679-9f9b-4c59-99ae-ee79827c8f43 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:49.684063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-00155679-9f9b-4c59-99ae-ee79827c8f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:49.693054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1337/2677] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:49.694406 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e75fbb-ecbb-46dd-b015-dd7c35851fc1 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:49.694753 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e75fbb-ecbb-46dd-b015-dd7c35851fc1 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:49.695092 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e75fbb-ecbb-46dd-b015-dd7c35851fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:49.713168 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-20ba14f9-2cd4-470d-ab49-becfff808ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '143be9a7b7544bba84b6db0b96a47e1b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.713445 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-f4e75fbb-ecbb-46dd-b015-dd7c35851fc1 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:49.713807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-20ba14f9-2cd4-470d-ab49-becfff808ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '143be9a7b7544bba84b6db0b96a47e1b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.714432 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-20ba14f9-2cd4-470d-ab49-becfff808ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '143be9a7b7544bba84b6db0b96a47e1b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.714586 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f4e75fbb-ecbb-46dd-b015-dd7c35851fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:49.721463 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-20ba14f9-2cd4-470d-ab49-becfff808ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '143be9a7b7544bba84b6db0b96a47e1b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.722496 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1338/2678] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:49.725839 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e75fbb-ecbb-46dd-b015-dd7c35851fc1 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:49.725839 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f4e75fbb-ecbb-46dd-b015-dd7c35851fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:49.729629 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-20ba14f9-2cd4-470d-ab49-becfff808ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '143be9a7b7544bba84b6db0b96a47e1b'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:49.732373 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:49.736281 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e75fbb-ecbb-46dd-b015-dd7c35851fc1 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:49.743270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e4468-44ad-4337-9622-bf8dba7e8e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:49.744064 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e4468-44ad-4337-9622-bf8dba7e8e81 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:49.744511 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e4468-44ad-4337-9622-bf8dba7e8e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:49.744820 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e4468-44ad-4337-9622-bf8dba7e8e81 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:49.745570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e4468-44ad-4337-9622-bf8dba7e8e81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:00:49.745878 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e4468-44ad-4337-9622-bf8dba7e8e81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:49.748144 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e4468-44ad-4337-9622-bf8dba7e8e81 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:49.749832 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1341/2679] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:49 2022] DELETE /identity/v3/users/143be9a7b7544bba84b6db0b96a47e1b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:49.753493 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba14f9-2cd4-470d-ab49-becfff808ced admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:49.760261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1339/2680] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:00:49.761824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:49.764885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb98350-11fc-4793-a71b-6104a548ee24 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:49.765400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb98350-11fc-4793-a71b-6104a548ee24 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:49.765506 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb98350-11fc-4793-a71b-6104a548ee24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:49.783723 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-1fb98350-11fc-4793-a71b-6104a548ee24 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:49.784939 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1fb98350-11fc-4793-a71b-6104a548ee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:49.819983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba14f9-2cd4-470d-ab49-becfff808ced admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:49.824617 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe1058-a71c-499f-a25a-b6b3cd554344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:49.825496 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe1058-a71c-499f-a25a-b6b3cd554344 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:49.825780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe1058-a71c-499f-a25a-b6b3cd554344 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:49.826056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe1058-a71c-499f-a25a-b6b3cd554344 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:49.826774 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe1058-a71c-499f-a25a-b6b3cd554344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:00:49.827084 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe1058-a71c-499f-a25a-b6b3cd554344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:49.828665 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe1058-a71c-499f-a25a-b6b3cd554344 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:49.840108 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1342/2681] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:00:49.841009 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe1058-a71c-499f-a25a-b6b3cd554344 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:49.844829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1340/2682] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:49.844829 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb98350-11fc-4793-a71b-6104a548ee24 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:49.853786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe1058-a71c-499f-a25a-b6b3cd554344 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:49.855375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb98350-11fc-4793-a71b-6104a548ee24 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:49.859164 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0536176-40e8-471b-b523-410747e76d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:49.859812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0536176-40e8-471b-b523-410747e76d57 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:49.860097 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0536176-40e8-471b-b523-410747e76d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:49.860374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0536176-40e8-471b-b523-410747e76d57 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:49.860539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b6528-b816-4244-aa5e-1f98b01cf6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:49.861061 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0536176-40e8-471b-b523-410747e76d57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:49.861167 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6528-b816-4244-aa5e-1f98b01cf6fb admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:49.861468 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6528-b816-4244-aa5e-1f98b01cf6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:49.861740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6528-b816-4244-aa5e-1f98b01cf6fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:49.862410 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b6528-b816-4244-aa5e-1f98b01cf6fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:49.863102 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0536176-40e8-471b-b523-410747e76d57 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:49.864299 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b6528-b816-4244-aa5e-1f98b01cf6fb admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:49.891486 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1341/2683] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:49 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:49.892369 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b6528-b816-4244-aa5e-1f98b01cf6fb admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:49.893971 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-254b6528-b816-4244-aa5e-1f98b01cf6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:49.898364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1343/2684] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:49 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:49.899496 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0536176-40e8-471b-b523-410747e76d57 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:49.957440 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b6528-b816-4244-aa5e-1f98b01cf6fb admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:49.965179 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0536176-40e8-471b-b523-410747e76d57 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:49.970119 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f348202-15b9-4d07-bf7c-0951c16a6e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:49.970874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f348202-15b9-4d07-bf7c-0951c16a6e45 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:49.971161 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f348202-15b9-4d07-bf7c-0951c16a6e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:49.971440 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f348202-15b9-4d07-bf7c-0951c16a6e45 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:49.972125 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f348202-15b9-4d07-bf7c-0951c16a6e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:49.974096 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f348202-15b9-4d07-bf7c-0951c16a6e45 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:49.995440 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1344/2685] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:49 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:49.999807 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f348202-15b9-4d07-bf7c-0951c16a6e45 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:50.008895 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1725f9-76e6-477a-a5ce-320be1b25e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:50.009404 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f348202-15b9-4d07-bf7c-0951c16a6e45 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:50.009576 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1725f9-76e6-477a-a5ce-320be1b25e0b service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:50.009854 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1725f9-76e6-477a-a5ce-320be1b25e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:50.010126 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1725f9-76e6-477a-a5ce-320be1b25e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:50.014005 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb2229-a131-4e5c-9205-00ee3ed29d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:50.014643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb2229-a131-4e5c-9205-00ee3ed29d1f admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:50.014930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb2229-a131-4e5c-9205-00ee3ed29d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:50.015208 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb2229-a131-4e5c-9205-00ee3ed29d1f admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:50.015887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb2229-a131-4e5c-9205-00ee3ed29d1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:50.017810 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb2229-a131-4e5c-9205-00ee3ed29d1f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:50.019629 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1725f9-76e6-477a-a5ce-320be1b25e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:50.021123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1725f9-76e6-477a-a5ce-320be1b25e0b service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:50.032195 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1342/2686] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:50.033154 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1725f9-76e6-477a-a5ce-320be1b25e0b service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:50.043129 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1345/2687] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:49 2022] POST /identity/v3/users => generated 291 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:50.043311 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1725f9-76e6-477a-a5ce-320be1b25e0b service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:50.045332 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb2229-a131-4e5c-9205-00ee3ed29d1f admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:50.048187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192ed36-c0fc-47ea-84aa-40cdbf8b1ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:50.048835 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192ed36-c0fc-47ea-84aa-40cdbf8b1ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:50.049117 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192ed36-c0fc-47ea-84aa-40cdbf8b1ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:50.049425 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192ed36-c0fc-47ea-84aa-40cdbf8b1ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:50.050771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192ed36-c0fc-47ea-84aa-40cdbf8b1ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:50.052420 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192ed36-c0fc-47ea-84aa-40cdbf8b1ab8 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:50.055571 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb2229-a131-4e5c-9205-00ee3ed29d1f admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:50.060824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd800166-4fe2-4019-b9a9-cdf3779035c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:50.061525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd800166-4fe2-4019-b9a9-cdf3779035c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:50.061806 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd800166-4fe2-4019-b9a9-cdf3779035c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:50.062079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd800166-4fe2-4019-b9a9-cdf3779035c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:50.062799 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd800166-4fe2-4019-b9a9-cdf3779035c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:50.063538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1343/2688] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:50.064397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd800166-4fe2-4019-b9a9-cdf3779035c3 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:50.067405 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192ed36-c0fc-47ea-84aa-40cdbf8b1ab8 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:50.078975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192ed36-c0fc-47ea-84aa-40cdbf8b1ab8 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:50.079276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1346/2689] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 14:00:50.083228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd800166-4fe2-4019-b9a9-cdf3779035c3 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:50.084902 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15e107-93fc-416d-aa96-35c5d81f80f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:50.085837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15e107-93fc-416d-aa96-35c5d81f80f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:50.086118 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15e107-93fc-416d-aa96-35c5d81f80f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:50.086391 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15e107-93fc-416d-aa96-35c5d81f80f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:50.087115 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15e107-93fc-416d-aa96-35c5d81f80f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:50.088701 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15e107-93fc-416d-aa96-35c5d81f80f7 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:50.093971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd800166-4fe2-4019-b9a9-cdf3779035c3 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:50.099320 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea9ba4-9596-4eee-a212-b0cefc1bc7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:50.099959 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea9ba4-9596-4eee-a212-b0cefc1bc7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:50.100624 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea9ba4-9596-4eee-a212-b0cefc1bc7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:50.100624 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea9ba4-9596-4eee-a212-b0cefc1bc7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:50.101227 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea9ba4-9596-4eee-a212-b0cefc1bc7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:50.102801 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea9ba4-9596-4eee-a212-b0cefc1bc7e4 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:50.107090 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1344/2690] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:50.108178 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15e107-93fc-416d-aa96-35c5d81f80f7 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:50.114727 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1347/2691] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 14:00:50.119179 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea9ba4-9596-4eee-a212-b0cefc1bc7e4 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:50.120976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15e107-93fc-416d-aa96-35c5d81f80f7 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:50.127548 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c63ad-e1a4-4310-888a-ba122536ead5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:50.128282 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c63ad-e1a4-4310-888a-ba122536ead5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:50.128545 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c63ad-e1a4-4310-888a-ba122536ead5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:50.128816 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c63ad-e1a4-4310-888a-ba122536ead5 admin admin] PATH_INFO: `/v3/projects/867e13f7785d4c948be1f56faeb6d941/users/079d9f05586e4f139e68b7f1f434809b/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:50.130569 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea9ba4-9596-4eee-a212-b0cefc1bc7e4 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:50.131394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:50.135614 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab63a1-76be-4adf-8af5-5b8a058066e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:50.136483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab63a1-76be-4adf-8af5-5b8a058066e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:50.137184 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab63a1-76be-4adf-8af5-5b8a058066e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:50.137184 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab63a1-76be-4adf-8af5-5b8a058066e4 admin admin] PATH_INFO: `/v3/projects/23dcb10e5f7442cc8e288ebe2a249406/users/43f001ce1d1549bd891a1d221ae4c6f9/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:50.149136 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c63ad-e1a4-4310-888a-ba122536ead5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=867e13f7785d4c948be1f56faeb6d941, user_id=079d9f05586e4f139e68b7f1f434809b, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:50.151824 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c63ad-e1a4-4310-888a-ba122536ead5 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:50.155597 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab63a1-76be-4adf-8af5-5b8a058066e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23dcb10e5f7442cc8e288ebe2a249406, user_id=43f001ce1d1549bd891a1d221ae4c6f9, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:50.159887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab63a1-76be-4adf-8af5-5b8a058066e4 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:50.167875 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1345/2692] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:50 2022] PUT /identity/v3/projects/867e13f7785d4c948be1f56faeb6d941/users/079d9f05586e4f139e68b7f1f434809b/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:50.173308 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004b8b0-e642-40b0-b2d7-0c2b05abbe25 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:50.173674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004b8b0-e642-40b0-b2d7-0c2b05abbe25 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:50.174074 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004b8b0-e642-40b0-b2d7-0c2b05abbe25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:50.175044 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1348/2693] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:50 2022] PUT /identity/v3/projects/23dcb10e5f7442cc8e288ebe2a249406/users/43f001ce1d1549bd891a1d221ae4c6f9/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:50.185666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96178ad-a9ac-4eda-9068-e017f84cced3 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:50.185946 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96178ad-a9ac-4eda-9068-e017f84cced3 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:50.186221 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96178ad-a9ac-4eda-9068-e017f84cced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:50.194256 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-9004b8b0-e642-40b0-b2d7-0c2b05abbe25 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:50.194423 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:50.195649 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9004b8b0-e642-40b0-b2d7-0c2b05abbe25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:50.226617 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-c96178ad-a9ac-4eda-9068-e017f84cced3 None None] MFA Rules not processed for user `43f001ce1d1549bd891a1d221ae4c6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:50.227752 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-c96178ad-a9ac-4eda-9068-e017f84cced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:50.271177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1346/2694] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:50.282080 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004b8b0-e642-40b0-b2d7-0c2b05abbe25 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:50.283776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9004b8b0-e642-40b0-b2d7-0c2b05abbe25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:50.305318 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1349/2695] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:50.307941 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96178ad-a9ac-4eda-9068-e017f84cced3 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:50.320117 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96178ad-a9ac-4eda-9068-e017f84cced3 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:50.324856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f6208-58ee-4570-af97-6e43e6bcb328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:50.325592 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f6208-58ee-4570-af97-6e43e6bcb328 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:50.325879 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f6208-58ee-4570-af97-6e43e6bcb328 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:50.326163 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f6208-58ee-4570-af97-6e43e6bcb328 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:50.326854 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f6208-58ee-4570-af97-6e43e6bcb328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:50.328761 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f6208-58ee-4570-af97-6e43e6bcb328 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:50.349223 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004b8b0-e642-40b0-b2d7-0c2b05abbe25 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:50.356267 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3f27d-40e4-485e-aaac-e282d0b75ada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:50.357857 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3f27d-40e4-485e-aaac-e282d0b75ada service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:50.358145 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3f27d-40e4-485e-aaac-e282d0b75ada service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:50.358540 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3f27d-40e4-485e-aaac-e282d0b75ada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:50.362327 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1350/2696] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:50 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:00:50.363170 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f6208-58ee-4570-af97-6e43e6bcb328 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:50.366616 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ef6f6208-58ee-4570-af97-6e43e6bcb328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:50.369567 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3f27d-40e4-485e-aaac-e282d0b75ada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:50.371090 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3f27d-40e4-485e-aaac-e282d0b75ada service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:50.381870 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1347/2697] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 14:00:50.388017 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3f27d-40e4-485e-aaac-e282d0b75ada service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:50.398997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3f27d-40e4-485e-aaac-e282d0b75ada service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:50.446836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f6208-58ee-4570-af97-6e43e6bcb328 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:50.451976 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c80b69-4688-4a70-ad01-744ccc178dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:50.453228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c80b69-4688-4a70-ad01-744ccc178dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:50.453524 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c80b69-4688-4a70-ad01-744ccc178dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:50.453812 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c80b69-4688-4a70-ad01-744ccc178dd7 admin admin] PATH_INFO: `/v3/projects/c422e034fbc4456f83c54ee263a1fe3b` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:50.455443 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c80b69-4688-4a70-ad01-744ccc178dd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c422e034fbc4456f83c54ee263a1fe3b)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:50.458067 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c80b69-4688-4a70-ad01-744ccc178dd7 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:50.470423 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4d134-86d6-47bc-9e32-2e8ac9e2420f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:50.471145 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4d134-86d6-47bc-9e32-2e8ac9e2420f admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:50.471571 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4d134-86d6-47bc-9e32-2e8ac9e2420f admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:50.471848 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4d134-86d6-47bc-9e32-2e8ac9e2420f admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:50.472670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4d134-86d6-47bc-9e32-2e8ac9e2420f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:50.474654 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4d134-86d6-47bc-9e32-2e8ac9e2420f admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:50.501058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1348/2698] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:50 2022] POST /identity/v3/users => generated 296 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:50.503888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4d134-86d6-47bc-9e32-2e8ac9e2420f admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:50.516988 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4d134-86d6-47bc-9e32-2e8ac9e2420f admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:50.521055 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d5c80b69-4688-4a70-ad01-744ccc178dd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c422e034fbc4456f83c54ee263a1fe3b', 'request_id': 'req-d5c80b69-4688-4a70-ad01-744ccc178dd7'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:50.529412 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d5c80b69-4688-4a70-ad01-744ccc178dd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c422e034fbc4456f83c54ee263a1fe3b', 'request_id': 'req-d5c80b69-4688-4a70-ad01-744ccc178dd7'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:50.535574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:50.539406 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d5c80b69-4688-4a70-ad01-744ccc178dd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c422e034fbc4456f83c54ee263a1fe3b', 'request_id': 'req-d5c80b69-4688-4a70-ad01-744ccc178dd7'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:50.552573 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d5c80b69-4688-4a70-ad01-744ccc178dd7 admin admin] The token cache is being invalidate because project c422e034fbc4456f83c54ee263a1fe3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:50.552990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d5c80b69-4688-4a70-ad01-744ccc178dd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:50.553772 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d5c80b69-4688-4a70-ad01-744ccc178dd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:50.555724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1351/2699] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:50 2022] DELETE /identity/v3/projects/c422e034fbc4456f83c54ee263a1fe3b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:50.597737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc9c9c-ee9a-41b3-bb06-6f787068cdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:50.598593 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc9c9c-ee9a-41b3-bb06-6f787068cdcb admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:50.598976 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc9c9c-ee9a-41b3-bb06-6f787068cdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:50.599342 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc9c9c-ee9a-41b3-bb06-6f787068cdcb admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:50.600195 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc9c9c-ee9a-41b3-bb06-6f787068cdcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:50.602249 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc9c9c-ee9a-41b3-bb06-6f787068cdcb admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:50.617403 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1349/2700] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 14:00:50.623522 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c80b69-4688-4a70-ad01-744ccc178dd7 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:50.627599 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d5c80b69-4688-4a70-ad01-744ccc178dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:50.637920 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:50.645389 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c80b69-4688-4a70-ad01-744ccc178dd7 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:50.654410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9d1e6-1520-4da1-9db2-04240f30e298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:50.656339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9d1e6-1520-4da1-9db2-04240f30e298 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:50.656884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9d1e6-1520-4da1-9db2-04240f30e298 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:50.657232 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9d1e6-1520-4da1-9db2-04240f30e298 admin admin] PATH_INFO: `/v3/projects/85876310590e4b51a83106e2125b1845/users/3035454352e84714a8942ebc8345919b/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:50.677241 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9d1e6-1520-4da1-9db2-04240f30e298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85876310590e4b51a83106e2125b1845, user_id=3035454352e84714a8942ebc8345919b, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:50.679216 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9d1e6-1520-4da1-9db2-04240f30e298 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:50.698758 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1352/2701] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:50 2022] PUT /identity/v3/projects/85876310590e4b51a83106e2125b1845/users/3035454352e84714a8942ebc8345919b/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:50.702953 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc9c9c-ee9a-41b3-bb06-6f787068cdcb admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:50.716136 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc9c9c-ee9a-41b3-bb06-6f787068cdcb admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:50.796867 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b86588-3fe4-4e20-9001-b8eb331f418a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:50.797730 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b86588-3fe4-4e20-9001-b8eb331f418a admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:50.798159 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b86588-3fe4-4e20-9001-b8eb331f418a admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:50.798557 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b86588-3fe4-4e20-9001-b8eb331f418a admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:50.799418 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b86588-3fe4-4e20-9001-b8eb331f418a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:50.801930 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b86588-3fe4-4e20-9001-b8eb331f418a admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:50.816610 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1350/2702] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:50.820976 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9d1e6-1520-4da1-9db2-04240f30e298 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:50.834811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9d1e6-1520-4da1-9db2-04240f30e298 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:50.841516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966212b-be6a-425d-b068-296b3c38e854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:50.843285 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966212b-be6a-425d-b068-296b3c38e854 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:50.843813 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966212b-be6a-425d-b068-296b3c38e854 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:50.844313 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966212b-be6a-425d-b068-296b3c38e854 admin admin] PATH_INFO: `/v3/projects/85876310590e4b51a83106e2125b1845/users/3035454352e84714a8942ebc8345919b/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:50.847803 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966212b-be6a-425d-b068-296b3c38e854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85876310590e4b51a83106e2125b1845, user_id=3035454352e84714a8942ebc8345919b, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:50.853274 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966212b-be6a-425d-b068-296b3c38e854 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:50.869643 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1353/2703] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:50 2022] PUT /identity/v3/projects/85876310590e4b51a83106e2125b1845/users/3035454352e84714a8942ebc8345919b/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:50.882963 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e216875-5101-4064-add5-0c7905ad350c None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:50.883478 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e216875-5101-4064-add5-0c7905ad350c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:50.884003 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e216875-5101-4064-add5-0c7905ad350c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:50.914477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-5e216875-5101-4064-add5-0c7905ad350c None None] MFA Rules not processed for user `3035454352e84714a8942ebc8345919b`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:50.915680 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-5e216875-5101-4064-add5-0c7905ad350c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:50.986483 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1351/2704] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 14:00:50.997716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966212b-be6a-425d-b068-296b3c38e854 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:50.999446 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7966212b-be6a-425d-b068-296b3c38e854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:51.059329 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966212b-be6a-425d-b068-296b3c38e854 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:51.063261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c1e5f-c846-4405-8b14-c005a6f802e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:51.063907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c1e5f-c846-4405-8b14-c005a6f802e5 service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:51.064191 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c1e5f-c846-4405-8b14-c005a6f802e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:51.064525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c1e5f-c846-4405-8b14-c005a6f802e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:51.074408 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c1e5f-c846-4405-8b14-c005a6f802e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:51.075907 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c1e5f-c846-4405-8b14-c005a6f802e5 service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:51.086449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1354/2705] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:51.485622 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e216875-5101-4064-add5-0c7905ad350c None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:51.526951 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:51.564646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e216875-5101-4064-add5-0c7905ad350c None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:51.570354 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ee263-d948-4d59-ae4a-33835ea74d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:51.571536 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ee263-d948-4d59-ae4a-33835ea74d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:51.571996 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ee263-d948-4d59-ae4a-33835ea74d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:51.572508 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ee263-d948-4d59-ae4a-33835ea74d05 admin admin] PATH_INFO: `/v3/users/43f001ce1d1549bd891a1d221ae4c6f9` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:51.573913 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ee263-d948-4d59-ae4a-33835ea74d05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f001ce1d1549bd891a1d221ae4c6f9)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:51.576563 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ee263-d948-4d59-ae4a-33835ea74d05 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:51.633170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f07ee263-d948-4d59-ae4a-33835ea74d05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f001ce1d1549bd891a1d221ae4c6f9'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:51.650225 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f07ee263-d948-4d59-ae4a-33835ea74d05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f001ce1d1549bd891a1d221ae4c6f9'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:51.651015 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f07ee263-d948-4d59-ae4a-33835ea74d05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f001ce1d1549bd891a1d221ae4c6f9'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:51.651634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f07ee263-d948-4d59-ae4a-33835ea74d05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f001ce1d1549bd891a1d221ae4c6f9'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:51.661398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f07ee263-d948-4d59-ae4a-33835ea74d05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f001ce1d1549bd891a1d221ae4c6f9'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:51.675814 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1352/2706] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:51 2022] DELETE /identity/v3/users/43f001ce1d1549bd891a1d221ae4c6f9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:51.686577 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb51ac1-ec9c-410f-be0f-d12ecb3fae09 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:51.686874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb51ac1-ec9c-410f-be0f-d12ecb3fae09 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:51.687148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb51ac1-ec9c-410f-be0f-d12ecb3fae09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:51.710090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-efb51ac1-ec9c-410f-be0f-d12ecb3fae09 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:51.711559 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-efb51ac1-ec9c-410f-be0f-d12ecb3fae09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:51.779540 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1355/2707] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:51.792831 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ee263-d948-4d59-ae4a-33835ea74d05 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:51.794761 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f07ee263-d948-4d59-ae4a-33835ea74d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:51.866686 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ee263-d948-4d59-ae4a-33835ea74d05 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:51.874330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82d81a-beff-4f7b-8435-688a031ef029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:51.879932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82d81a-beff-4f7b-8435-688a031ef029 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:51.880300 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82d81a-beff-4f7b-8435-688a031ef029 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:51.880653 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82d81a-beff-4f7b-8435-688a031ef029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:51.894224 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82d81a-beff-4f7b-8435-688a031ef029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:51.896485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82d81a-beff-4f7b-8435-688a031ef029 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:51.911681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1353/2708] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 14:00:52.404931 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb51ac1-ec9c-410f-be0f-d12ecb3fae09 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:52.406553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-efb51ac1-ec9c-410f-be0f-d12ecb3fae09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:52.421343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb51ac1-ec9c-410f-be0f-d12ecb3fae09 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:52.426038 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52598220-dc13-41a7-84db-c92f83400b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:52.426929 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52598220-dc13-41a7-84db-c92f83400b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:52.427215 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52598220-dc13-41a7-84db-c92f83400b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:52.427995 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52598220-dc13-41a7-84db-c92f83400b60 admin admin] PATH_INFO: `/v3/projects/23dcb10e5f7442cc8e288ebe2a249406` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:52.429811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52598220-dc13-41a7-84db-c92f83400b60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23dcb10e5f7442cc8e288ebe2a249406)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:52.431769 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52598220-dc13-41a7-84db-c92f83400b60 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:52.479969 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-52598220-dc13-41a7-84db-c92f83400b60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23dcb10e5f7442cc8e288ebe2a249406', 'request_id': 'req-52598220-dc13-41a7-84db-c92f83400b60'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:52.486877 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-52598220-dc13-41a7-84db-c92f83400b60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23dcb10e5f7442cc8e288ebe2a249406', 'request_id': 'req-52598220-dc13-41a7-84db-c92f83400b60'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:52.496014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-52598220-dc13-41a7-84db-c92f83400b60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23dcb10e5f7442cc8e288ebe2a249406', 'request_id': 'req-52598220-dc13-41a7-84db-c92f83400b60'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:52.498777 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:52.511528 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-52598220-dc13-41a7-84db-c92f83400b60 admin admin] The token cache is being invalidate because project 23dcb10e5f7442cc8e288ebe2a249406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:52.511918 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-52598220-dc13-41a7-84db-c92f83400b60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:52.513485 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-52598220-dc13-41a7-84db-c92f83400b60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:52.515189 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1356/2709] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:52 2022] DELETE /identity/v3/projects/23dcb10e5f7442cc8e288ebe2a249406 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:52.519938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82d81a-beff-4f7b-8435-688a031ef029 service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:52.531252 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82d81a-beff-4f7b-8435-688a031ef029 service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:52.596816 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:52.610313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c134b-b3c3-433b-9938-458fff92a178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:52.611512 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c134b-b3c3-433b-9938-458fff92a178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:52.611919 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c134b-b3c3-433b-9938-458fff92a178 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:52.612593 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c134b-b3c3-433b-9938-458fff92a178 admin admin] PATH_INFO: `/v3/users/3035454352e84714a8942ebc8345919b` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:52.614493 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c134b-b3c3-433b-9938-458fff92a178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3035454352e84714a8942ebc8345919b)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:52.617467 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c134b-b3c3-433b-9938-458fff92a178 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:52.686922 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-027c134b-b3c3-433b-9938-458fff92a178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3035454352e84714a8942ebc8345919b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:52.701745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-027c134b-b3c3-433b-9938-458fff92a178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3035454352e84714a8942ebc8345919b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:52.702524 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-027c134b-b3c3-433b-9938-458fff92a178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3035454352e84714a8942ebc8345919b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:52.703147 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-027c134b-b3c3-433b-9938-458fff92a178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3035454352e84714a8942ebc8345919b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:52.718528 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-027c134b-b3c3-433b-9938-458fff92a178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3035454352e84714a8942ebc8345919b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:52.741300 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1354/2710] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:00:52 2022] DELETE /identity/v3/users/3035454352e84714a8942ebc8345919b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:53.158644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52598220-dc13-41a7-84db-c92f83400b60 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:53.160822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-52598220-dc13-41a7-84db-c92f83400b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:53.186761 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52598220-dc13-41a7-84db-c92f83400b60 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:53.281158 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad179bc-cb78-4485-80fd-7521fea2fe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:53.282385 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad179bc-cb78-4485-80fd-7521fea2fe1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:53.283318 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad179bc-cb78-4485-80fd-7521fea2fe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:53.284283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad179bc-cb78-4485-80fd-7521fea2fe1f admin admin] PATH_INFO: `/v3/projects/85876310590e4b51a83106e2125b1845` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:53.286029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad179bc-cb78-4485-80fd-7521fea2fe1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=85876310590e4b51a83106e2125b1845)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:53.287997 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad179bc-cb78-4485-80fd-7521fea2fe1f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:53.356548 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8ad179bc-cb78-4485-80fd-7521fea2fe1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85876310590e4b51a83106e2125b1845', 'request_id': 'req-8ad179bc-cb78-4485-80fd-7521fea2fe1f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:53.363780 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8ad179bc-cb78-4485-80fd-7521fea2fe1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85876310590e4b51a83106e2125b1845', 'request_id': 'req-8ad179bc-cb78-4485-80fd-7521fea2fe1f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:53.377653 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8ad179bc-cb78-4485-80fd-7521fea2fe1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85876310590e4b51a83106e2125b1845', 'request_id': 'req-8ad179bc-cb78-4485-80fd-7521fea2fe1f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:53.392630 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8ad179bc-cb78-4485-80fd-7521fea2fe1f admin admin] The token cache is being invalidate because project 85876310590e4b51a83106e2125b1845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:00:53.393121 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8ad179bc-cb78-4485-80fd-7521fea2fe1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:53.394313 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-8ad179bc-cb78-4485-80fd-7521fea2fe1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:00:53.399040 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1357/2711] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:00:53 2022] DELETE /identity/v3/projects/85876310590e4b51a83106e2125b1845 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:53.405291 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cad866-e91f-48fb-a397-bea2bab0264d None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:53.409793 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cad866-e91f-48fb-a397-bea2bab0264d None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:53.410261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cad866-e91f-48fb-a397-bea2bab0264d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:53.437716 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-45cad866-e91f-48fb-a397-bea2bab0264d None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:53.439265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-45cad866-e91f-48fb-a397-bea2bab0264d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:53.521401 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1355/2712] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:53.530189 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44768a78-2695-43a8-9a4d-045ac7ed8896 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:53.530712 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44768a78-2695-43a8-9a4d-045ac7ed8896 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:53.530943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44768a78-2695-43a8-9a4d-045ac7ed8896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:53.555380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-44768a78-2695-43a8-9a4d-045ac7ed8896 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:53.556798 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-44768a78-2695-43a8-9a4d-045ac7ed8896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:53.569611 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1358/2713] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:53.574567 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cad866-e91f-48fb-a397-bea2bab0264d None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:53.587867 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cad866-e91f-48fb-a397-bea2bab0264d None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:53.594568 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86117f2a-9dee-43d5-a601-1fe5c6b5cea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:53.595364 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86117f2a-9dee-43d5-a601-1fe5c6b5cea5 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:53.595750 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86117f2a-9dee-43d5-a601-1fe5c6b5cea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:53.597413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86117f2a-9dee-43d5-a601-1fe5c6b5cea5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:53.599160 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86117f2a-9dee-43d5-a601-1fe5c6b5cea5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:00:53.599583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86117f2a-9dee-43d5-a601-1fe5c6b5cea5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:53.601409 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86117f2a-9dee-43d5-a601-1fe5c6b5cea5 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:53.621145 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1356/2714] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:00:53.621615 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44768a78-2695-43a8-9a4d-045ac7ed8896 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:53.635106 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44768a78-2695-43a8-9a4d-045ac7ed8896 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:53.641314 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fcce1-1ae4-46bb-ac82-7d8ec8047f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:53.641994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fcce1-1ae4-46bb-ac82-7d8ec8047f83 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:53.642276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fcce1-1ae4-46bb-ac82-7d8ec8047f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:53.642555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fcce1-1ae4-46bb-ac82-7d8ec8047f83 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:53.643247 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fcce1-1ae4-46bb-ac82-7d8ec8047f83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:53.645156 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fcce1-1ae4-46bb-ac82-7d8ec8047f83 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:53.698460 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1359/2715] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:53 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:00:53.699573 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86117f2a-9dee-43d5-a601-1fe5c6b5cea5 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:53.712038 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86117f2a-9dee-43d5-a601-1fe5c6b5cea5 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:53.790769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1984c73-c071-4d9e-918c-8f3a5be1d9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:53.791569 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984c73-c071-4d9e-918c-8f3a5be1d9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:53.791911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984c73-c071-4d9e-918c-8f3a5be1d9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:53.792281 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984c73-c071-4d9e-918c-8f3a5be1d9c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:53.793067 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1984c73-c071-4d9e-918c-8f3a5be1d9c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:53.795849 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1984c73-c071-4d9e-918c-8f3a5be1d9c1 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:53.804576 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:53.823443 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1357/2716] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:53 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:53.827797 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fcce1-1ae4-46bb-ac82-7d8ec8047f83 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:53.839660 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fcce1-1ae4-46bb-ac82-7d8ec8047f83 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:53.844626 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2830c-7258-4030-9150-e134e29b0c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:53.845437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2830c-7258-4030-9150-e134e29b0c49 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:53.845811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2830c-7258-4030-9150-e134e29b0c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:53.846160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2830c-7258-4030-9150-e134e29b0c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:53.847056 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2830c-7258-4030-9150-e134e29b0c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:53.849053 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2830c-7258-4030-9150-e134e29b0c49 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:53.864081 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1360/2717] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:00:53.866776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1984c73-c071-4d9e-918c-8f3a5be1d9c1 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:53.881123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1984c73-c071-4d9e-918c-8f3a5be1d9c1 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:53.886813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b470a-24a2-448d-8ee0-1098d8a5b778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:53.887738 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b470a-24a2-448d-8ee0-1098d8a5b778 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:53.888029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b470a-24a2-448d-8ee0-1098d8a5b778 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:53.888310 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b470a-24a2-448d-8ee0-1098d8a5b778 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:53.889203 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b470a-24a2-448d-8ee0-1098d8a5b778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:53.890854 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b470a-24a2-448d-8ee0-1098d8a5b778 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:53.904340 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1358/2718] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 14:00:53.908631 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2830c-7258-4030-9150-e134e29b0c49 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:53.919649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2830c-7258-4030-9150-e134e29b0c49 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:53.924657 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a681c09-d5fe-44a5-b224-25b9b2ba248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:53.925942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a681c09-d5fe-44a5-b224-25b9b2ba248c admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:53.926326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a681c09-d5fe-44a5-b224-25b9b2ba248c admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:53.926707 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a681c09-d5fe-44a5-b224-25b9b2ba248c admin admin] PATH_INFO: `/v3/projects/ef7ab605539240ee84f957577a76f8a6/users/dc146107465f4aa3b5392e6589ec9c52/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:53.942256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a681c09-d5fe-44a5-b224-25b9b2ba248c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef7ab605539240ee84f957577a76f8a6, user_id=dc146107465f4aa3b5392e6589ec9c52, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:53.945009 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a681c09-d5fe-44a5-b224-25b9b2ba248c admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:53.970200 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1361/2719] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:53 2022] PUT /identity/v3/projects/ef7ab605539240ee84f957577a76f8a6/users/dc146107465f4aa3b5392e6589ec9c52/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:00:53.972023 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2ed35-5f34-40ff-8109-47d3b1f1702c None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:53.972502 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2ed35-5f34-40ff-8109-47d3b1f1702c None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:53.972860 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2ed35-5f34-40ff-8109-47d3b1f1702c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:54.004736 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-e4f2ed35-5f34-40ff-8109-47d3b1f1702c None None] MFA Rules not processed for user `dc146107465f4aa3b5392e6589ec9c52`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:54.006123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e4f2ed35-5f34-40ff-8109-47d3b1f1702c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:54.081301 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1359/2720] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:54.102278 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a681c09-d5fe-44a5-b224-25b9b2ba248c admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:54.107767 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-4a681c09-d5fe-44a5-b224-25b9b2ba248c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:54.140703 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:54.195159 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a681c09-d5fe-44a5-b224-25b9b2ba248c admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:54.200384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c4edd-cf86-4eb5-b533-34503d9b16c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3039ec7e613464c8a71f4440dfe8bc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:54.201318 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c4edd-cf86-4eb5-b533-34503d9b16c1 service glance] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:54.202256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c4edd-cf86-4eb5-b533-34503d9b16c1 service glance] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:54.202964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c4edd-cf86-4eb5-b533-34503d9b16c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:54.219912 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c4edd-cf86-4eb5-b533-34503d9b16c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:54.221437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c4edd-cf86-4eb5-b533-34503d9b16c1 service glance] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:54.232522 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1362/2721] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:00:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:00:55.136377 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39aa896-2e4c-450f-b8c9-71d4fc17c799 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:55.136911 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39aa896-2e4c-450f-b8c9-71d4fc17c799 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:55.137418 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39aa896-2e4c-450f-b8c9-71d4fc17c799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:55.170221 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-e39aa896-2e4c-450f-b8c9-71d4fc17c799 None None] MFA Rules not processed for user `079d9f05586e4f139e68b7f1f434809b`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:00:55.171519 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e39aa896-2e4c-450f-b8c9-71d4fc17c799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:55.273100 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1360/2722] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:00:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:00:55.274947 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c4edd-cf86-4eb5-b533-34503d9b16c1 service glance] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:55.276582 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-4b1c4edd-cf86-4eb5-b533-34503d9b16c1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:00:55.359384 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c4edd-cf86-4eb5-b533-34503d9b16c1 service glance] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:55.366303 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417e0e2-098f-441c-954a-316e33f6ddc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:55.367085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417e0e2-098f-441c-954a-316e33f6ddc0 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:55.367436 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417e0e2-098f-441c-954a-316e33f6ddc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:55.367790 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417e0e2-098f-441c-954a-316e33f6ddc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:55.368556 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417e0e2-098f-441c-954a-316e33f6ddc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:55.370611 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417e0e2-098f-441c-954a-316e33f6ddc0 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:55.398300 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1363/2723] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:00:55 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:00:55.402364 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39aa896-2e4c-450f-b8c9-71d4fc17c799 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:55.413197 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39aa896-2e4c-450f-b8c9-71d4fc17c799 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:55.470070 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cf00f-0c37-42fc-acca-eb636fc2b0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:55.470641 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cf00f-0c37-42fc-acca-eb636fc2b0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:55.470952 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cf00f-0c37-42fc-acca-eb636fc2b0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:55.471236 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cf00f-0c37-42fc-acca-eb636fc2b0e8 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:55.471923 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cf00f-0c37-42fc-acca-eb636fc2b0e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:55.473908 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cf00f-0c37-42fc-acca-eb636fc2b0e8 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:55.480477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:55.495766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1361/2724] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:00:55 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:00:55.500279 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417e0e2-098f-441c-954a-316e33f6ddc0 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:55.510767 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417e0e2-098f-441c-954a-316e33f6ddc0 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:55.515820 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d95c77-ee31-486e-8dc8-99b7b0a041b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:55.516514 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d95c77-ee31-486e-8dc8-99b7b0a041b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:55.516803 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d95c77-ee31-486e-8dc8-99b7b0a041b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:55.517080 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d95c77-ee31-486e-8dc8-99b7b0a041b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:55.517838 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d95c77-ee31-486e-8dc8-99b7b0a041b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:55.519517 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d95c77-ee31-486e-8dc8-99b7b0a041b4 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:55.530425 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1364/2725] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 14:00:55.534737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cf00f-0c37-42fc-acca-eb636fc2b0e8 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:55.546193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cf00f-0c37-42fc-acca-eb636fc2b0e8 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:55.551218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a5a84-ee76-4eea-a8c7-91214c941f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:55.552112 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a5a84-ee76-4eea-a8c7-91214c941f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:55.552400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a5a84-ee76-4eea-a8c7-91214c941f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:55.552679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a5a84-ee76-4eea-a8c7-91214c941f4e admin admin] PATH_INFO: `/v3/projects/868206cf31bf4026ab61f493cd62bbab/users/1bd3253fc4ea4ea5942d3ce54206a37f/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:55.571400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a5a84-ee76-4eea-a8c7-91214c941f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=868206cf31bf4026ab61f493cd62bbab, user_id=1bd3253fc4ea4ea5942d3ce54206a37f, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:55.574160 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a5a84-ee76-4eea-a8c7-91214c941f4e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:55.591122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1362/2726] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:55 2022] PUT /identity/v3/projects/868206cf31bf4026ab61f493cd62bbab/users/1bd3253fc4ea4ea5942d3ce54206a37f/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:00:55.595288 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d95c77-ee31-486e-8dc8-99b7b0a041b4 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:55.606037 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d95c77-ee31-486e-8dc8-99b7b0a041b4 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:55.664192 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7854c-f98f-4699-9589-cd89931b3fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:55.664870 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7854c-f98f-4699-9589-cd89931b3fda admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:55.665156 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7854c-f98f-4699-9589-cd89931b3fda admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:55.665464 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7854c-f98f-4699-9589-cd89931b3fda admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:55.666191 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7854c-f98f-4699-9589-cd89931b3fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:55.667786 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7854c-f98f-4699-9589-cd89931b3fda admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:55.678347 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1365/2727] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 14:00:55.682462 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a5a84-ee76-4eea-a8c7-91214c941f4e admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:00:55.693529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a5a84-ee76-4eea-a8c7-91214c941f4e admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:00:55.698325 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986a25a-0923-4bf2-9b53-ba9d2bfbe383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:00:55.699214 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986a25a-0923-4bf2-9b53-ba9d2bfbe383 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:00:55.699619 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986a25a-0923-4bf2-9b53-ba9d2bfbe383 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:00:55.699812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986a25a-0923-4bf2-9b53-ba9d2bfbe383 admin admin] PATH_INFO: `/v3/projects/868206cf31bf4026ab61f493cd62bbab/users/1bd3253fc4ea4ea5942d3ce54206a37f/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:00:55.702449 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986a25a-0923-4bf2-9b53-ba9d2bfbe383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=868206cf31bf4026ab61f493cd62bbab, user_id=1bd3253fc4ea4ea5942d3ce54206a37f, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:00:55.705150 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986a25a-0923-4bf2-9b53-ba9d2bfbe383 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:00:55.715870 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1363/2728] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:00:55 2022] PUT /identity/v3/projects/868206cf31bf4026ab61f493cd62bbab/users/1bd3253fc4ea4ea5942d3ce54206a37f/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:00.266883 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a483b-421e-4307-8a09-20c0fe3e4c1f None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:00.267379 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a483b-421e-4307-8a09-20c0fe3e4c1f None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:00.268319 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a483b-421e-4307-8a09-20c0fe3e4c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:00.321429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-f05a483b-421e-4307-8a09-20c0fe3e4c1f None None] MFA Rules not processed for user `1bd3253fc4ea4ea5942d3ce54206a37f`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:00.322829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-f05a483b-421e-4307-8a09-20c0fe3e4c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:00.355991 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:00.438213 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1366/2729] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:00.446458 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986a25a-0923-4bf2-9b53-ba9d2bfbe383 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:00.519154 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986a25a-0923-4bf2-9b53-ba9d2bfbe383 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:00.522593 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f8a37-32fb-4e7f-b487-8edfb782ccc9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3039ec7e613464c8a71f4440dfe8bc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:00.523256 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f8a37-32fb-4e7f-b487-8edfb782ccc9 service glance] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:00.523546 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f8a37-32fb-4e7f-b487-8edfb782ccc9 service glance] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:00.523821 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f8a37-32fb-4e7f-b487-8edfb782ccc9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:00.586796 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f8a37-32fb-4e7f-b487-8edfb782ccc9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:00.588265 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f8a37-32fb-4e7f-b487-8edfb782ccc9 service glance] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:00.602569 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1364/2730] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:01:00.738974 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdb6a9-2e38-4745-8e2e-85343751c2a7 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:00.739274 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdb6a9-2e38-4745-8e2e-85343751c2a7 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:00.739563 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdb6a9-2e38-4745-8e2e-85343751c2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:00.764422 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-0fbdb6a9-2e38-4745-8e2e-85343751c2a7 None None] MFA Rules not processed for user `135410329e56486c8ccb65b1f2d87aca`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:00.765473 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0fbdb6a9-2e38-4745-8e2e-85343751c2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:00.839962 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1367/2731] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:00.866876 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f8a37-32fb-4e7f-b487-8edfb782ccc9 service glance] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:00.868321 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c88f8a37-32fb-4e7f-b487-8edfb782ccc9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:00.959427 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f8a37-32fb-4e7f-b487-8edfb782ccc9 service glance] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:00.964767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6691a-8603-44e5-b446-611f2e4f6df0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e517dc43cc6d401e820c65ad4c941386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:00.965997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6691a-8603-44e5-b446-611f2e4f6df0 service swift] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:00.966284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6691a-8603-44e5-b446-611f2e4f6df0 service swift] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:00.966563 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6691a-8603-44e5-b446-611f2e4f6df0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:00.974096 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:00.982191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6691a-8603-44e5-b446-611f2e4f6df0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:00.983832 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6691a-8603-44e5-b446-611f2e4f6df0 service swift] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:00.993675 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1365/2732] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 14:01:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 14:01:09.952346 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdb6a9-2e38-4745-8e2e-85343751c2a7 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:09.953904 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0fbdb6a9-2e38-4745-8e2e-85343751c2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:10.017399 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdb6a9-2e38-4745-8e2e-85343751c2a7 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:10.021397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391d1be-09c4-412f-9bd5-a4c8e449e47a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:10.022092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391d1be-09c4-412f-9bd5-a4c8e449e47a service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:10.022375 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391d1be-09c4-412f-9bd5-a4c8e449e47a service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:10.022644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391d1be-09c4-412f-9bd5-a4c8e449e47a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:10.026343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-5391d1be-09c4-412f-9bd5-a4c8e449e47a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:10.098778 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391d1be-09c4-412f-9bd5-a4c8e449e47a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:10.100256 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391d1be-09c4-412f-9bd5-a4c8e449e47a service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:10.112697 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1368/2733] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:01:10.920430 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fd531-c865-47a9-be32-6985785a0c82 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:10.920860 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fd531-c865-47a9-be32-6985785a0c82 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:10.921183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fd531-c865-47a9-be32-6985785a0c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:10.941035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-788fd531-c865-47a9-be32-6985785a0c82 None None] MFA Rules not processed for user `079d9f05586e4f139e68b7f1f434809b`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:10.942371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-788fd531-c865-47a9-be32-6985785a0c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:10.950049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1366/2734] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:13.191236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0579732-824a-46d0-8573-426f17d5769c None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:13.191824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0579732-824a-46d0-8573-426f17d5769c None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:13.191824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0579732-824a-46d0-8573-426f17d5769c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:13.218868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-f0579732-824a-46d0-8573-426f17d5769c None None] MFA Rules not processed for user `135410329e56486c8ccb65b1f2d87aca`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:13.220110 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-f0579732-824a-46d0-8573-426f17d5769c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:13.238874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1369/2735] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 14:01:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:13.254262 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fd531-c865-47a9-be32-6985785a0c82 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:13.268581 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fd531-c865-47a9-be32-6985785a0c82 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:13.275297 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b06703-e3b3-470f-977b-d915913f726c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e517dc43cc6d401e820c65ad4c941386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:13.276324 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b06703-e3b3-470f-977b-d915913f726c service swift] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:13.276801 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b06703-e3b3-470f-977b-d915913f726c service swift] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:13.277540 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b06703-e3b3-470f-977b-d915913f726c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:13.288389 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b06703-e3b3-470f-977b-d915913f726c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:13.290188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b06703-e3b3-470f-977b-d915913f726c service swift] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:13.318018 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1367/2736] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 14:01:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 14:01:14.450280 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0579732-824a-46d0-8573-426f17d5769c None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:14.453671 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-f0579732-824a-46d0-8573-426f17d5769c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:14.478699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:14.491736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0579732-824a-46d0-8573-426f17d5769c None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:14.510098 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e18124-c3a8-45de-aeca-1b0236eeb601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:14.519229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e18124-c3a8-45de-aeca-1b0236eeb601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:14.521414 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e18124-c3a8-45de-aeca-1b0236eeb601 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:14.522043 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e18124-c3a8-45de-aeca-1b0236eeb601 admin admin] PATH_INFO: `/v3/users/ff4a8240c1f4495eb3f518a7f1b741bf` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:14.529696 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e18124-c3a8-45de-aeca-1b0236eeb601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4a8240c1f4495eb3f518a7f1b741bf)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:14.531668 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e18124-c3a8-45de-aeca-1b0236eeb601 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:14.686119 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c1e18124-c3a8-45de-aeca-1b0236eeb601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4a8240c1f4495eb3f518a7f1b741bf'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:14.688403 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c1e18124-c3a8-45de-aeca-1b0236eeb601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4a8240c1f4495eb3f518a7f1b741bf'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:14.690136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c1e18124-c3a8-45de-aeca-1b0236eeb601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4a8240c1f4495eb3f518a7f1b741bf'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:14.704898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c1e18124-c3a8-45de-aeca-1b0236eeb601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4a8240c1f4495eb3f518a7f1b741bf'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:14.734401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c1e18124-c3a8-45de-aeca-1b0236eeb601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4a8240c1f4495eb3f518a7f1b741bf'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:14.782515 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1370/2737] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:01:14 2022] DELETE /identity/v3/users/ff4a8240c1f4495eb3f518a7f1b741bf => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:01:15.047557 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b06703-e3b3-470f-977b-d915913f726c service swift] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:15.065743 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b06703-e3b3-470f-977b-d915913f726c service swift] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:15.205167 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5679c-9abe-48ce-aa8b-ce65f3a4121a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:15.206413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5679c-9abe-48ce-aa8b-ce65f3a4121a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:15.208300 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5679c-9abe-48ce-aa8b-ce65f3a4121a admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:15.208696 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5679c-9abe-48ce-aa8b-ce65f3a4121a admin admin] PATH_INFO: `/v3/projects/53ec3ebc7d724ff28f91016733ae9134` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:15.212277 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5679c-9abe-48ce-aa8b-ce65f3a4121a admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ec3ebc7d724ff28f91016733ae9134)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:15.214608 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5679c-9abe-48ce-aa8b-ce65f3a4121a admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:15.287071 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ddd5679c-9abe-48ce-aa8b-ce65f3a4121a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ec3ebc7d724ff28f91016733ae9134', 'request_id': 'req-ddd5679c-9abe-48ce-aa8b-ce65f3a4121a'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:15.300888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ddd5679c-9abe-48ce-aa8b-ce65f3a4121a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ec3ebc7d724ff28f91016733ae9134', 'request_id': 'req-ddd5679c-9abe-48ce-aa8b-ce65f3a4121a'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:15.313846 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ddd5679c-9abe-48ce-aa8b-ce65f3a4121a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ec3ebc7d724ff28f91016733ae9134', 'request_id': 'req-ddd5679c-9abe-48ce-aa8b-ce65f3a4121a'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:15.343934 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ddd5679c-9abe-48ce-aa8b-ce65f3a4121a admin admin] The token cache is being invalidate because project 53ec3ebc7d724ff28f91016733ae9134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:01:15.346153 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ddd5679c-9abe-48ce-aa8b-ce65f3a4121a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:15.348362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-ddd5679c-9abe-48ce-aa8b-ce65f3a4121a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:15.352768 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1368/2738] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:01:15 2022] DELETE /identity/v3/projects/53ec3ebc7d724ff28f91016733ae9134 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:15.359119 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5233677-b2ac-4321-853d-bf8ef2ebfa22 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:15.359737 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5233677-b2ac-4321-853d-bf8ef2ebfa22 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:15.360217 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5233677-b2ac-4321-853d-bf8ef2ebfa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:15.386374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-a5233677-b2ac-4321-853d-bf8ef2ebfa22 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:15.388104 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-a5233677-b2ac-4321-853d-bf8ef2ebfa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:15.523032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1371/2739] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:15.531200 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a837a-acdb-4f19-b414-a14f6af38d24 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:15.531533 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a837a-acdb-4f19-b414-a14f6af38d24 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:15.531772 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a837a-acdb-4f19-b414-a14f6af38d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:15.576299 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-d82a837a-acdb-4f19-b414-a14f6af38d24 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:15.577807 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-d82a837a-acdb-4f19-b414-a14f6af38d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:15.608530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1369/2740] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:15.612012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5233677-b2ac-4321-853d-bf8ef2ebfa22 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:15.625718 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5233677-b2ac-4321-853d-bf8ef2ebfa22 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:15.643988 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6c784-08e8-4c09-bac9-414052f50b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:15.646985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6c784-08e8-4c09-bac9-414052f50b72 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:15.647951 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6c784-08e8-4c09-bac9-414052f50b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:15.648410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6c784-08e8-4c09-bac9-414052f50b72 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:15.649350 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6c784-08e8-4c09-bac9-414052f50b72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:01:15.649845 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6c784-08e8-4c09-bac9-414052f50b72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:15.651629 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6c784-08e8-4c09-bac9-414052f50b72 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:15.666059 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1372/2741] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:01:15.671166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a837a-acdb-4f19-b414-a14f6af38d24 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:15.689666 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a837a-acdb-4f19-b414-a14f6af38d24 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:15.707106 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff090eb3-0192-4362-8135-243adda27966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:15.707985 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff090eb3-0192-4362-8135-243adda27966 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:15.708270 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff090eb3-0192-4362-8135-243adda27966 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:15.708547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff090eb3-0192-4362-8135-243adda27966 admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:15.709255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff090eb3-0192-4362-8135-243adda27966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:15.711740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff090eb3-0192-4362-8135-243adda27966 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:15.766756 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1370/2742] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:01:15 2022] POST /identity/v3/projects => generated 403 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:15.768250 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6c784-08e8-4c09-bac9-414052f50b72 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:15.780764 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6c784-08e8-4c09-bac9-414052f50b72 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:15.933899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5aca13-4ade-40ac-9ea3-e7064dac55d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:15.935044 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5aca13-4ade-40ac-9ea3-e7064dac55d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:15.935339 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5aca13-4ade-40ac-9ea3-e7064dac55d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:15.935678 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5aca13-4ade-40ac-9ea3-e7064dac55d6 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:15.936608 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5aca13-4ade-40ac-9ea3-e7064dac55d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:15.938644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5aca13-4ade-40ac-9ea3-e7064dac55d6 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:15.950257 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:15.968052 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1373/2743] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:01:15 2022] POST /identity/v3/users => generated 302 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:15.972752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff090eb3-0192-4362-8135-243adda27966 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:15.985788 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff090eb3-0192-4362-8135-243adda27966 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:15.994056 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6741653-3c18-4687-823a-77ff113cd704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:15.994739 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6741653-3c18-4687-823a-77ff113cd704 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:15.995039 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6741653-3c18-4687-823a-77ff113cd704 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:15.995313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6741653-3c18-4687-823a-77ff113cd704 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:15.996924 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6741653-3c18-4687-823a-77ff113cd704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:15.999305 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6741653-3c18-4687-823a-77ff113cd704 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:16.019937 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1371/2744] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:16.021580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5aca13-4ade-40ac-9ea3-e7064dac55d6 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:16.041120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5aca13-4ade-40ac-9ea3-e7064dac55d6 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:16.054796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a030db-64e4-4cc9-91c9-af7629f27029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:16.056057 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a030db-64e4-4cc9-91c9-af7629f27029 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:16.057047 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a030db-64e4-4cc9-91c9-af7629f27029 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:16.058287 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a030db-64e4-4cc9-91c9-af7629f27029 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:16.060352 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a030db-64e4-4cc9-91c9-af7629f27029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:16.065138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a030db-64e4-4cc9-91c9-af7629f27029 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:16.100377 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1374/2745] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:16.101681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6741653-3c18-4687-823a-77ff113cd704 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:16.114599 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6741653-3c18-4687-823a-77ff113cd704 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:16.125872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0aea6-c0f6-4697-8667-fcf61600a66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:16.126958 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0aea6-c0f6-4697-8667-fcf61600a66e admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:16.127244 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0aea6-c0f6-4697-8667-fcf61600a66e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:16.127521 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0aea6-c0f6-4697-8667-fcf61600a66e admin admin] PATH_INFO: `/v3/projects/860e272df8bb4f8898b6a77114bf9442/users/9b79fff00cac4987b17e742a8c058c1f/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:16.164624 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0aea6-c0f6-4697-8667-fcf61600a66e admin admin] RBAC: Authorizing `identity:create_grant(project_id=860e272df8bb4f8898b6a77114bf9442, user_id=9b79fff00cac4987b17e742a8c058c1f, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:16.168541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0aea6-c0f6-4697-8667-fcf61600a66e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:16.201262 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1372/2746] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:01:16 2022] PUT /identity/v3/projects/860e272df8bb4f8898b6a77114bf9442/users/9b79fff00cac4987b17e742a8c058c1f/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:01:16.217361 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f5606-6235-442e-b6e9-2da3d1fd2a66 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:16.218026 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f5606-6235-442e-b6e9-2da3d1fd2a66 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:16.218388 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f5606-6235-442e-b6e9-2da3d1fd2a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:16.301468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-973f5606-6235-442e-b6e9-2da3d1fd2a66 None None] MFA Rules not processed for user `9b79fff00cac4987b17e742a8c058c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:16.304968 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-973f5606-6235-442e-b6e9-2da3d1fd2a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:16.455238 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1375/2747] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:16.457556 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0aea6-c0f6-4697-8667-fcf61600a66e admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:16.471216 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:16.610255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0aea6-c0f6-4697-8667-fcf61600a66e admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:16.615096 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6110cb6-dfb5-4a0d-9931-9d282f22599f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:16.616053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6110cb6-dfb5-4a0d-9931-9d282f22599f admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:16.616336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6110cb6-dfb5-4a0d-9931-9d282f22599f admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:16.616697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6110cb6-dfb5-4a0d-9931-9d282f22599f admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:16.617335 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6110cb6-dfb5-4a0d-9931-9d282f22599f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:16.619413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6110cb6-dfb5-4a0d-9931-9d282f22599f admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:16.669378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1373/2748] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:01:16 2022] POST /identity/v3/projects => generated 405 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:16.673567 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f5606-6235-442e-b6e9-2da3d1fd2a66 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:16.693895 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f5606-6235-442e-b6e9-2da3d1fd2a66 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:16.779613 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b9c02-61f7-453f-8d0f-4892aa578d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:16.780300 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b9c02-61f7-453f-8d0f-4892aa578d22 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:16.780565 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b9c02-61f7-453f-8d0f-4892aa578d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:16.780848 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b9c02-61f7-453f-8d0f-4892aa578d22 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:16.781575 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b9c02-61f7-453f-8d0f-4892aa578d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:16.783531 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b9c02-61f7-453f-8d0f-4892aa578d22 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:16.805960 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1376/2749] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:01:16 2022] POST /identity/v3/users => generated 309 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:16.811041 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6110cb6-dfb5-4a0d-9931-9d282f22599f admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:16.824618 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6110cb6-dfb5-4a0d-9931-9d282f22599f admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:16.830560 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262883b-52c6-456b-87f2-4f4e7af9f706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:16.831246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262883b-52c6-456b-87f2-4f4e7af9f706 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:16.831604 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262883b-52c6-456b-87f2-4f4e7af9f706 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:16.831882 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262883b-52c6-456b-87f2-4f4e7af9f706 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:16.832685 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262883b-52c6-456b-87f2-4f4e7af9f706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:16.834463 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262883b-52c6-456b-87f2-4f4e7af9f706 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:16.853599 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1374/2750] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:16.857947 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b9c02-61f7-453f-8d0f-4892aa578d22 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:16.869902 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b9c02-61f7-453f-8d0f-4892aa578d22 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:16.875122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096443c-b9e3-44d8-86ee-442f47183e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:16.876120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096443c-b9e3-44d8-86ee-442f47183e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:16.876457 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096443c-b9e3-44d8-86ee-442f47183e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:16.876832 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096443c-b9e3-44d8-86ee-442f47183e76 admin admin] PATH_INFO: `/v3/projects/2d863dd7d2794847b194dd73ee801f9c/users/47675177e2a64fbea48712ac36d6eb73/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:16.897457 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096443c-b9e3-44d8-86ee-442f47183e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d863dd7d2794847b194dd73ee801f9c, user_id=47675177e2a64fbea48712ac36d6eb73, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:16.901596 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096443c-b9e3-44d8-86ee-442f47183e76 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:16.921709 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1377/2751] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:01:16 2022] PUT /identity/v3/projects/2d863dd7d2794847b194dd73ee801f9c/users/47675177e2a64fbea48712ac36d6eb73/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:16.925452 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262883b-52c6-456b-87f2-4f4e7af9f706 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:16.938078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262883b-52c6-456b-87f2-4f4e7af9f706 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:16.940095 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096443c-b9e3-44d8-86ee-442f47183e76 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:16.944969 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-7096443c-b9e3-44d8-86ee-442f47183e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:17.001062 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:17.034326 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfab75-6bb8-4de5-845d-1fa715ae40fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:17.035170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfab75-6bb8-4de5-845d-1fa715ae40fe admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:17.035461 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfab75-6bb8-4de5-845d-1fa715ae40fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:17.036252 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfab75-6bb8-4de5-845d-1fa715ae40fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:17.037301 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfab75-6bb8-4de5-845d-1fa715ae40fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:17.038932 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfab75-6bb8-4de5-845d-1fa715ae40fe admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:17.053357 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1375/2752] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:17.055756 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096443c-b9e3-44d8-86ee-442f47183e76 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:17.057717 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfab75-6bb8-4de5-845d-1fa715ae40fe admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:17.060867 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f8c06-281c-417e-b42b-5c2f2a525ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:17.061964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f8c06-281c-417e-b42b-5c2f2a525ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:17.062373 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f8c06-281c-417e-b42b-5c2f2a525ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:17.062762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f8c06-281c-417e-b42b-5c2f2a525ff1 admin admin] PATH_INFO: `/v3/users/dc146107465f4aa3b5392e6589ec9c52` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:17.064072 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f8c06-281c-417e-b42b-5c2f2a525ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc146107465f4aa3b5392e6589ec9c52)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:17.066120 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f8c06-281c-417e-b42b-5c2f2a525ff1 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:17.068181 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfab75-6bb8-4de5-845d-1fa715ae40fe admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:17.073493 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950cc3a-1db7-4c21-9a12-c3bf5a721d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:17.074984 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950cc3a-1db7-4c21-9a12-c3bf5a721d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:17.075333 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950cc3a-1db7-4c21-9a12-c3bf5a721d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:17.075663 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950cc3a-1db7-4c21-9a12-c3bf5a721d05 admin admin] PATH_INFO: `/v3/projects/2d863dd7d2794847b194dd73ee801f9c/users/47675177e2a64fbea48712ac36d6eb73/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:17.078541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950cc3a-1db7-4c21-9a12-c3bf5a721d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d863dd7d2794847b194dd73ee801f9c, user_id=47675177e2a64fbea48712ac36d6eb73, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:17.081468 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950cc3a-1db7-4c21-9a12-c3bf5a721d05 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:17.102315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1376/2753] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:01:17 2022] PUT /identity/v3/projects/2d863dd7d2794847b194dd73ee801f9c/users/47675177e2a64fbea48712ac36d6eb73/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:01:17.104394 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e92f1-57c7-46f1-a348-26a6064c3169 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:17.104923 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e92f1-57c7-46f1-a348-26a6064c3169 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:17.105319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e92f1-57c7-46f1-a348-26a6064c3169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:17.146887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d82f8c06-281c-417e-b42b-5c2f2a525ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc146107465f4aa3b5392e6589ec9c52'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:17.148562 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d82f8c06-281c-417e-b42b-5c2f2a525ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc146107465f4aa3b5392e6589ec9c52'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:17.149330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-e09e92f1-57c7-46f1-a348-26a6064c3169 None None] MFA Rules not processed for user `47675177e2a64fbea48712ac36d6eb73`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:17.150027 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d82f8c06-281c-417e-b42b-5c2f2a525ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc146107465f4aa3b5392e6589ec9c52'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:17.150787 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e09e92f1-57c7-46f1-a348-26a6064c3169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:17.159824 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d82f8c06-281c-417e-b42b-5c2f2a525ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc146107465f4aa3b5392e6589ec9c52'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:17.169910 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d82f8c06-281c-417e-b42b-5c2f2a525ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc146107465f4aa3b5392e6589ec9c52'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:17.202149 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1378/2754] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:01:16 2022] DELETE /identity/v3/users/dc146107465f4aa3b5392e6589ec9c52 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:17.206813 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd734f9-9e3b-4d71-b99b-02ab209880d9 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:17.207103 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd734f9-9e3b-4d71-b99b-02ab209880d9 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:17.207386 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd734f9-9e3b-4d71-b99b-02ab209880d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:17.239436 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-cbd734f9-9e3b-4d71-b99b-02ab209880d9 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:17.240960 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-cbd734f9-9e3b-4d71-b99b-02ab209880d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:17.242444 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:17.274226 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1377/2755] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:17 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 14:01:17.285784 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e92f1-57c7-46f1-a348-26a6064c3169 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:17.287486 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-e09e92f1-57c7-46f1-a348-26a6064c3169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:17.341547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1379/2756] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 14:01:17.361910 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd734f9-9e3b-4d71-b99b-02ab209880d9 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:17.363904 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-cbd734f9-9e3b-4d71-b99b-02ab209880d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:17.380384 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e92f1-57c7-46f1-a348-26a6064c3169 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:17.445240 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd734f9-9e3b-4d71-b99b-02ab209880d9 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:17.453196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b2ede-ab47-40cf-902a-c4b381539ca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:17.453452 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b2ede-ab47-40cf-902a-c4b381539ca5 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:17.453742 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b2ede-ab47-40cf-902a-c4b381539ca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:17.453967 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b2ede-ab47-40cf-902a-c4b381539ca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:17.455917 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ed25d-c223-47e1-bda4-dd2ba5e482c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:17.456574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ed25d-c223-47e1-bda4-dd2ba5e482c5 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:17.456857 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ed25d-c223-47e1-bda4-dd2ba5e482c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:17.457131 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ed25d-c223-47e1-bda4-dd2ba5e482c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:17.470080 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b2ede-ab47-40cf-902a-c4b381539ca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:17.471668 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b2ede-ab47-40cf-902a-c4b381539ca5 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:17.477152 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:17.506391 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1380/2757] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:01:17.539312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ed25d-c223-47e1-bda4-dd2ba5e482c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:17.541132 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ed25d-c223-47e1-bda4-dd2ba5e482c5 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:17.582028 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1378/2758] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:17 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:01:17.783455 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b2ede-ab47-40cf-902a-c4b381539ca5 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:17.785413 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-fb9b2ede-ab47-40cf-902a-c4b381539ca5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:17.807941 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b2ede-ab47-40cf-902a-c4b381539ca5 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:17.813410 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ec435-f47a-4962-8ab0-3a6cba01681f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:17.815079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ec435-f47a-4962-8ab0-3a6cba01681f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:17.815380 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ec435-f47a-4962-8ab0-3a6cba01681f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:17.815664 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ec435-f47a-4962-8ab0-3a6cba01681f admin admin] PATH_INFO: `/v3/users/9b79fff00cac4987b17e742a8c058c1f` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:17.818034 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ec435-f47a-4962-8ab0-3a6cba01681f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b79fff00cac4987b17e742a8c058c1f)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:17.820138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ec435-f47a-4962-8ab0-3a6cba01681f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:17.898676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6a4ec435-f47a-4962-8ab0-3a6cba01681f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b79fff00cac4987b17e742a8c058c1f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:17.899799 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6a4ec435-f47a-4962-8ab0-3a6cba01681f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b79fff00cac4987b17e742a8c058c1f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:17.900848 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6a4ec435-f47a-4962-8ab0-3a6cba01681f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b79fff00cac4987b17e742a8c058c1f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:17.910419 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6a4ec435-f47a-4962-8ab0-3a6cba01681f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b79fff00cac4987b17e742a8c058c1f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:17.920630 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6a4ec435-f47a-4962-8ab0-3a6cba01681f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b79fff00cac4987b17e742a8c058c1f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:17.951644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1381/2759] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:01:17 2022] DELETE /identity/v3/users/9b79fff00cac4987b17e742a8c058c1f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:17.957453 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5b6d2-beba-4260-afba-3a375320fe4e None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:17.957453 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5b6d2-beba-4260-afba-3a375320fe4e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:17.957453 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5b6d2-beba-4260-afba-3a375320fe4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:17.997786 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-0ef5b6d2-beba-4260-afba-3a375320fe4e None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:17.999225 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-0ef5b6d2-beba-4260-afba-3a375320fe4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:18.006965 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ec435-f47a-4962-8ab0-3a6cba01681f admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:18.008407 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-6a4ec435-f47a-4962-8ab0-3a6cba01681f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:18.078277 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:18.127567 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1379/2760] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:18.131166 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ec435-f47a-4962-8ab0-3a6cba01681f admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:18.139039 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5b6d2-beba-4260-afba-3a375320fe4e None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:18.140455 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-0ef5b6d2-beba-4260-afba-3a375320fe4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:18.144959 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a0327-e351-4453-b644-c5749110d4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:18.146437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a0327-e351-4453-b644-c5749110d4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:18.146738 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a0327-e351-4453-b644-c5749110d4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:18.147124 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a0327-e351-4453-b644-c5749110d4d1 admin admin] PATH_INFO: `/v3/projects/ef7ab605539240ee84f957577a76f8a6` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:18.148309 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a0327-e351-4453-b644-c5749110d4d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef7ab605539240ee84f957577a76f8a6)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:18.151281 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a0327-e351-4453-b644-c5749110d4d1 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:18.208285 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5b6d2-beba-4260-afba-3a375320fe4e None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:18.212052 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-163a0327-e351-4453-b644-c5749110d4d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef7ab605539240ee84f957577a76f8a6', 'request_id': 'req-163a0327-e351-4453-b644-c5749110d4d1'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:18.220878 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-163a0327-e351-4453-b644-c5749110d4d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef7ab605539240ee84f957577a76f8a6', 'request_id': 'req-163a0327-e351-4453-b644-c5749110d4d1'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:18.229305 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-163a0327-e351-4453-b644-c5749110d4d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef7ab605539240ee84f957577a76f8a6', 'request_id': 'req-163a0327-e351-4453-b644-c5749110d4d1'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:18.244026 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-163a0327-e351-4453-b644-c5749110d4d1 admin admin] The token cache is being invalidate because project ef7ab605539240ee84f957577a76f8a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:01:18.244316 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-163a0327-e351-4453-b644-c5749110d4d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:18.245010 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-163a0327-e351-4453-b644-c5749110d4d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:18.246636 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1382/2761] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:01:18 2022] DELETE /identity/v3/projects/ef7ab605539240ee84f957577a76f8a6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:01:18.252648 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bec52-8664-462a-a42f-0ab8f85be660 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:18.252944 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bec52-8664-462a-a42f-0ab8f85be660 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:18.253332 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bec52-8664-462a-a42f-0ab8f85be660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:18.264814 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:18.280582 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda31a1a-1f31-419a-8dc9-58f4a769630c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:18.281659 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda31a1a-1f31-419a-8dc9-58f4a769630c service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:18.281963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-6a9bec52-8664-462a-a42f-0ab8f85be660 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:18.282366 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda31a1a-1f31-419a-8dc9-58f4a769630c service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:18.282872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda31a1a-1f31-419a-8dc9-58f4a769630c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:18.283449 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-6a9bec52-8664-462a-a42f-0ab8f85be660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:18.285096 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-fda31a1a-1f31-419a-8dc9-58f4a769630c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:18.369177 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda31a1a-1f31-419a-8dc9-58f4a769630c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:18.370896 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda31a1a-1f31-419a-8dc9-58f4a769630c service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:18.382684 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1380/2763] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:01:18.383046 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1383/2763] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 14:01:18.391393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243680c-ea00-4056-bdc3-8dfba18c0bd9 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:18.391871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243680c-ea00-4056-bdc3-8dfba18c0bd9 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:18.392172 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243680c-ea00-4056-bdc3-8dfba18c0bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:18.411603 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-8243680c-ea00-4056-bdc3-8dfba18c0bd9 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:18.413610 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-8243680c-ea00-4056-bdc3-8dfba18c0bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:18.432737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1381/2764] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:18.434218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bec52-8664-462a-a42f-0ab8f85be660 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:18.449525 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bec52-8664-462a-a42f-0ab8f85be660 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:18.455138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80661f2e-cb98-4c12-89c2-53695d93b679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:18.456179 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80661f2e-cb98-4c12-89c2-53695d93b679 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:18.456715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80661f2e-cb98-4c12-89c2-53695d93b679 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:18.457155 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80661f2e-cb98-4c12-89c2-53695d93b679 admin admin] PATH_INFO: `/v3/domains` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:18.458130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80661f2e-cb98-4c12-89c2-53695d93b679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:01:18.458604 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80661f2e-cb98-4c12-89c2-53695d93b679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:18.469099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80661f2e-cb98-4c12-89c2-53695d93b679 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:18.493191 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1384/2765] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:01:18.494166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243680c-ea00-4056-bdc3-8dfba18c0bd9 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:18.504837 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243680c-ea00-4056-bdc3-8dfba18c0bd9 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:18.509834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab695dc0-d8aa-4c5b-abfe-1b000ceb64bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:18.510863 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab695dc0-d8aa-4c5b-abfe-1b000ceb64bd admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:18.511838 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab695dc0-d8aa-4c5b-abfe-1b000ceb64bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:18.512266 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab695dc0-d8aa-4c5b-abfe-1b000ceb64bd admin admin] PATH_INFO: `/v3/projects` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:18.513152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab695dc0-d8aa-4c5b-abfe-1b000ceb64bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:18.515540 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab695dc0-d8aa-4c5b-abfe-1b000ceb64bd admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:18.560182 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1382/2766] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:01:18 2022] POST /identity/v3/projects => generated 363 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:01:18.567016 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80661f2e-cb98-4c12-89c2-53695d93b679 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:18.580296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80661f2e-cb98-4c12-89c2-53695d93b679 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:18.707082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc2cf4-2389-43d0-89a4-0433bcf8a8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:18.708190 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc2cf4-2389-43d0-89a4-0433bcf8a8a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:18.708684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc2cf4-2389-43d0-89a4-0433bcf8a8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:18.708966 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc2cf4-2389-43d0-89a4-0433bcf8a8a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:18.709724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc2cf4-2389-43d0-89a4-0433bcf8a8a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:18.711632 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc2cf4-2389-43d0-89a4-0433bcf8a8a3 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:18.727349 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab695dc0-d8aa-4c5b-abfe-1b000ceb64bd admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:18.729160 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ab695dc0-d8aa-4c5b-abfe-1b000ceb64bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:18.734733 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1385/2767] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:01:18 2022] POST /identity/v3/users => generated 282 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:18.738975 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc2cf4-2389-43d0-89a4-0433bcf8a8a3 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:18.743469 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab695dc0-d8aa-4c5b-abfe-1b000ceb64bd admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:18.748826 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba37cc5-52f8-4a68-bd97-c9a1253373b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:18.749765 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba37cc5-52f8-4a68-bd97-c9a1253373b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:18.750049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba37cc5-52f8-4a68-bd97-c9a1253373b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:18.750375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba37cc5-52f8-4a68-bd97-c9a1253373b6 admin admin] PATH_INFO: `/v3/projects/860e272df8bb4f8898b6a77114bf9442` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:18.751627 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba37cc5-52f8-4a68-bd97-c9a1253373b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=860e272df8bb4f8898b6a77114bf9442)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:18.753636 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba37cc5-52f8-4a68-bd97-c9a1253373b6 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:18.768472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc2cf4-2389-43d0-89a4-0433bcf8a8a3 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:18.775414 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d422a1-780d-4d1b-bbea-ad77ed0edfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:18.776265 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d422a1-780d-4d1b-bbea-ad77ed0edfbb admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:18.777007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d422a1-780d-4d1b-bbea-ad77ed0edfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:18.777506 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d422a1-780d-4d1b-bbea-ad77ed0edfbb admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:18.778470 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d422a1-780d-4d1b-bbea-ad77ed0edfbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:18.780178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d422a1-780d-4d1b-bbea-ad77ed0edfbb admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:18.788353 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:18.798287 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1386/2768] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:18.800720 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d422a1-780d-4d1b-bbea-ad77ed0edfbb admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:18.821848 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d422a1-780d-4d1b-bbea-ad77ed0edfbb admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:18.831746 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7ba37cc5-52f8-4a68-bd97-c9a1253373b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '860e272df8bb4f8898b6a77114bf9442', 'request_id': 'req-7ba37cc5-52f8-4a68-bd97-c9a1253373b6'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:18.841606 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7ba37cc5-52f8-4a68-bd97-c9a1253373b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '860e272df8bb4f8898b6a77114bf9442', 'request_id': 'req-7ba37cc5-52f8-4a68-bd97-c9a1253373b6'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:18.854884 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7ba37cc5-52f8-4a68-bd97-c9a1253373b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '860e272df8bb4f8898b6a77114bf9442', 'request_id': 'req-7ba37cc5-52f8-4a68-bd97-c9a1253373b6'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:18.884472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7ba37cc5-52f8-4a68-bd97-c9a1253373b6 admin admin] The token cache is being invalidate because project 860e272df8bb4f8898b6a77114bf9442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:01:18.884767 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7ba37cc5-52f8-4a68-bd97-c9a1253373b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:18.885613 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-7ba37cc5-52f8-4a68-bd97-c9a1253373b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:18.888234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1383/2769] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:01:18 2022] DELETE /identity/v3/projects/860e272df8bb4f8898b6a77114bf9442 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:01:18.892105 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba37cc5-52f8-4a68-bd97-c9a1253373b6 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:18.902439 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-7ba37cc5-52f8-4a68-bd97-c9a1253373b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:18.940236 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fe2d8-74cb-495b-b3eb-5f8b86ff582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:18.942852 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fe2d8-74cb-495b-b3eb-5f8b86ff582d admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:18.943143 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fe2d8-74cb-495b-b3eb-5f8b86ff582d admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:18.943419 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fe2d8-74cb-495b-b3eb-5f8b86ff582d admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:18.944316 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fe2d8-74cb-495b-b3eb-5f8b86ff582d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:18.951041 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fe2d8-74cb-495b-b3eb-5f8b86ff582d admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:18.951299 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba37cc5-52f8-4a68-bd97-c9a1253373b6 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:18.959770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9aa2b-f1f5-4a65-b908-5a2214204f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:18.960850 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9aa2b-f1f5-4a65-b908-5a2214204f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:18.961341 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9aa2b-f1f5-4a65-b908-5a2214204f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:18.961908 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9aa2b-f1f5-4a65-b908-5a2214204f43 admin admin] PATH_INFO: `/v3/users/47675177e2a64fbea48712ac36d6eb73` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:18.963920 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9aa2b-f1f5-4a65-b908-5a2214204f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47675177e2a64fbea48712ac36d6eb73)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:18.968022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9aa2b-f1f5-4a65-b908-5a2214204f43 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:18.978451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1387/2770] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:18.980151 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fe2d8-74cb-495b-b3eb-5f8b86ff582d admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:18.982848 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d95fe2d8-74cb-495b-b3eb-5f8b86ff582d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:19.000162 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:19.013748 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fe2d8-74cb-495b-b3eb-5f8b86ff582d admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:19.020691 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3f64d-4110-4988-8d83-20d51cb5d248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:19.021794 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3f64d-4110-4988-8d83-20d51cb5d248 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:19.022176 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3f64d-4110-4988-8d83-20d51cb5d248 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:19.022555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3f64d-4110-4988-8d83-20d51cb5d248 admin admin] PATH_INFO: `/v3/projects/ad66afc9e0d64f27a7d9d0e94910801d/users/95c2fc4f457e43b1a137e021270da5b2/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:19.039746 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3f64d-4110-4988-8d83-20d51cb5d248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad66afc9e0d64f27a7d9d0e94910801d, user_id=95c2fc4f457e43b1a137e021270da5b2, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:19.048619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3f64d-4110-4988-8d83-20d51cb5d248 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:19.052516 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-08d9aa2b-f1f5-4a65-b908-5a2214204f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47675177e2a64fbea48712ac36d6eb73'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:19.072789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-08d9aa2b-f1f5-4a65-b908-5a2214204f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47675177e2a64fbea48712ac36d6eb73'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:19.073940 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-08d9aa2b-f1f5-4a65-b908-5a2214204f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47675177e2a64fbea48712ac36d6eb73'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:19.075250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-08d9aa2b-f1f5-4a65-b908-5a2214204f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47675177e2a64fbea48712ac36d6eb73'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:19.080261 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1388/2771] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:01:18 2022] PUT /identity/v3/projects/ad66afc9e0d64f27a7d9d0e94910801d/users/95c2fc4f457e43b1a137e021270da5b2/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:19.093109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-08d9aa2b-f1f5-4a65-b908-5a2214204f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47675177e2a64fbea48712ac36d6eb73'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:19.103018 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec62b9-0026-41fc-8c20-891369e86e00 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:19.103234 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec62b9-0026-41fc-8c20-891369e86e00 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:19.103523 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec62b9-0026-41fc-8c20-891369e86e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:19.113318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1384/2772] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:01:18 2022] DELETE /identity/v3/users/47675177e2a64fbea48712ac36d6eb73 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:19.168835 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-adec62b9-0026-41fc-8c20-891369e86e00 None None] MFA Rules not processed for user `95c2fc4f457e43b1a137e021270da5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:19.171262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-adec62b9-0026-41fc-8c20-891369e86e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:19.273028 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1389/2773] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:19 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:19.285591 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9aa2b-f1f5-4a65-b908-5a2214204f43 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:19.287472 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-08d9aa2b-f1f5-4a65-b908-5a2214204f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:19.352771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9aa2b-f1f5-4a65-b908-5a2214204f43 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:19.357725 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829ea70-1b96-449a-92da-12f187aa3aea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:19.358850 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829ea70-1b96-449a-92da-12f187aa3aea service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:19.359865 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829ea70-1b96-449a-92da-12f187aa3aea service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:19.360273 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829ea70-1b96-449a-92da-12f187aa3aea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:19.371857 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829ea70-1b96-449a-92da-12f187aa3aea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:19.373488 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829ea70-1b96-449a-92da-12f187aa3aea service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:19.383858 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1385/2774] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:19 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:01:19.460060 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec62b9-0026-41fc-8c20-891369e86e00 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:19.461720 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-adec62b9-0026-41fc-8c20-891369e86e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:19.600032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec62b9-0026-41fc-8c20-891369e86e00 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:19.606231 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d9d15-a8a7-41a4-95d8-61d15158cdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:19.607125 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d9d15-a8a7-41a4-95d8-61d15158cdbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:19.607407 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d9d15-a8a7-41a4-95d8-61d15158cdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:19.607796 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d9d15-a8a7-41a4-95d8-61d15158cdbf admin admin] PATH_INFO: `/v3/projects/2d863dd7d2794847b194dd73ee801f9c` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:19.609193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d9d15-a8a7-41a4-95d8-61d15158cdbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d863dd7d2794847b194dd73ee801f9c)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:19.611433 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d9d15-a8a7-41a4-95d8-61d15158cdbf admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:19.687444 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0f6d9d15-a8a7-41a4-95d8-61d15158cdbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d863dd7d2794847b194dd73ee801f9c', 'request_id': 'req-0f6d9d15-a8a7-41a4-95d8-61d15158cdbf'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:19.694663 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0f6d9d15-a8a7-41a4-95d8-61d15158cdbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d863dd7d2794847b194dd73ee801f9c', 'request_id': 'req-0f6d9d15-a8a7-41a4-95d8-61d15158cdbf'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:19.704285 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0f6d9d15-a8a7-41a4-95d8-61d15158cdbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d863dd7d2794847b194dd73ee801f9c', 'request_id': 'req-0f6d9d15-a8a7-41a4-95d8-61d15158cdbf'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:19.712972 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:19.717895 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0f6d9d15-a8a7-41a4-95d8-61d15158cdbf admin admin] The token cache is being invalidate because project 2d863dd7d2794847b194dd73ee801f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:01:19.718448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0f6d9d15-a8a7-41a4-95d8-61d15158cdbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:19.719647 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0f6d9d15-a8a7-41a4-95d8-61d15158cdbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:19.725790 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1390/2775] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:01:19 2022] DELETE /identity/v3/projects/2d863dd7d2794847b194dd73ee801f9c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:19.727626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0007f0-fe7c-4315-92d6-6472c0339460 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:19.727924 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0007f0-fe7c-4315-92d6-6472c0339460 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:19.728187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0007f0-fe7c-4315-92d6-6472c0339460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:19.774246 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-2a0007f0-fe7c-4315-92d6-6472c0339460 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:19.775491 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-2a0007f0-fe7c-4315-92d6-6472c0339460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:19.834066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:19.913358 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1386/2776] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 14:01:19.916723 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a06aa-25f8-46c6-810e-cf07cfc90cd3 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:19.917316 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a06aa-25f8-46c6-810e-cf07cfc90cd3 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:19.917435 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a06aa-25f8-46c6-810e-cf07cfc90cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:19.936526 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-cb1a06aa-25f8-46c6-810e-cf07cfc90cd3 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:19.937821 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-cb1a06aa-25f8-46c6-810e-cf07cfc90cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:19.946721 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1391/2777] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 14:01:19.951768 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0007f0-fe7c-4315-92d6-6472c0339460 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:19.966610 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0007f0-fe7c-4315-92d6-6472c0339460 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:19.973485 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444d189-a974-4017-874f-bf2459d0176f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:19.974257 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444d189-a974-4017-874f-bf2459d0176f admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:19.974540 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444d189-a974-4017-874f-bf2459d0176f admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:19.974812 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444d189-a974-4017-874f-bf2459d0176f admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:19.975563 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444d189-a974-4017-874f-bf2459d0176f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:01:19.975834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444d189-a974-4017-874f-bf2459d0176f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:19.977470 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444d189-a974-4017-874f-bf2459d0176f admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:19.990877 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1387/2778] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:01:19.995333 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a06aa-25f8-46c6-810e-cf07cfc90cd3 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:20.004983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a06aa-25f8-46c6-810e-cf07cfc90cd3 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:20.009665 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed1b6e-5135-468a-b444-28816079104b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:20.010403 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1b6e-5135-468a-b444-28816079104b admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:20.010747 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1b6e-5135-468a-b444-28816079104b admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:20.011591 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1b6e-5135-468a-b444-28816079104b admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:20.012277 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed1b6e-5135-468a-b444-28816079104b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:20.014200 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed1b6e-5135-468a-b444-28816079104b admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:20.041634 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1392/2779] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:01:19 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:20.046030 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444d189-a974-4017-874f-bf2459d0176f admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:20.058295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444d189-a974-4017-874f-bf2459d0176f admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:20.134888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c3843-ac71-4dbc-b6da-599d45ea5856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:20.135859 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c3843-ac71-4dbc-b6da-599d45ea5856 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:20.137051 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c3843-ac71-4dbc-b6da-599d45ea5856 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:20.137051 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c3843-ac71-4dbc-b6da-599d45ea5856 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:20.137888 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c3843-ac71-4dbc-b6da-599d45ea5856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:20.139903 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c3843-ac71-4dbc-b6da-599d45ea5856 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:20.174302 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1388/2780] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:01:20 2022] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:20.178216 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed1b6e-5135-468a-b444-28816079104b admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:20.193463 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed1b6e-5135-468a-b444-28816079104b admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:20.202931 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60157f5e-009f-4fda-aed0-fb2281c9a68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:20.203627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60157f5e-009f-4fda-aed0-fb2281c9a68a admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:20.203914 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60157f5e-009f-4fda-aed0-fb2281c9a68a admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:20.204193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60157f5e-009f-4fda-aed0-fb2281c9a68a admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:20.204927 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60157f5e-009f-4fda-aed0-fb2281c9a68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:20.206552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60157f5e-009f-4fda-aed0-fb2281c9a68a admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:20.229482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1393/2781] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:20.233577 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c3843-ac71-4dbc-b6da-599d45ea5856 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:20.246448 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c3843-ac71-4dbc-b6da-599d45ea5856 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:20.253804 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c88ce2-74a3-450d-9c4a-c2bf9156a21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:20.254602 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c88ce2-74a3-450d-9c4a-c2bf9156a21d admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:20.255132 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c88ce2-74a3-450d-9c4a-c2bf9156a21d admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:20.255813 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c88ce2-74a3-450d-9c4a-c2bf9156a21d admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:20.257049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c88ce2-74a3-450d-9c4a-c2bf9156a21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:20.259035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c88ce2-74a3-450d-9c4a-c2bf9156a21d admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:20.275657 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1389/2782] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:20.277822 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60157f5e-009f-4fda-aed0-fb2281c9a68a admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:20.297165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60157f5e-009f-4fda-aed0-fb2281c9a68a admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:20.302333 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668660f-1a4f-47df-b7d2-7d89c74ccb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:20.302863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668660f-1a4f-47df-b7d2-7d89c74ccb57 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:20.303148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668660f-1a4f-47df-b7d2-7d89c74ccb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:20.303425 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668660f-1a4f-47df-b7d2-7d89c74ccb57 admin admin] PATH_INFO: `/v3/projects/dc82e458794e40a9804b860d48a24d85/users/dc4bc75989864b15937a8ea0df813a7f/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:20.320062 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668660f-1a4f-47df-b7d2-7d89c74ccb57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc82e458794e40a9804b860d48a24d85, user_id=dc4bc75989864b15937a8ea0df813a7f, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:20.322715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668660f-1a4f-47df-b7d2-7d89c74ccb57 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:20.339863 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1394/2783] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:01:20 2022] PUT /identity/v3/projects/dc82e458794e40a9804b860d48a24d85/users/dc4bc75989864b15937a8ea0df813a7f/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:01:20.351550 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cf55c-89f7-42cb-924d-f7e0f260c415 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:20.352271 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cf55c-89f7-42cb-924d-f7e0f260c415 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:20.352271 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cf55c-89f7-42cb-924d-f7e0f260c415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:20.381079 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-df9cf55c-89f7-42cb-924d-f7e0f260c415 None None] MFA Rules not processed for user `dc4bc75989864b15937a8ea0df813a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:20.382378 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-df9cf55c-89f7-42cb-924d-f7e0f260c415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:20.451980 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1390/2784] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 14:01:20.456469 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668660f-1a4f-47df-b7d2-7d89c74ccb57 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:20.539029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668660f-1a4f-47df-b7d2-7d89c74ccb57 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:20.548482 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e9b17-6e15-4254-ab98-64054bbd6d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:20.549162 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e9b17-6e15-4254-ab98-64054bbd6d20 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:20.549475 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e9b17-6e15-4254-ab98-64054bbd6d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:20.549758 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e9b17-6e15-4254-ab98-64054bbd6d20 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:20.550466 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e9b17-6e15-4254-ab98-64054bbd6d20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:20.560475 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e9b17-6e15-4254-ab98-64054bbd6d20 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:20.622706 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1395/2785] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:01:20 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:20.629725 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cf55c-89f7-42cb-924d-f7e0f260c415 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:20.641229 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cf55c-89f7-42cb-924d-f7e0f260c415 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:20.663593 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:20.711133 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f30440-dabd-4960-83e0-98818532b942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:20.711754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f30440-dabd-4960-83e0-98818532b942 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:20.712038 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f30440-dabd-4960-83e0-98818532b942 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:20.712313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f30440-dabd-4960-83e0-98818532b942 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:20.713010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f30440-dabd-4960-83e0-98818532b942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:20.715001 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f30440-dabd-4960-83e0-98818532b942 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:20.744645 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1391/2786] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:01:20 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:01:20.749474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e9b17-6e15-4254-ab98-64054bbd6d20 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:20.763527 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e9b17-6e15-4254-ab98-64054bbd6d20 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:20.770247 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c50939-2b83-4ae7-8b50-1ea43fb11563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:20.771203 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c50939-2b83-4ae7-8b50-1ea43fb11563 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:20.771656 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c50939-2b83-4ae7-8b50-1ea43fb11563 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:20.772113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c50939-2b83-4ae7-8b50-1ea43fb11563 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:20.773111 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c50939-2b83-4ae7-8b50-1ea43fb11563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:20.775132 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c50939-2b83-4ae7-8b50-1ea43fb11563 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:20.788734 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1396/2787] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:20.793430 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f30440-dabd-4960-83e0-98818532b942 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:20.805975 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f30440-dabd-4960-83e0-98818532b942 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:20.814222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc4fa0-c7de-4674-9119-817270e5eb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:20.815362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc4fa0-c7de-4674-9119-817270e5eb8d admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:20.815816 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc4fa0-c7de-4674-9119-817270e5eb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:20.816263 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc4fa0-c7de-4674-9119-817270e5eb8d admin admin] PATH_INFO: `/v3/projects/479d2bfe90bf4e91aa0e6e15fd218da4/users/6da23f2e94c84156bc4ad2f396daa592/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:20.839297 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc4fa0-c7de-4674-9119-817270e5eb8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=479d2bfe90bf4e91aa0e6e15fd218da4, user_id=6da23f2e94c84156bc4ad2f396daa592, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:20.842680 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc4fa0-c7de-4674-9119-817270e5eb8d admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:20.858217 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1392/2788] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:01:20 2022] PUT /identity/v3/projects/479d2bfe90bf4e91aa0e6e15fd218da4/users/6da23f2e94c84156bc4ad2f396daa592/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:20.862043 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c50939-2b83-4ae7-8b50-1ea43fb11563 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:20.881487 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c50939-2b83-4ae7-8b50-1ea43fb11563 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:20.962499 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9843dd1-6152-43ea-a8eb-75b8b5baf7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:20.963327 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9843dd1-6152-43ea-a8eb-75b8b5baf7ee admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:20.963680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9843dd1-6152-43ea-a8eb-75b8b5baf7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:20.963680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9843dd1-6152-43ea-a8eb-75b8b5baf7ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:20.965028 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9843dd1-6152-43ea-a8eb-75b8b5baf7ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:20.966715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9843dd1-6152-43ea-a8eb-75b8b5baf7ee admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:20.997658 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1397/2789] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:21.001604 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc4fa0-c7de-4674-9119-817270e5eb8d admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:21.012250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc4fa0-c7de-4674-9119-817270e5eb8d admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:21.030828 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858945ce-72d8-4396-bd87-f84a5067c596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:21.035336 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858945ce-72d8-4396-bd87-f84a5067c596 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:21.035681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858945ce-72d8-4396-bd87-f84a5067c596 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:21.036213 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858945ce-72d8-4396-bd87-f84a5067c596 admin admin] PATH_INFO: `/v3/projects/479d2bfe90bf4e91aa0e6e15fd218da4/users/6da23f2e94c84156bc4ad2f396daa592/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:21.041774 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858945ce-72d8-4396-bd87-f84a5067c596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=479d2bfe90bf4e91aa0e6e15fd218da4, user_id=6da23f2e94c84156bc4ad2f396daa592, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:21.045104 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858945ce-72d8-4396-bd87-f84a5067c596 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:21.058830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1393/2790] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:01:21 2022] PUT /identity/v3/projects/479d2bfe90bf4e91aa0e6e15fd218da4/users/6da23f2e94c84156bc4ad2f396daa592/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:01:21.068864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abe04f-ddfa-4e52-97f1-da37e9509fde None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:21.069148 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abe04f-ddfa-4e52-97f1-da37e9509fde None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:21.069456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abe04f-ddfa-4e52-97f1-da37e9509fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:21.083536 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:21.100830 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-52abe04f-ddfa-4e52-97f1-da37e9509fde None None] MFA Rules not processed for user `6da23f2e94c84156bc4ad2f396daa592`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:21.102438 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-52abe04f-ddfa-4e52-97f1-da37e9509fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:21.179896 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1398/2791] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:21.193129 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858945ce-72d8-4396-bd87-f84a5067c596 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:21.195122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-858945ce-72d8-4396-bd87-f84a5067c596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:21.261554 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858945ce-72d8-4396-bd87-f84a5067c596 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:21.265393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a599f68-b9f3-44c7-b30e-8e463b125424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:21.266040 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a599f68-b9f3-44c7-b30e-8e463b125424 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:21.266328 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a599f68-b9f3-44c7-b30e-8e463b125424 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:21.266609 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a599f68-b9f3-44c7-b30e-8e463b125424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:21.276306 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a599f68-b9f3-44c7-b30e-8e463b125424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:21.277818 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a599f68-b9f3-44c7-b30e-8e463b125424 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:21.289529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1394/2792] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:01:21.391487 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abe04f-ddfa-4e52-97f1-da37e9509fde None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:21.402902 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abe04f-ddfa-4e52-97f1-da37e9509fde None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:21.405716 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b09048-833d-4e81-9fba-ba8ec1230037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:21.406366 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b09048-833d-4e81-9fba-ba8ec1230037 service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:21.406648 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b09048-833d-4e81-9fba-ba8ec1230037 service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:21.406933 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b09048-833d-4e81-9fba-ba8ec1230037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:21.479095 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b09048-833d-4e81-9fba-ba8ec1230037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:21.481448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b09048-833d-4e81-9fba-ba8ec1230037 service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:21.492312 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1399/2793] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:01:28.219064 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a599f68-b9f3-44c7-b30e-8e463b125424 service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:28.291455 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a599f68-b9f3-44c7-b30e-8e463b125424 service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:28.296499 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c7458-e124-4b67-b034-8ffd9c193bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:28.297400 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c7458-e124-4b67-b034-8ffd9c193bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:28.297683 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c7458-e124-4b67-b034-8ffd9c193bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:28.297958 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c7458-e124-4b67-b034-8ffd9c193bc0 admin admin] PATH_INFO: `/v3/users/dc4bc75989864b15937a8ea0df813a7f` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:28.299129 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c7458-e124-4b67-b034-8ffd9c193bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc4bc75989864b15937a8ea0df813a7f)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:28.301040 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c7458-e124-4b67-b034-8ffd9c193bc0 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:28.323135 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:28.347981 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-257c7458-e124-4b67-b034-8ffd9c193bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc4bc75989864b15937a8ea0df813a7f'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:28.360365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-257c7458-e124-4b67-b034-8ffd9c193bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc4bc75989864b15937a8ea0df813a7f'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:28.361025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-257c7458-e124-4b67-b034-8ffd9c193bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc4bc75989864b15937a8ea0df813a7f'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:28.361646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-257c7458-e124-4b67-b034-8ffd9c193bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc4bc75989864b15937a8ea0df813a7f'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:28.369022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-257c7458-e124-4b67-b034-8ffd9c193bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc4bc75989864b15937a8ea0df813a7f'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:28.381481 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1395/2794] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:01:28 2022] DELETE /identity/v3/users/dc4bc75989864b15937a8ea0df813a7f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:28.386012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8396df4-2735-4048-8446-d1b98a6bc877 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:28.386520 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8396df4-2735-4048-8446-d1b98a6bc877 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:28.386644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8396df4-2735-4048-8446-d1b98a6bc877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:28.403405 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-b8396df4-2735-4048-8446-d1b98a6bc877 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:28.404591 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-b8396df4-2735-4048-8446-d1b98a6bc877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:28.462364 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1400/2795] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:28.472347 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c7458-e124-4b67-b034-8ffd9c193bc0 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:28.473885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-257c7458-e124-4b67-b034-8ffd9c193bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:28.534648 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c7458-e124-4b67-b034-8ffd9c193bc0 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:28.538418 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbad1b4-c154-45ae-80d2-78d50d8265c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:28.539054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbad1b4-c154-45ae-80d2-78d50d8265c7 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:28.539334 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbad1b4-c154-45ae-80d2-78d50d8265c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:28.539608 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbad1b4-c154-45ae-80d2-78d50d8265c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:28.550076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbad1b4-c154-45ae-80d2-78d50d8265c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:28.551663 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbad1b4-c154-45ae-80d2-78d50d8265c7 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:28.562086 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1396/2796] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:01:28.837199 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8396df4-2735-4048-8446-d1b98a6bc877 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:28.838743 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-b8396df4-2735-4048-8446-d1b98a6bc877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:28.856289 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8396df4-2735-4048-8446-d1b98a6bc877 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:28.862920 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae0ce3-d292-43d5-b0ab-19e4e454cdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:28.864271 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae0ce3-d292-43d5-b0ab-19e4e454cdb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:28.864551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae0ce3-d292-43d5-b0ab-19e4e454cdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:28.865180 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae0ce3-d292-43d5-b0ab-19e4e454cdb8 admin admin] PATH_INFO: `/v3/projects/dc82e458794e40a9804b860d48a24d85` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:28.866619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae0ce3-d292-43d5-b0ab-19e4e454cdb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc82e458794e40a9804b860d48a24d85)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:28.868678 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae0ce3-d292-43d5-b0ab-19e4e454cdb8 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:28.903479 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:28.922307 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cfae0ce3-d292-43d5-b0ab-19e4e454cdb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc82e458794e40a9804b860d48a24d85', 'request_id': 'req-cfae0ce3-d292-43d5-b0ab-19e4e454cdb8'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:28.929926 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cfae0ce3-d292-43d5-b0ab-19e4e454cdb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc82e458794e40a9804b860d48a24d85', 'request_id': 'req-cfae0ce3-d292-43d5-b0ab-19e4e454cdb8'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:28.937654 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cfae0ce3-d292-43d5-b0ab-19e4e454cdb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc82e458794e40a9804b860d48a24d85', 'request_id': 'req-cfae0ce3-d292-43d5-b0ab-19e4e454cdb8'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:28.949160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cfae0ce3-d292-43d5-b0ab-19e4e454cdb8 admin admin] The token cache is being invalidate because project dc82e458794e40a9804b860d48a24d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:01:28.949472 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cfae0ce3-d292-43d5-b0ab-19e4e454cdb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:28.950099 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cfae0ce3-d292-43d5-b0ab-19e4e454cdb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:28.951649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1401/2797] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:01:28 2022] DELETE /identity/v3/projects/dc82e458794e40a9804b860d48a24d85 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:28.955664 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbad1b4-c154-45ae-80d2-78d50d8265c7 service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:28.966919 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbad1b4-c154-45ae-80d2-78d50d8265c7 service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:29.046840 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359c8bf-3dc3-408b-ae0c-e58a85e0edd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:29.047838 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359c8bf-3dc3-408b-ae0c-e58a85e0edd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:29.048191 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359c8bf-3dc3-408b-ae0c-e58a85e0edd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:29.048538 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359c8bf-3dc3-408b-ae0c-e58a85e0edd8 admin admin] PATH_INFO: `/v3/users/6da23f2e94c84156bc4ad2f396daa592` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:29.049898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359c8bf-3dc3-408b-ae0c-e58a85e0edd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da23f2e94c84156bc4ad2f396daa592)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:29.056029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359c8bf-3dc3-408b-ae0c-e58a85e0edd8 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:29.110338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:29.121042 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b359c8bf-3dc3-408b-ae0c-e58a85e0edd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da23f2e94c84156bc4ad2f396daa592'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:29.137292 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b359c8bf-3dc3-408b-ae0c-e58a85e0edd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da23f2e94c84156bc4ad2f396daa592'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:29.138028 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b359c8bf-3dc3-408b-ae0c-e58a85e0edd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da23f2e94c84156bc4ad2f396daa592'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:29.139253 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b359c8bf-3dc3-408b-ae0c-e58a85e0edd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da23f2e94c84156bc4ad2f396daa592'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:29.149717 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b359c8bf-3dc3-408b-ae0c-e58a85e0edd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da23f2e94c84156bc4ad2f396daa592'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:29.168234 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1397/2798] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:01:28 2022] DELETE /identity/v3/users/6da23f2e94c84156bc4ad2f396daa592 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:01:29.457259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae0ce3-d292-43d5-b0ab-19e4e454cdb8 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:29.460375 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-cfae0ce3-d292-43d5-b0ab-19e4e454cdb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:29.477039 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae0ce3-d292-43d5-b0ab-19e4e454cdb8 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:29.541528 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2b9d8-c424-49b5-8135-ae6c896ea61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:29.543011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2b9d8-c424-49b5-8135-ae6c896ea61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:29.543296 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2b9d8-c424-49b5-8135-ae6c896ea61f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:29.543571 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2b9d8-c424-49b5-8135-ae6c896ea61f admin admin] PATH_INFO: `/v3/projects/479d2bfe90bf4e91aa0e6e15fd218da4` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:29.544818 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2b9d8-c424-49b5-8135-ae6c896ea61f admin admin] RBAC: Authorizing `identity:delete_project(project_id=479d2bfe90bf4e91aa0e6e15fd218da4)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:29.546766 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2b9d8-c424-49b5-8135-ae6c896ea61f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:29.598593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3ed2b9d8-c424-49b5-8135-ae6c896ea61f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '479d2bfe90bf4e91aa0e6e15fd218da4', 'request_id': 'req-3ed2b9d8-c424-49b5-8135-ae6c896ea61f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:29.606937 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3ed2b9d8-c424-49b5-8135-ae6c896ea61f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '479d2bfe90bf4e91aa0e6e15fd218da4', 'request_id': 'req-3ed2b9d8-c424-49b5-8135-ae6c896ea61f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:29.614630 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3ed2b9d8-c424-49b5-8135-ae6c896ea61f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '479d2bfe90bf4e91aa0e6e15fd218da4', 'request_id': 'req-3ed2b9d8-c424-49b5-8135-ae6c896ea61f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:29.626438 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3ed2b9d8-c424-49b5-8135-ae6c896ea61f admin admin] The token cache is being invalidate because project 479d2bfe90bf4e91aa0e6e15fd218da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:01:29.626724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3ed2b9d8-c424-49b5-8135-ae6c896ea61f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:29.627337 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3ed2b9d8-c424-49b5-8135-ae6c896ea61f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:29.628849 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1402/2799] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:01:29 2022] DELETE /identity/v3/projects/479d2bfe90bf4e91aa0e6e15fd218da4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:01:29.633726 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978d61d-0ee9-40c3-86d4-c31fba519633 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:29.634198 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978d61d-0ee9-40c3-86d4-c31fba519633 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:29.634298 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978d61d-0ee9-40c3-86d4-c31fba519633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:29.654049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-0978d61d-0ee9-40c3-86d4-c31fba519633 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:29.655333 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-0978d61d-0ee9-40c3-86d4-c31fba519633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:29.715066 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1398/2800] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:29.724082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd294b4-a8ed-4a6a-9953-0c29251e9ec8 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:29.724369 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd294b4-a8ed-4a6a-9953-0c29251e9ec8 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:29.724649 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd294b4-a8ed-4a6a-9953-0c29251e9ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:29.743467 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-2fd294b4-a8ed-4a6a-9953-0c29251e9ec8 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:29.744662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-2fd294b4-a8ed-4a6a-9953-0c29251e9ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:29.754044 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1403/2801] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:29.758696 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978d61d-0ee9-40c3-86d4-c31fba519633 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:29.769230 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978d61d-0ee9-40c3-86d4-c31fba519633 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:29.773857 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6684de8-666f-4e80-be81-0680c16c5397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:29.774506 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6684de8-666f-4e80-be81-0680c16c5397 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:29.774787 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6684de8-666f-4e80-be81-0680c16c5397 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:29.775061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6684de8-666f-4e80-be81-0680c16c5397 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:29.775773 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6684de8-666f-4e80-be81-0680c16c5397 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:01:29.776076 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6684de8-666f-4e80-be81-0680c16c5397 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:29.777692 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6684de8-666f-4e80-be81-0680c16c5397 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:29.790001 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1399/2802] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:01:29.795365 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd294b4-a8ed-4a6a-9953-0c29251e9ec8 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:29.804605 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd294b4-a8ed-4a6a-9953-0c29251e9ec8 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:29.809990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebe5d4-321e-4c3f-b7a9-c35298aace07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:29.810635 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebe5d4-321e-4c3f-b7a9-c35298aace07 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:29.810922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebe5d4-321e-4c3f-b7a9-c35298aace07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:29.811230 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebe5d4-321e-4c3f-b7a9-c35298aace07 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:29.811919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebe5d4-321e-4c3f-b7a9-c35298aace07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:29.813887 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebe5d4-321e-4c3f-b7a9-c35298aace07 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:29.839301 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1404/2803] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:01:29 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:29.843028 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6684de8-666f-4e80-be81-0680c16c5397 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:29.853699 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6684de8-666f-4e80-be81-0680c16c5397 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:29.912109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78016d09-be7e-40a4-92df-ab12f8e813c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:29.912780 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78016d09-be7e-40a4-92df-ab12f8e813c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:29.913062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78016d09-be7e-40a4-92df-ab12f8e813c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:29.913372 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78016d09-be7e-40a4-92df-ab12f8e813c6 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:29.914054 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78016d09-be7e-40a4-92df-ab12f8e813c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:29.915995 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78016d09-be7e-40a4-92df-ab12f8e813c6 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:29.936629 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1400/2804] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:01:29 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:29.940811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebe5d4-321e-4c3f-b7a9-c35298aace07 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:29.950983 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebe5d4-321e-4c3f-b7a9-c35298aace07 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:29.955610 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63458d5f-ea32-4da6-a75c-cf0bae363454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:29.956260 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63458d5f-ea32-4da6-a75c-cf0bae363454 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:29.956538 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63458d5f-ea32-4da6-a75c-cf0bae363454 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:29.956916 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63458d5f-ea32-4da6-a75c-cf0bae363454 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:29.957738 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63458d5f-ea32-4da6-a75c-cf0bae363454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:29.959330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63458d5f-ea32-4da6-a75c-cf0bae363454 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:29.970347 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1405/2805] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 14:01:29.975922 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78016d09-be7e-40a4-92df-ab12f8e813c6 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:29.990429 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78016d09-be7e-40a4-92df-ab12f8e813c6 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:29.996588 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa25200-e607-4db7-8f88-f95eb13e4784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:29.997244 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa25200-e607-4db7-8f88-f95eb13e4784 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:29.997561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa25200-e607-4db7-8f88-f95eb13e4784 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:29.997826 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa25200-e607-4db7-8f88-f95eb13e4784 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:29.998539 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa25200-e607-4db7-8f88-f95eb13e4784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:30.000123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa25200-e607-4db7-8f88-f95eb13e4784 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:30.010013 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1401/2806] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:30.014110 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63458d5f-ea32-4da6-a75c-cf0bae363454 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:30.020334 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:30.024014 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63458d5f-ea32-4da6-a75c-cf0bae363454 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:30.030260 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06f088-0720-463e-8c4a-69becefaedf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:30.031281 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06f088-0720-463e-8c4a-69becefaedf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:30.031767 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06f088-0720-463e-8c4a-69becefaedf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:30.032213 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06f088-0720-463e-8c4a-69becefaedf6 admin admin] PATH_INFO: `/v3/projects/91e0c83bc07f41e08f61cda8360ef434/users/82dd99c04f73493eb2a9dcc0ae9baf62/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:30.047372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06f088-0720-463e-8c4a-69becefaedf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e0c83bc07f41e08f61cda8360ef434, user_id=82dd99c04f73493eb2a9dcc0ae9baf62, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:30.050882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06f088-0720-463e-8c4a-69becefaedf6 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:30.065248 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1406/2807] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:01:30 2022] PUT /identity/v3/projects/91e0c83bc07f41e08f61cda8360ef434/users/82dd99c04f73493eb2a9dcc0ae9baf62/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:30.075645 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849677e-2bfe-4af3-976c-60f6e1a924e1 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:30.075938 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849677e-2bfe-4af3-976c-60f6e1a924e1 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:30.076218 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849677e-2bfe-4af3-976c-60f6e1a924e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:30.102489 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a849677e-2bfe-4af3-976c-60f6e1a924e1 None None] MFA Rules not processed for user `82dd99c04f73493eb2a9dcc0ae9baf62`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:30.103689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a849677e-2bfe-4af3-976c-60f6e1a924e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:30.115859 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:30.168125 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1402/2808] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:30.172521 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06f088-0720-463e-8c4a-69becefaedf6 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:30.236980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06f088-0720-463e-8c4a-69becefaedf6 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:30.242007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79571c4-48c7-4415-888c-b499fc879e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:30.242662 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79571c4-48c7-4415-888c-b499fc879e87 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:30.242945 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79571c4-48c7-4415-888c-b499fc879e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:30.243222 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79571c4-48c7-4415-888c-b499fc879e87 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:30.243921 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79571c4-48c7-4415-888c-b499fc879e87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:30.245829 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79571c4-48c7-4415-888c-b499fc879e87 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:30.275199 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1407/2809] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:01:30 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:01:30.278091 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849677e-2bfe-4af3-976c-60f6e1a924e1 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:30.290075 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849677e-2bfe-4af3-976c-60f6e1a924e1 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:30.352770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bada82-ac95-4159-89c6-71f268abd4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:30.353592 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bada82-ac95-4159-89c6-71f268abd4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:30.353873 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bada82-ac95-4159-89c6-71f268abd4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:30.354222 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bada82-ac95-4159-89c6-71f268abd4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:30.354968 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bada82-ac95-4159-89c6-71f268abd4b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:30.357107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bada82-ac95-4159-89c6-71f268abd4b1 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:30.377122 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1403/2810] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:01:30 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:30.381330 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79571c4-48c7-4415-888c-b499fc879e87 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:30.391847 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79571c4-48c7-4415-888c-b499fc879e87 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:30.396429 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d7e7f-356f-4d02-8176-cca604329197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:30.397085 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d7e7f-356f-4d02-8176-cca604329197 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:30.397387 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d7e7f-356f-4d02-8176-cca604329197 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:30.397664 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d7e7f-356f-4d02-8176-cca604329197 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:30.398398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d7e7f-356f-4d02-8176-cca604329197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:30.399966 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d7e7f-356f-4d02-8176-cca604329197 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:30.411021 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1408/2811] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:30.415549 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bada82-ac95-4159-89c6-71f268abd4b1 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:30.425848 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bada82-ac95-4159-89c6-71f268abd4b1 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:30.430697 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356674b-6c57-451e-be91-55f3c9a3e85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:30.431564 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356674b-6c57-451e-be91-55f3c9a3e85a admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:30.431844 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356674b-6c57-451e-be91-55f3c9a3e85a admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:30.432128 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356674b-6c57-451e-be91-55f3c9a3e85a admin admin] PATH_INFO: `/v3/projects/d661e428c03d4eafb9c05c56cca98550/users/f109d0ee25cc4595a1723823d04b450a/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:30.449304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356674b-6c57-451e-be91-55f3c9a3e85a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d661e428c03d4eafb9c05c56cca98550, user_id=f109d0ee25cc4595a1723823d04b450a, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:30.451885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356674b-6c57-451e-be91-55f3c9a3e85a admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:30.465617 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1404/2812] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:01:30 2022] PUT /identity/v3/projects/d661e428c03d4eafb9c05c56cca98550/users/f109d0ee25cc4595a1723823d04b450a/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:30.469889 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d7e7f-356f-4d02-8176-cca604329197 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:30.480745 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d7e7f-356f-4d02-8176-cca604329197 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:30.535483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6292022-fac5-40da-8d81-5e4f8c8518ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:30.536136 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6292022-fac5-40da-8d81-5e4f8c8518ce admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:30.536421 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6292022-fac5-40da-8d81-5e4f8c8518ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:30.536699 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6292022-fac5-40da-8d81-5e4f8c8518ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:30.537445 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6292022-fac5-40da-8d81-5e4f8c8518ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:30.539012 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6292022-fac5-40da-8d81-5e4f8c8518ce admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:30.548762 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1409/2813] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:30.553162 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356674b-6c57-451e-be91-55f3c9a3e85a admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:30.563360 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356674b-6c57-451e-be91-55f3c9a3e85a admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:30.567887 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f137fda-9b51-426e-b5ae-1622b06a21ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:30.568751 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f137fda-9b51-426e-b5ae-1622b06a21ba admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:30.569032 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f137fda-9b51-426e-b5ae-1622b06a21ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:30.569338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f137fda-9b51-426e-b5ae-1622b06a21ba admin admin] PATH_INFO: `/v3/projects/d661e428c03d4eafb9c05c56cca98550/users/f109d0ee25cc4595a1723823d04b450a/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:30.571289 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f137fda-9b51-426e-b5ae-1622b06a21ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d661e428c03d4eafb9c05c56cca98550, user_id=f109d0ee25cc4595a1723823d04b450a, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:30.574441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f137fda-9b51-426e-b5ae-1622b06a21ba admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:30.585978 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1405/2814] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:01:30 2022] PUT /identity/v3/projects/d661e428c03d4eafb9c05c56cca98550/users/f109d0ee25cc4595a1723823d04b450a/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:01:30.596789 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a5924-e359-4aff-8391-9d719ae9209e None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:30.597083 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a5924-e359-4aff-8391-9d719ae9209e None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:30.597397 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a5924-e359-4aff-8391-9d719ae9209e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:30.624311 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-942a5924-e359-4aff-8391-9d719ae9209e None None] MFA Rules not processed for user `f109d0ee25cc4595a1723823d04b450a`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:30.625555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-942a5924-e359-4aff-8391-9d719ae9209e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:30.667196 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:30.699444 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1410/2815] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:30.710319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f137fda-9b51-426e-b5ae-1622b06a21ba admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:30.712083 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-5f137fda-9b51-426e-b5ae-1622b06a21ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:30.773324 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f137fda-9b51-426e-b5ae-1622b06a21ba admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:30.776897 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561a707-db36-4777-96a2-f7c844b35943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:30.777561 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561a707-db36-4777-96a2-f7c844b35943 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:30.777861 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561a707-db36-4777-96a2-f7c844b35943 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:30.778109 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561a707-db36-4777-96a2-f7c844b35943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:30.787012 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561a707-db36-4777-96a2-f7c844b35943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:30.788431 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561a707-db36-4777-96a2-f7c844b35943 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:30.797921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1406/2816] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:30 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:01:32.189650 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a5924-e359-4aff-8391-9d719ae9209e None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:32.275109 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a5924-e359-4aff-8391-9d719ae9209e None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:32.282255 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a4769-2ff9-4c65-b19e-c1e02498e6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:32.283166 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a4769-2ff9-4c65-b19e-c1e02498e6f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:32.283444 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a4769-2ff9-4c65-b19e-c1e02498e6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:32.283763 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a4769-2ff9-4c65-b19e-c1e02498e6f0 admin admin] PATH_INFO: `/v3/users/82dd99c04f73493eb2a9dcc0ae9baf62` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:32.284993 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a4769-2ff9-4c65-b19e-c1e02498e6f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82dd99c04f73493eb2a9dcc0ae9baf62)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:32.286974 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a4769-2ff9-4c65-b19e-c1e02498e6f0 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:32.354138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-720a4769-2ff9-4c65-b19e-c1e02498e6f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82dd99c04f73493eb2a9dcc0ae9baf62'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:32.354757 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-720a4769-2ff9-4c65-b19e-c1e02498e6f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82dd99c04f73493eb2a9dcc0ae9baf62'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:32.355344 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-720a4769-2ff9-4c65-b19e-c1e02498e6f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82dd99c04f73493eb2a9dcc0ae9baf62'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:32.363928 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-720a4769-2ff9-4c65-b19e-c1e02498e6f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82dd99c04f73493eb2a9dcc0ae9baf62'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:32.373374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-720a4769-2ff9-4c65-b19e-c1e02498e6f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82dd99c04f73493eb2a9dcc0ae9baf62'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:32.394714 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1411/2817] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:01:32 2022] DELETE /identity/v3/users/82dd99c04f73493eb2a9dcc0ae9baf62 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:32.399647 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45c42d-727a-4ce0-b9ae-92fefe22d492 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:32.400156 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45c42d-727a-4ce0-b9ae-92fefe22d492 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:32.400263 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45c42d-727a-4ce0-b9ae-92fefe22d492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:32.418255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-2d45c42d-727a-4ce0-b9ae-92fefe22d492 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:32.419471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-2d45c42d-727a-4ce0-b9ae-92fefe22d492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:32.423520 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:32.485022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1407/2818] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:32.499481 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a4769-2ff9-4c65-b19e-c1e02498e6f0 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:32.500947 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-720a4769-2ff9-4c65-b19e-c1e02498e6f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:32.536427 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45c42d-727a-4ce0-b9ae-92fefe22d492 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:32.537843 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-2d45c42d-727a-4ce0-b9ae-92fefe22d492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:32.567814 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a4769-2ff9-4c65-b19e-c1e02498e6f0 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:32.572298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125fde6-9672-4a00-91b4-3e425c30b590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:32.573110 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125fde6-9672-4a00-91b4-3e425c30b590 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:32.573636 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125fde6-9672-4a00-91b4-3e425c30b590 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:32.573977 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125fde6-9672-4a00-91b4-3e425c30b590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:32.586053 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125fde6-9672-4a00-91b4-3e425c30b590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:32.587494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125fde6-9672-4a00-91b4-3e425c30b590 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:32.592579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:32.599893 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1412/2819] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:01:32.605393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45c42d-727a-4ce0-b9ae-92fefe22d492 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:32.609360 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c934687-8212-4409-9d39-0ee2758b9c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:32.610080 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c934687-8212-4409-9d39-0ee2758b9c62 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:32.610374 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c934687-8212-4409-9d39-0ee2758b9c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:32.610640 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c934687-8212-4409-9d39-0ee2758b9c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:32.612438 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1c934687-8212-4409-9d39-0ee2758b9c62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:32.688495 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c934687-8212-4409-9d39-0ee2758b9c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:32.689994 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c934687-8212-4409-9d39-0ee2758b9c62 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:32.700220 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1408/2820] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 14:01:33.087083 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125fde6-9672-4a00-91b4-3e425c30b590 service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:33.088520 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-8125fde6-9672-4a00-91b4-3e425c30b590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:33.104086 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125fde6-9672-4a00-91b4-3e425c30b590 service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:33.110872 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826fc89-049d-46d1-a288-d27fea2846e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:33.111879 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826fc89-049d-46d1-a288-d27fea2846e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:33.112165 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826fc89-049d-46d1-a288-d27fea2846e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:33.112447 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826fc89-049d-46d1-a288-d27fea2846e0 admin admin] PATH_INFO: `/v3/projects/91e0c83bc07f41e08f61cda8360ef434` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:33.113923 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826fc89-049d-46d1-a288-d27fea2846e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e0c83bc07f41e08f61cda8360ef434)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:33.116316 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826fc89-049d-46d1-a288-d27fea2846e0 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:33.174964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0826fc89-049d-46d1-a288-d27fea2846e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e0c83bc07f41e08f61cda8360ef434', 'request_id': 'req-0826fc89-049d-46d1-a288-d27fea2846e0'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:33.181862 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0826fc89-049d-46d1-a288-d27fea2846e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e0c83bc07f41e08f61cda8360ef434', 'request_id': 'req-0826fc89-049d-46d1-a288-d27fea2846e0'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:33.195226 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0826fc89-049d-46d1-a288-d27fea2846e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e0c83bc07f41e08f61cda8360ef434', 'request_id': 'req-0826fc89-049d-46d1-a288-d27fea2846e0'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:33.207036 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0826fc89-049d-46d1-a288-d27fea2846e0 admin admin] The token cache is being invalidate because project 91e0c83bc07f41e08f61cda8360ef434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:01:33.207572 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0826fc89-049d-46d1-a288-d27fea2846e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:33.208228 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0826fc89-049d-46d1-a288-d27fea2846e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:33.209815 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1413/2821] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:01:33 2022] DELETE /identity/v3/projects/91e0c83bc07f41e08f61cda8360ef434 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:33.214325 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c934687-8212-4409-9d39-0ee2758b9c62 service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:33.229554 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c934687-8212-4409-9d39-0ee2758b9c62 service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:33.290514 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17914e68-7671-4caf-8279-6d7a4306a5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:33.291387 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17914e68-7671-4caf-8279-6d7a4306a5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:33.291671 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17914e68-7671-4caf-8279-6d7a4306a5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:33.291971 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17914e68-7671-4caf-8279-6d7a4306a5b4 admin admin] PATH_INFO: `/v3/users/f109d0ee25cc4595a1723823d04b450a` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:33.293261 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17914e68-7671-4caf-8279-6d7a4306a5b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f109d0ee25cc4595a1723823d04b450a)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:33.295201 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17914e68-7671-4caf-8279-6d7a4306a5b4 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:33.296676 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=100 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:33.354914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-17914e68-7671-4caf-8279-6d7a4306a5b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f109d0ee25cc4595a1723823d04b450a'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:33.367345 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-17914e68-7671-4caf-8279-6d7a4306a5b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f109d0ee25cc4595a1723823d04b450a'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:33.368152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-17914e68-7671-4caf-8279-6d7a4306a5b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f109d0ee25cc4595a1723823d04b450a'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:33.368777 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-17914e68-7671-4caf-8279-6d7a4306a5b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f109d0ee25cc4595a1723823d04b450a'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:33.376215 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-17914e68-7671-4caf-8279-6d7a4306a5b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f109d0ee25cc4595a1723823d04b450a'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:33.391745 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1409/2822] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:01:33 2022] DELETE /identity/v3/users/f109d0ee25cc4595a1723823d04b450a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:33.689661 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826fc89-049d-46d1-a288-d27fea2846e0 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:33.691093 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-0826fc89-049d-46d1-a288-d27fea2846e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:33.718348 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826fc89-049d-46d1-a288-d27fea2846e0 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:33.779756 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461757b-c194-4d52-85e6-fb992ca60dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:33.780627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461757b-c194-4d52-85e6-fb992ca60dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:33.780941 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461757b-c194-4d52-85e6-fb992ca60dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:33.781224 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461757b-c194-4d52-85e6-fb992ca60dd5 admin admin] PATH_INFO: `/v3/projects/d661e428c03d4eafb9c05c56cca98550` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:33.782448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461757b-c194-4d52-85e6-fb992ca60dd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d661e428c03d4eafb9c05c56cca98550)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:33.784381 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461757b-c194-4d52-85e6-fb992ca60dd5 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:33.840518 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c461757b-c194-4d52-85e6-fb992ca60dd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd661e428c03d4eafb9c05c56cca98550', 'request_id': 'req-c461757b-c194-4d52-85e6-fb992ca60dd5'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:33.848639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c461757b-c194-4d52-85e6-fb992ca60dd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd661e428c03d4eafb9c05c56cca98550', 'request_id': 'req-c461757b-c194-4d52-85e6-fb992ca60dd5'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:33.863659 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c461757b-c194-4d52-85e6-fb992ca60dd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd661e428c03d4eafb9c05c56cca98550', 'request_id': 'req-c461757b-c194-4d52-85e6-fb992ca60dd5'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:33.878170 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c461757b-c194-4d52-85e6-fb992ca60dd5 admin admin] The token cache is being invalidate because project d661e428c03d4eafb9c05c56cca98550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:01:33.878527 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c461757b-c194-4d52-85e6-fb992ca60dd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:33.879860 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-c461757b-c194-4d52-85e6-fb992ca60dd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:33.881948 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1414/2823] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:01:33 2022] DELETE /identity/v3/projects/d661e428c03d4eafb9c05c56cca98550 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:33.886624 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe43cc-57b9-4ee4-8201-47eaf68de6f1 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:33.887107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe43cc-57b9-4ee4-8201-47eaf68de6f1 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:33.887193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe43cc-57b9-4ee4-8201-47eaf68de6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:33.906596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-edfe43cc-57b9-4ee4-8201-47eaf68de6f1 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:33.907908 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-edfe43cc-57b9-4ee4-8201-47eaf68de6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:33.983345 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1410/2824] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 14:01:33.992517 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb15235-0897-408a-9ba6-c72d36d461fd None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:33.992810 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb15235-0897-408a-9ba6-c72d36d461fd None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:33.993095 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb15235-0897-408a-9ba6-c72d36d461fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:34.013841 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-9eb15235-0897-408a-9ba6-c72d36d461fd None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:34.015758 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-9eb15235-0897-408a-9ba6-c72d36d461fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:34.024897 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1415/2825] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:34.029842 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe43cc-57b9-4ee4-8201-47eaf68de6f1 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:34.040047 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe43cc-57b9-4ee4-8201-47eaf68de6f1 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:34.044677 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb815820-0d10-4f54-a42d-002103d826ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:34.045360 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb815820-0d10-4f54-a42d-002103d826ab admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:34.045643 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb815820-0d10-4f54-a42d-002103d826ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:34.045914 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb815820-0d10-4f54-a42d-002103d826ab admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:34.049508 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb815820-0d10-4f54-a42d-002103d826ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:01:34.049508 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb815820-0d10-4f54-a42d-002103d826ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:34.049508 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb815820-0d10-4f54-a42d-002103d826ab admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:34.063380 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1411/2826] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:01:34.068457 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb15235-0897-408a-9ba6-c72d36d461fd None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:34.074990 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:34.079092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb15235-0897-408a-9ba6-c72d36d461fd None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:34.088821 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f608e60-6008-494e-96c3-8d5b7cb5867a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:34.090477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f608e60-6008-494e-96c3-8d5b7cb5867a admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:34.090835 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f608e60-6008-494e-96c3-8d5b7cb5867a admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:34.091485 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f608e60-6008-494e-96c3-8d5b7cb5867a admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:34.092279 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f608e60-6008-494e-96c3-8d5b7cb5867a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:34.094326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f608e60-6008-494e-96c3-8d5b7cb5867a admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:34.120382 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1416/2827] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:01:34 2022] POST /identity/v3/projects => generated 407 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:34.124642 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb815820-0d10-4f54-a42d-002103d826ab admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:34.135211 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb815820-0d10-4f54-a42d-002103d826ab admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:34.197856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22008e-8973-46fe-84c3-9f5748d962fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:34.199413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22008e-8973-46fe-84c3-9f5748d962fd admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:34.199413 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22008e-8973-46fe-84c3-9f5748d962fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:34.199665 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22008e-8973-46fe-84c3-9f5748d962fd admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:34.200304 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22008e-8973-46fe-84c3-9f5748d962fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:34.202289 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22008e-8973-46fe-84c3-9f5748d962fd admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:34.218274 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:34.231139 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1412/2828] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:01:34 2022] POST /identity/v3/users => generated 304 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:34.234856 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f608e60-6008-494e-96c3-8d5b7cb5867a admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:34.246122 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f608e60-6008-494e-96c3-8d5b7cb5867a admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:34.252813 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41452d-7059-4e8d-8886-1dc016d63c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:34.261356 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41452d-7059-4e8d-8886-1dc016d63c71 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:34.261879 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41452d-7059-4e8d-8886-1dc016d63c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:34.262259 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41452d-7059-4e8d-8886-1dc016d63c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:34.263257 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41452d-7059-4e8d-8886-1dc016d63c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:34.265217 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41452d-7059-4e8d-8886-1dc016d63c71 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:34.278427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1417/2829] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 14:01:34.282626 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22008e-8973-46fe-84c3-9f5748d962fd admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:34.297766 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22008e-8973-46fe-84c3-9f5748d962fd admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:34.305967 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8857055-6693-4ab3-be2a-c8cc84473dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:34.306818 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8857055-6693-4ab3-be2a-c8cc84473dfb admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:34.307844 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8857055-6693-4ab3-be2a-c8cc84473dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:34.308151 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8857055-6693-4ab3-be2a-c8cc84473dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:34.309062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8857055-6693-4ab3-be2a-c8cc84473dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:34.310811 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8857055-6693-4ab3-be2a-c8cc84473dfb admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:34.327600 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41452d-7059-4e8d-8886-1dc016d63c71 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:34.341670 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1413/2830] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:34.347509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41452d-7059-4e8d-8886-1dc016d63c71 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:34.352497 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebd13a-2466-491b-ad51-bd5cae509166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:34.353403 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebd13a-2466-491b-ad51-bd5cae509166 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:34.353891 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebd13a-2466-491b-ad51-bd5cae509166 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:34.354485 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebd13a-2466-491b-ad51-bd5cae509166 admin admin] PATH_INFO: `/v3/projects/1219e79b317d43a6bec48a07fcb97835/users/7932d5acc3d04e44b3de6fb4d7004ced/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:34.371008 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ebd13a-2466-491b-ad51-bd5cae509166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1219e79b317d43a6bec48a07fcb97835, user_id=7932d5acc3d04e44b3de6fb4d7004ced, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:34.373917 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ebd13a-2466-491b-ad51-bd5cae509166 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:34.425170 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1418/2831] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:01:34 2022] PUT /identity/v3/projects/1219e79b317d43a6bec48a07fcb97835/users/7932d5acc3d04e44b3de6fb4d7004ced/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:34.436529 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4b38b-d02d-4ebc-b97f-820df51c93d4 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:34.437043 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4b38b-d02d-4ebc-b97f-820df51c93d4 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:34.437552 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4b38b-d02d-4ebc-b97f-820df51c93d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:34.470689 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-45f4b38b-d02d-4ebc-b97f-820df51c93d4 None None] MFA Rules not processed for user `7932d5acc3d04e44b3de6fb4d7004ced`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:34.471964 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-45f4b38b-d02d-4ebc-b97f-820df51c93d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:34.570710 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1414/2832] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:34.572651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebd13a-2466-491b-ad51-bd5cae509166 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:34.719456 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebd13a-2466-491b-ad51-bd5cae509166 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:34.724554 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7692b-7bf5-4a6f-9d6d-8bdf842accce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:34.725324 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7692b-7bf5-4a6f-9d6d-8bdf842accce admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:34.725610 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7692b-7bf5-4a6f-9d6d-8bdf842accce admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:34.725884 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7692b-7bf5-4a6f-9d6d-8bdf842accce admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:34.726582 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7692b-7bf5-4a6f-9d6d-8bdf842accce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:34.728473 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7692b-7bf5-4a6f-9d6d-8bdf842accce admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:34.766171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1419/2833] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:01:34 2022] POST /identity/v3/projects => generated 407 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:34.770097 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4b38b-d02d-4ebc-b97f-820df51c93d4 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:34.784288 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4b38b-d02d-4ebc-b97f-820df51c93d4 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:34.866310 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988d8f1-eb27-4c85-ad5a-2ef481f8dff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:34.867679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988d8f1-eb27-4c85-ad5a-2ef481f8dff2 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:34.867679 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988d8f1-eb27-4c85-ad5a-2ef481f8dff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:34.867909 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988d8f1-eb27-4c85-ad5a-2ef481f8dff2 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:34.868684 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988d8f1-eb27-4c85-ad5a-2ef481f8dff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:34.872407 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988d8f1-eb27-4c85-ad5a-2ef481f8dff2 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:34.908283 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1415/2834] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:01:34 2022] POST /identity/v3/users => generated 310 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:34.914142 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7692b-7bf5-4a6f-9d6d-8bdf842accce admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:34.936024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7692b-7bf5-4a6f-9d6d-8bdf842accce admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:34.942229 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387c9bd-6a28-4352-9d9b-cb01c40fab89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:34.942903 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387c9bd-6a28-4352-9d9b-cb01c40fab89 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:34.943211 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387c9bd-6a28-4352-9d9b-cb01c40fab89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:34.943593 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387c9bd-6a28-4352-9d9b-cb01c40fab89 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:34.944409 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387c9bd-6a28-4352-9d9b-cb01c40fab89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:34.946037 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387c9bd-6a28-4352-9d9b-cb01c40fab89 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:34.960466 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1420/2835] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:34.964312 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988d8f1-eb27-4c85-ad5a-2ef481f8dff2 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:34.985223 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988d8f1-eb27-4c85-ad5a-2ef481f8dff2 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:34.995983 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d1671-38ba-4827-b18d-d0864651b307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:34.997020 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d1671-38ba-4827-b18d-d0864651b307 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:34.997368 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d1671-38ba-4827-b18d-d0864651b307 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:34.997951 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d1671-38ba-4827-b18d-d0864651b307 admin admin] PATH_INFO: `/v3/projects/340fe69d7ba44c35b12dcee014fb6f34/users/27c8457dc8f84e86ae24e86f73bea545/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:35.021929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d1671-38ba-4827-b18d-d0864651b307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=340fe69d7ba44c35b12dcee014fb6f34, user_id=27c8457dc8f84e86ae24e86f73bea545, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:35.024860 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d1671-38ba-4827-b18d-d0864651b307 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:35.044893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1416/2836] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:01:34 2022] PUT /identity/v3/projects/340fe69d7ba44c35b12dcee014fb6f34/users/27c8457dc8f84e86ae24e86f73bea545/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:35.051354 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387c9bd-6a28-4352-9d9b-cb01c40fab89 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:35.075209 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387c9bd-6a28-4352-9d9b-cb01c40fab89 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:35.180942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18691ca-3b57-46b7-afd4-b5ee4b4185e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:35.180942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18691ca-3b57-46b7-afd4-b5ee4b4185e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:35.180942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18691ca-3b57-46b7-afd4-b5ee4b4185e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:35.180942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18691ca-3b57-46b7-afd4-b5ee4b4185e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:35.181586 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18691ca-3b57-46b7-afd4-b5ee4b4185e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:35.182487 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18691ca-3b57-46b7-afd4-b5ee4b4185e3 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:35.193792 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1421/2837] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:35.197853 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d1671-38ba-4827-b18d-d0864651b307 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:35.213123 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d1671-38ba-4827-b18d-d0864651b307 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:35.220574 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c59cc8-416c-40e9-9750-412004123ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:35.221617 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c59cc8-416c-40e9-9750-412004123ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:35.222002 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c59cc8-416c-40e9-9750-412004123ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:35.222399 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c59cc8-416c-40e9-9750-412004123ee1 admin admin] PATH_INFO: `/v3/projects/340fe69d7ba44c35b12dcee014fb6f34/users/27c8457dc8f84e86ae24e86f73bea545/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:35.224503 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c59cc8-416c-40e9-9750-412004123ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=340fe69d7ba44c35b12dcee014fb6f34, user_id=27c8457dc8f84e86ae24e86f73bea545, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:35.227411 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c59cc8-416c-40e9-9750-412004123ee1 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:35.238880 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1417/2838] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:01:35 2022] PUT /identity/v3/projects/340fe69d7ba44c35b12dcee014fb6f34/users/27c8457dc8f84e86ae24e86f73bea545/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:35.251351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c458448-afb4-4fa2-8763-a1e743bd0dbb None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:35.251868 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c458448-afb4-4fa2-8763-a1e743bd0dbb None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:35.252009 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c458448-afb4-4fa2-8763-a1e743bd0dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:35.283156 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-6c458448-afb4-4fa2-8763-a1e743bd0dbb None None] MFA Rules not processed for user `27c8457dc8f84e86ae24e86f73bea545`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:35.285007 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-6c458448-afb4-4fa2-8763-a1e743bd0dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:35.291294 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:35.369004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1422/2839] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:35 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:35.379815 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c59cc8-416c-40e9-9750-412004123ee1 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:35.382026 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-06c59cc8-416c-40e9-9750-412004123ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:35.429170 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:35.487622 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c59cc8-416c-40e9-9750-412004123ee1 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:35.492329 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aebb9d-6a7e-4350-bd8a-2a67606c7970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:35.493341 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aebb9d-6a7e-4350-bd8a-2a67606c7970 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:35.493856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aebb9d-6a7e-4350-bd8a-2a67606c7970 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:35.494358 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aebb9d-6a7e-4350-bd8a-2a67606c7970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:35.510404 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aebb9d-6a7e-4350-bd8a-2a67606c7970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:35.513419 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aebb9d-6a7e-4350-bd8a-2a67606c7970 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:35.540830 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1418/2840] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:35 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:01:35.770831 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c458448-afb4-4fa2-8763-a1e743bd0dbb None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:35.784483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c458448-afb4-4fa2-8763-a1e743bd0dbb None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:35.789193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddbef9-451f-4600-982e-dcbdd0d33fb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:35.789963 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddbef9-451f-4600-982e-dcbdd0d33fb6 service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:35.790326 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddbef9-451f-4600-982e-dcbdd0d33fb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:35.790675 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddbef9-451f-4600-982e-dcbdd0d33fb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:35.853790 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddbef9-451f-4600-982e-dcbdd0d33fb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:35.855478 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddbef9-451f-4600-982e-dcbdd0d33fb6 service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:35.878536 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1423/2841] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:35 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:01:41.240920 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aebb9d-6a7e-4350-bd8a-2a67606c7970 service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:41.305716 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aebb9d-6a7e-4350-bd8a-2a67606c7970 service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:41.310287 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865e52c-ebb6-4b35-86d9-3fdc26508ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:41.311152 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865e52c-ebb6-4b35-86d9-3fdc26508ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:41.311441 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865e52c-ebb6-4b35-86d9-3fdc26508ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:41.311748 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865e52c-ebb6-4b35-86d9-3fdc26508ba7 admin admin] PATH_INFO: `/v3/users/7932d5acc3d04e44b3de6fb4d7004ced` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:41.312921 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865e52c-ebb6-4b35-86d9-3fdc26508ba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7932d5acc3d04e44b3de6fb4d7004ced)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:41.314958 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865e52c-ebb6-4b35-86d9-3fdc26508ba7 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:41.363112 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-1865e52c-ebb6-4b35-86d9-3fdc26508ba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7932d5acc3d04e44b3de6fb4d7004ced'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:41.375341 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-1865e52c-ebb6-4b35-86d9-3fdc26508ba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7932d5acc3d04e44b3de6fb4d7004ced'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:41.376026 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-1865e52c-ebb6-4b35-86d9-3fdc26508ba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7932d5acc3d04e44b3de6fb4d7004ced'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:41.376646 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-1865e52c-ebb6-4b35-86d9-3fdc26508ba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7932d5acc3d04e44b3de6fb4d7004ced'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:41.384305 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-1865e52c-ebb6-4b35-86d9-3fdc26508ba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7932d5acc3d04e44b3de6fb4d7004ced'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:41.396492 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1419/2842] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:01:41 2022] DELETE /identity/v3/users/7932d5acc3d04e44b3de6fb4d7004ced => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:41.401035 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79794cd-c2eb-42e6-ae3c-6ce97ac1a239 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:41.401561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79794cd-c2eb-42e6-ae3c-6ce97ac1a239 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:41.401664 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79794cd-c2eb-42e6-ae3c-6ce97ac1a239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:41.419510 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-a79794cd-c2eb-42e6-ae3c-6ce97ac1a239 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:41.420726 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-a79794cd-c2eb-42e6-ae3c-6ce97ac1a239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:41.479920 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1424/2843] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:41.490435 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865e52c-ebb6-4b35-86d9-3fdc26508ba7 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:41.491831 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-1865e52c-ebb6-4b35-86d9-3fdc26508ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:41.545409 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:41.549192 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865e52c-ebb6-4b35-86d9-3fdc26508ba7 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:41.553682 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503c9a9-d83d-4cb2-a032-31f3c114bbce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:41.554380 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503c9a9-d83d-4cb2-a032-31f3c114bbce service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:41.554623 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503c9a9-d83d-4cb2-a032-31f3c114bbce service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:41.554961 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503c9a9-d83d-4cb2-a032-31f3c114bbce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:41.569000 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503c9a9-d83d-4cb2-a032-31f3c114bbce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:41.570411 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503c9a9-d83d-4cb2-a032-31f3c114bbce service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:41.580329 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1420/2844] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:01:41.848218 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79794cd-c2eb-42e6-ae3c-6ce97ac1a239 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:41.849715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-a79794cd-c2eb-42e6-ae3c-6ce97ac1a239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:41.862244 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79794cd-c2eb-42e6-ae3c-6ce97ac1a239 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:41.867491 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd865427-0e14-4049-9b28-ff725a939d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:41.869117 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd865427-0e14-4049-9b28-ff725a939d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:41.869569 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd865427-0e14-4049-9b28-ff725a939d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:41.870033 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd865427-0e14-4049-9b28-ff725a939d25 admin admin] PATH_INFO: `/v3/projects/1219e79b317d43a6bec48a07fcb97835` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:41.872070 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd865427-0e14-4049-9b28-ff725a939d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1219e79b317d43a6bec48a07fcb97835)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:41.874771 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd865427-0e14-4049-9b28-ff725a939d25 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:41.914493 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:41.925178 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cd865427-0e14-4049-9b28-ff725a939d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1219e79b317d43a6bec48a07fcb97835', 'request_id': 'req-cd865427-0e14-4049-9b28-ff725a939d25'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:41.931515 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cd865427-0e14-4049-9b28-ff725a939d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1219e79b317d43a6bec48a07fcb97835', 'request_id': 'req-cd865427-0e14-4049-9b28-ff725a939d25'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:41.939551 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cd865427-0e14-4049-9b28-ff725a939d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1219e79b317d43a6bec48a07fcb97835', 'request_id': 'req-cd865427-0e14-4049-9b28-ff725a939d25'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:41.951168 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cd865427-0e14-4049-9b28-ff725a939d25 admin admin] The token cache is being invalidate because project 1219e79b317d43a6bec48a07fcb97835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:01:41.951579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cd865427-0e14-4049-9b28-ff725a939d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:41.952217 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-cd865427-0e14-4049-9b28-ff725a939d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:41.954090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1425/2845] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:01:41 2022] DELETE /identity/v3/projects/1219e79b317d43a6bec48a07fcb97835 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:01:41.958081 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503c9a9-d83d-4cb2-a032-31f3c114bbce service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:41.967859 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503c9a9-d83d-4cb2-a032-31f3c114bbce service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:42.025951 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4e5f0-199a-45ef-8e80-ba6533a58b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:42.026822 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4e5f0-199a-45ef-8e80-ba6533a58b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:42.027141 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4e5f0-199a-45ef-8e80-ba6533a58b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:42.027424 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4e5f0-199a-45ef-8e80-ba6533a58b2b admin admin] PATH_INFO: `/v3/users/27c8457dc8f84e86ae24e86f73bea545` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:42.028608 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4e5f0-199a-45ef-8e80-ba6533a58b2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c8457dc8f84e86ae24e86f73bea545)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:42.030558 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4e5f0-199a-45ef-8e80-ba6533a58b2b admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:42.077084 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f5e4e5f0-199a-45ef-8e80-ba6533a58b2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c8457dc8f84e86ae24e86f73bea545'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:42.090431 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f5e4e5f0-199a-45ef-8e80-ba6533a58b2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c8457dc8f84e86ae24e86f73bea545'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:42.091188 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f5e4e5f0-199a-45ef-8e80-ba6533a58b2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c8457dc8f84e86ae24e86f73bea545'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:42.091732 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f5e4e5f0-199a-45ef-8e80-ba6533a58b2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c8457dc8f84e86ae24e86f73bea545'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:42.099834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f5e4e5f0-199a-45ef-8e80-ba6533a58b2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c8457dc8f84e86ae24e86f73bea545'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:42.112014 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1421/2846] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:01:41 2022] DELETE /identity/v3/users/27c8457dc8f84e86ae24e86f73bea545 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:42.391149 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd865427-0e14-4049-9b28-ff725a939d25 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:42.392685 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-cd865427-0e14-4049-9b28-ff725a939d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:42.406639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd865427-0e14-4049-9b28-ff725a939d25 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:42.464487 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309add7-3325-4c4d-81c5-423e0acf63f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:42.465407 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309add7-3325-4c4d-81c5-423e0acf63f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:42.465691 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309add7-3325-4c4d-81c5-423e0acf63f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:42.465970 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309add7-3325-4c4d-81c5-423e0acf63f3 admin admin] PATH_INFO: `/v3/projects/340fe69d7ba44c35b12dcee014fb6f34` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:42.467163 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309add7-3325-4c4d-81c5-423e0acf63f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=340fe69d7ba44c35b12dcee014fb6f34)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:42.469082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309add7-3325-4c4d-81c5-423e0acf63f3 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:42.514930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0309add7-3325-4c4d-81c5-423e0acf63f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '340fe69d7ba44c35b12dcee014fb6f34', 'request_id': 'req-0309add7-3325-4c4d-81c5-423e0acf63f3'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:42.520869 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0309add7-3325-4c4d-81c5-423e0acf63f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '340fe69d7ba44c35b12dcee014fb6f34', 'request_id': 'req-0309add7-3325-4c4d-81c5-423e0acf63f3'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:42.528243 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0309add7-3325-4c4d-81c5-423e0acf63f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '340fe69d7ba44c35b12dcee014fb6f34', 'request_id': 'req-0309add7-3325-4c4d-81c5-423e0acf63f3'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:42.539042 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0309add7-3325-4c4d-81c5-423e0acf63f3 admin admin] The token cache is being invalidate because project 340fe69d7ba44c35b12dcee014fb6f34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:01:42.539332 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0309add7-3325-4c4d-81c5-423e0acf63f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:42.539960 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-0309add7-3325-4c4d-81c5-423e0acf63f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:42.541561 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1426/2847] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:01:42 2022] DELETE /identity/v3/projects/340fe69d7ba44c35b12dcee014fb6f34 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:42.546996 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30b241-8e88-4f2d-aac7-b7a84943a6e5 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:42.547467 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30b241-8e88-4f2d-aac7-b7a84943a6e5 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:42.547577 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30b241-8e88-4f2d-aac7-b7a84943a6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:42.566017 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-5c30b241-8e88-4f2d-aac7-b7a84943a6e5 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:42.567205 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-5c30b241-8e88-4f2d-aac7-b7a84943a6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:42.627022 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1422/2848] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:42.634943 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08dd10-33a8-46fb-be94-ceab33a8c1fd None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:42.635304 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08dd10-33a8-46fb-be94-ceab33a8c1fd None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:42.635601 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08dd10-33a8-46fb-be94-ceab33a8c1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:42.654111 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-4f08dd10-33a8-46fb-be94-ceab33a8c1fd None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:42.655302 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-4f08dd10-33a8-46fb-be94-ceab33a8c1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:42.663011 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1427/2849] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:42.667243 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30b241-8e88-4f2d-aac7-b7a84943a6e5 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:42.678155 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30b241-8e88-4f2d-aac7-b7a84943a6e5 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:42.685384 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0996805-0283-48c9-90b0-d88adf55147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:42.686038 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0996805-0283-48c9-90b0-d88adf55147a admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:42.686318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0996805-0283-48c9-90b0-d88adf55147a admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:42.686593 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0996805-0283-48c9-90b0-d88adf55147a admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:42.687301 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0996805-0283-48c9-90b0-d88adf55147a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:01:42.687605 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0996805-0283-48c9-90b0-d88adf55147a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:42.689195 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0996805-0283-48c9-90b0-d88adf55147a admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:42.696249 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:42.705301 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1423/2850] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:01:42.707049 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08dd10-33a8-46fb-be94-ceab33a8c1fd None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:42.716790 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08dd10-33a8-46fb-be94-ceab33a8c1fd None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:42.721428 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f1928-6869-4218-8cff-ee2abd5b1b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:42.722069 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f1928-6869-4218-8cff-ee2abd5b1b9d admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:42.722351 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f1928-6869-4218-8cff-ee2abd5b1b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:42.722627 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f1928-6869-4218-8cff-ee2abd5b1b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:42.723318 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f1928-6869-4218-8cff-ee2abd5b1b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:42.725175 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f1928-6869-4218-8cff-ee2abd5b1b9d admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:42.751715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1428/2851] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:01:42 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:42.755681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0996805-0283-48c9-90b0-d88adf55147a admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:42.766025 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0996805-0283-48c9-90b0-d88adf55147a admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:42.823450 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba03f33-4e56-4c16-a07a-c6b68fa65fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:42.824150 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba03f33-4e56-4c16-a07a-c6b68fa65fce admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:42.824439 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba03f33-4e56-4c16-a07a-c6b68fa65fce admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:42.824718 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba03f33-4e56-4c16-a07a-c6b68fa65fce admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:42.825436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba03f33-4e56-4c16-a07a-c6b68fa65fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:42.827343 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba03f33-4e56-4c16-a07a-c6b68fa65fce admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:42.847006 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1424/2852] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:01:42 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:42.851154 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f1928-6869-4218-8cff-ee2abd5b1b9d admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:42.862107 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f1928-6869-4218-8cff-ee2abd5b1b9d admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:42.866944 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40c50b-94bf-4550-8623-e817340b1cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:42.867592 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40c50b-94bf-4550-8623-e817340b1cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:42.867876 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40c50b-94bf-4550-8623-e817340b1cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:42.868154 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40c50b-94bf-4550-8623-e817340b1cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:42.868869 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40c50b-94bf-4550-8623-e817340b1cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:42.870483 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40c50b-94bf-4550-8623-e817340b1cb3 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:42.880942 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1429/2853] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:42.884681 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba03f33-4e56-4c16-a07a-c6b68fa65fce admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:42.894590 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba03f33-4e56-4c16-a07a-c6b68fa65fce admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:42.899364 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a792e-80ac-4576-8531-2eab25b1915e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:42.900052 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a792e-80ac-4576-8531-2eab25b1915e admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:42.900362 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a792e-80ac-4576-8531-2eab25b1915e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:42.900638 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a792e-80ac-4576-8531-2eab25b1915e admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:42.901500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a792e-80ac-4576-8531-2eab25b1915e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:42.903602 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a792e-80ac-4576-8531-2eab25b1915e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:42.913401 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1425/2854] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:42.917464 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40c50b-94bf-4550-8623-e817340b1cb3 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:42.927872 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40c50b-94bf-4550-8623-e817340b1cb3 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:42.932442 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa4885-ccad-43dd-ab1f-fb0d74945d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:42.933333 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa4885-ccad-43dd-ab1f-fb0d74945d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:42.933619 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa4885-ccad-43dd-ab1f-fb0d74945d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:42.933895 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa4885-ccad-43dd-ab1f-fb0d74945d08 admin admin] PATH_INFO: `/v3/projects/4661b152c06642ada25e54301305a578/users/36c7879fef3d4bb3916a4376b5a818f9/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:42.945407 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:42.948886 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa4885-ccad-43dd-ab1f-fb0d74945d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4661b152c06642ada25e54301305a578, user_id=36c7879fef3d4bb3916a4376b5a818f9, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:42.951724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa4885-ccad-43dd-ab1f-fb0d74945d08 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:42.965684 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1430/2855] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:01:42 2022] PUT /identity/v3/projects/4661b152c06642ada25e54301305a578/users/36c7879fef3d4bb3916a4376b5a818f9/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:42.975867 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aadd8-d443-479d-a163-b07d21328e7e None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:42.976166 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aadd8-d443-479d-a163-b07d21328e7e None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:42.976477 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aadd8-d443-479d-a163-b07d21328e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:43.003585 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-ad0aadd8-d443-479d-a163-b07d21328e7e None None] MFA Rules not processed for user `36c7879fef3d4bb3916a4376b5a818f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:43.004814 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ad0aadd8-d443-479d-a163-b07d21328e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:43.065882 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1426/2856] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:43.070337 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa4885-ccad-43dd-ab1f-fb0d74945d08 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:43.131658 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa4885-ccad-43dd-ab1f-fb0d74945d08 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:43.136219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967bfd2-65cc-4481-9ff2-e51348a24b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:43.137468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967bfd2-65cc-4481-9ff2-e51348a24b4d admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:43.137749 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967bfd2-65cc-4481-9ff2-e51348a24b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:43.138024 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967bfd2-65cc-4481-9ff2-e51348a24b4d admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:43.138710 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967bfd2-65cc-4481-9ff2-e51348a24b4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:43.140601 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967bfd2-65cc-4481-9ff2-e51348a24b4d admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:43.165553 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1431/2857] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:01:43 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:43.169530 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aadd8-d443-479d-a163-b07d21328e7e None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:43.180393 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aadd8-d443-479d-a163-b07d21328e7e None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:43.235650 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1165397-ecf7-4634-a8ca-aef06e48cfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:43.236313 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1165397-ecf7-4634-a8ca-aef06e48cfa0 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:43.236615 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1165397-ecf7-4634-a8ca-aef06e48cfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:43.236881 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1165397-ecf7-4634-a8ca-aef06e48cfa0 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:43.237588 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1165397-ecf7-4634-a8ca-aef06e48cfa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:43.239500 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1165397-ecf7-4634-a8ca-aef06e48cfa0 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:43.249090 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:43.261179 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1427/2858] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:01:43 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:43.265655 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967bfd2-65cc-4481-9ff2-e51348a24b4d admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:43.275711 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967bfd2-65cc-4481-9ff2-e51348a24b4d admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:43.281009 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f34acc-8b87-4e87-b615-080e4fca430c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:43.281689 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f34acc-8b87-4e87-b615-080e4fca430c admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:43.281969 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f34acc-8b87-4e87-b615-080e4fca430c admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:43.282244 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f34acc-8b87-4e87-b615-080e4fca430c admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:43.282982 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f34acc-8b87-4e87-b615-080e4fca430c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:43.284552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f34acc-8b87-4e87-b615-080e4fca430c admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:43.294895 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1432/2859] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:43.298593 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1165397-ecf7-4634-a8ca-aef06e48cfa0 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:43.308415 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1165397-ecf7-4634-a8ca-aef06e48cfa0 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:43.313223 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f289f62-c01c-4efa-abd1-c21f4ca7764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:43.313906 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f289f62-c01c-4efa-abd1-c21f4ca7764e admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:43.314192 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f289f62-c01c-4efa-abd1-c21f4ca7764e admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:43.314470 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f289f62-c01c-4efa-abd1-c21f4ca7764e admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:43.315187 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f289f62-c01c-4efa-abd1-c21f4ca7764e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:43.316772 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f289f62-c01c-4efa-abd1-c21f4ca7764e admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:43.327164 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1428/2860] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:43.331096 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f34acc-8b87-4e87-b615-080e4fca430c admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:43.341477 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f34acc-8b87-4e87-b615-080e4fca430c admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:43.346048 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53541f-2fdd-47a7-90ed-9c7eaa81a019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:43.347374 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53541f-2fdd-47a7-90ed-9c7eaa81a019 admin admin] REQUEST_METHOD: `PUT` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:43.347895 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53541f-2fdd-47a7-90ed-9c7eaa81a019 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:43.348398 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53541f-2fdd-47a7-90ed-9c7eaa81a019 admin admin] PATH_INFO: `/v3/projects/61d589df9e784a3f827183a2ae7b9990/users/5a7adb839d7e4e58bd07b41386274ee4/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:43.366170 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53541f-2fdd-47a7-90ed-9c7eaa81a019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d589df9e784a3f827183a2ae7b9990, user_id=5a7adb839d7e4e58bd07b41386274ee4, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:43.368811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53541f-2fdd-47a7-90ed-9c7eaa81a019 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:43.386444 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1433/2861] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:01:43 2022] PUT /identity/v3/projects/61d589df9e784a3f827183a2ae7b9990/users/5a7adb839d7e4e58bd07b41386274ee4/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:43.401007 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186e0a2-5511-440c-b2a9-9d95e5b5d34b None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:43.401704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186e0a2-5511-440c-b2a9-9d95e5b5d34b None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:43.401704 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186e0a2-5511-440c-b2a9-9d95e5b5d34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:43.431514 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-6186e0a2-5511-440c-b2a9-9d95e5b5d34b None None] MFA Rules not processed for user `5a7adb839d7e4e58bd07b41386274ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:43.432757 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-6186e0a2-5511-440c-b2a9-9d95e5b5d34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:43.497620 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1429/2862] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:43.502113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53541f-2fdd-47a7-90ed-9c7eaa81a019 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:43.561779 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53541f-2fdd-47a7-90ed-9c7eaa81a019 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:43.566377 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e08aff-3746-44d7-924e-6dad7886abb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:43.567022 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e08aff-3746-44d7-924e-6dad7886abb0 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:43.567306 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e08aff-3746-44d7-924e-6dad7886abb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:43.567590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e08aff-3746-44d7-924e-6dad7886abb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:43.568266 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e08aff-3746-44d7-924e-6dad7886abb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:43.570167 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e08aff-3746-44d7-924e-6dad7886abb0 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:43.595079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1434/2863] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:01:43 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:43.599235 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186e0a2-5511-440c-b2a9-9d95e5b5d34b None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:43.609918 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186e0a2-5511-440c-b2a9-9d95e5b5d34b None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:43.665773 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088e9e6-60d0-445b-9b50-40888d7c74a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:43.666370 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088e9e6-60d0-445b-9b50-40888d7c74a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:43.666655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088e9e6-60d0-445b-9b50-40888d7c74a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:43.666930 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088e9e6-60d0-445b-9b50-40888d7c74a4 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:43.667611 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088e9e6-60d0-445b-9b50-40888d7c74a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:43.669559 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088e9e6-60d0-445b-9b50-40888d7c74a4 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:43.690180 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1430/2864] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:01:43 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:43.694096 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e08aff-3746-44d7-924e-6dad7886abb0 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:43.704831 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e08aff-3746-44d7-924e-6dad7886abb0 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:43.709345 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada260bf-fa2f-46b4-b8d1-ebd05deada45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:43.709992 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada260bf-fa2f-46b4-b8d1-ebd05deada45 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:43.710268 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada260bf-fa2f-46b4-b8d1-ebd05deada45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:43.710539 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada260bf-fa2f-46b4-b8d1-ebd05deada45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:43.711251 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada260bf-fa2f-46b4-b8d1-ebd05deada45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:43.712806 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada260bf-fa2f-46b4-b8d1-ebd05deada45 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:43.723124 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1435/2865] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:43.727141 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088e9e6-60d0-445b-9b50-40888d7c74a4 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:43.737809 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088e9e6-60d0-445b-9b50-40888d7c74a4 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:43.742620 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f5dbd-d91f-4616-939f-37a2aae40745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:43.743488 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f5dbd-d91f-4616-939f-37a2aae40745 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:43.743772 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f5dbd-d91f-4616-939f-37a2aae40745 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:43.744051 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f5dbd-d91f-4616-939f-37a2aae40745 admin admin] PATH_INFO: `/v3/projects/ea9eeabff05c4516a9e07e453043b04b/users/e675783f183a4c08ae314016828264f6/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:43.759102 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f5dbd-d91f-4616-939f-37a2aae40745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9eeabff05c4516a9e07e453043b04b, user_id=e675783f183a4c08ae314016828264f6, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:43.761890 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f5dbd-d91f-4616-939f-37a2aae40745 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:43.774578 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1431/2866] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:01:43 2022] PUT /identity/v3/projects/ea9eeabff05c4516a9e07e453043b04b/users/e675783f183a4c08ae314016828264f6/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:43.778533 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada260bf-fa2f-46b4-b8d1-ebd05deada45 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:43.788473 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada260bf-fa2f-46b4-b8d1-ebd05deada45 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:43.800491 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:43.845308 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb725b2-6f33-4275-a555-1e7ad1073f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:43.845964 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb725b2-6f33-4275-a555-1e7ad1073f19 admin admin] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:43.846276 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb725b2-6f33-4275-a555-1e7ad1073f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:43.846554 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb725b2-6f33-4275-a555-1e7ad1073f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:43.847269 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb725b2-6f33-4275-a555-1e7ad1073f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:43.848828 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb725b2-6f33-4275-a555-1e7ad1073f19 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:43.858875 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1436/2867] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:43.863021 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f5dbd-d91f-4616-939f-37a2aae40745 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:43.874668 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f5dbd-d91f-4616-939f-37a2aae40745 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:43.879678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c71347-5d4c-4f82-a4b2-9d9d88f17592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:43.880583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c71347-5d4c-4f82-a4b2-9d9d88f17592 admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:43.880868 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c71347-5d4c-4f82-a4b2-9d9d88f17592 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:43.881147 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c71347-5d4c-4f82-a4b2-9d9d88f17592 admin admin] PATH_INFO: `/v3/projects/ea9eeabff05c4516a9e07e453043b04b/users/e675783f183a4c08ae314016828264f6/roles/e6dbcc7e1ea84b1fa478cff5d02d0344` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:43.883151 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c71347-5d4c-4f82-a4b2-9d9d88f17592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9eeabff05c4516a9e07e453043b04b, user_id=e675783f183a4c08ae314016828264f6, role_id=e6dbcc7e1ea84b1fa478cff5d02d0344)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:43.885824 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c71347-5d4c-4f82-a4b2-9d9d88f17592 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:43.895843 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1432/2868] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:01:43 2022] PUT /identity/v3/projects/ea9eeabff05c4516a9e07e453043b04b/users/e675783f183a4c08ae314016828264f6/roles/e6dbcc7e1ea84b1fa478cff5d02d0344 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:43.906430 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8caab-6740-4a21-8e26-9c2703fa1e8d None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:43.906721 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8caab-6740-4a21-8e26-9c2703fa1e8d None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:43.907001 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8caab-6740-4a21-8e26-9c2703fa1e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:43.932845 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-76f8caab-6740-4a21-8e26-9c2703fa1e8d None None] MFA Rules not processed for user `e675783f183a4c08ae314016828264f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:43.934623 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-76f8caab-6740-4a21-8e26-9c2703fa1e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:44.000611 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1437/2869] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:44.011834 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c71347-5d4c-4f82-a4b2-9d9d88f17592 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:44.013583 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f4c71347-5d4c-4f82-a4b2-9d9d88f17592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:44.043898 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:44.072643 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c71347-5d4c-4f82-a4b2-9d9d88f17592 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:44.076338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87897869-d760-45c3-a6a2-aac072ca1cb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:44.076969 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87897869-d760-45c3-a6a2-aac072ca1cb9 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:44.077255 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87897869-d760-45c3-a6a2-aac072ca1cb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:44.077565 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87897869-d760-45c3-a6a2-aac072ca1cb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:44.133117 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87897869-d760-45c3-a6a2-aac072ca1cb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:44.134593 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87897869-d760-45c3-a6a2-aac072ca1cb9 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:44.143338 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1433/2870] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:01:45.625202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8caab-6740-4a21-8e26-9c2703fa1e8d None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:45.626752 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-76f8caab-6740-4a21-8e26-9c2703fa1e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:45.639729 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8caab-6740-4a21-8e26-9c2703fa1e8d None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:45.643870 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26383ae9-9a0c-471f-833c-7a12ae6aeb83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:45.644523 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26383ae9-9a0c-471f-833c-7a12ae6aeb83 service cinder] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:45.644931 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26383ae9-9a0c-471f-833c-7a12ae6aeb83 service cinder] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:45.645130 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26383ae9-9a0c-471f-833c-7a12ae6aeb83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:45.709770 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26383ae9-9a0c-471f-833c-7a12ae6aeb83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:45.711193 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26383ae9-9a0c-471f-833c-7a12ae6aeb83 service cinder] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:45.720159 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1438/2871] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:01:46.266434 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87897869-d760-45c3-a6a2-aac072ca1cb9 service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:46.275008 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87897869-d760-45c3-a6a2-aac072ca1cb9 service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:46.278651 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349d911-2a5c-45c8-84db-afa40a583a61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:46.279283 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349d911-2a5c-45c8-84db-afa40a583a61 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:46.279584 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349d911-2a5c-45c8-84db-afa40a583a61 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:46.279847 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349d911-2a5c-45c8-84db-afa40a583a61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:46.289103 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349d911-2a5c-45c8-84db-afa40a583a61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:46.290596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349d911-2a5c-45c8-84db-afa40a583a61 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:46.300536 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1434/2872] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:01:50.126491 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26383ae9-9a0c-471f-833c-7a12ae6aeb83 service cinder] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:50.164372 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=100 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:50.188633 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26383ae9-9a0c-471f-833c-7a12ae6aeb83 service cinder] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:50.193064 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60b661-e750-4499-af0a-2bd32f9a875d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:50.193947 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60b661-e750-4499-af0a-2bd32f9a875d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:50.194227 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60b661-e750-4499-af0a-2bd32f9a875d admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:50.194494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60b661-e750-4499-af0a-2bd32f9a875d admin admin] PATH_INFO: `/v3/users/36c7879fef3d4bb3916a4376b5a818f9` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:50.195651 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60b661-e750-4499-af0a-2bd32f9a875d admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c7879fef3d4bb3916a4376b5a818f9)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:50.197579 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60b661-e750-4499-af0a-2bd32f9a875d admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:50.242784 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ab60b661-e750-4499-af0a-2bd32f9a875d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c7879fef3d4bb3916a4376b5a818f9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:50.243480 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ab60b661-e750-4499-af0a-2bd32f9a875d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c7879fef3d4bb3916a4376b5a818f9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:50.244079 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ab60b661-e750-4499-af0a-2bd32f9a875d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c7879fef3d4bb3916a4376b5a818f9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:50.251358 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ab60b661-e750-4499-af0a-2bd32f9a875d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c7879fef3d4bb3916a4376b5a818f9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:50.258334 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ab60b661-e750-4499-af0a-2bd32f9a875d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c7879fef3d4bb3916a4376b5a818f9'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:50.275419 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1439/2873] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:01:50 2022] DELETE /identity/v3/users/36c7879fef3d4bb3916a4376b5a818f9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:50.279929 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74555d9-9692-439a-969e-264e245fe9b0 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:50.280514 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74555d9-9692-439a-969e-264e245fe9b0 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:50.280514 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74555d9-9692-439a-969e-264e245fe9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:50.300776 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-d74555d9-9692-439a-969e-264e245fe9b0 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:50.302028 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-d74555d9-9692-439a-969e-264e245fe9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:50.359603 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1435/2874] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:50.369469 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60b661-e750-4499-af0a-2bd32f9a875d admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:50.370888 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ab60b661-e750-4499-af0a-2bd32f9a875d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:50.431187 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60b661-e750-4499-af0a-2bd32f9a875d admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:50.435437 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226e67e-36a5-4ff2-b1c8-4ad523e87159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:50.436065 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226e67e-36a5-4ff2-b1c8-4ad523e87159 service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:50.436371 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226e67e-36a5-4ff2-b1c8-4ad523e87159 service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:50.436646 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226e67e-36a5-4ff2-b1c8-4ad523e87159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:50.445653 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226e67e-36a5-4ff2-b1c8-4ad523e87159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:50.447114 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226e67e-36a5-4ff2-b1c8-4ad523e87159 service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:50.456741 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1440/2875] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 14:01:50.491134 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74555d9-9692-439a-969e-264e245fe9b0 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:50.492523 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-d74555d9-9692-439a-969e-264e245fe9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:50.504919 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74555d9-9692-439a-969e-264e245fe9b0 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:50.509810 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23615f5-8e6f-4940-8941-31c5e1098c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:50.510705 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23615f5-8e6f-4940-8941-31c5e1098c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:50.510987 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23615f5-8e6f-4940-8941-31c5e1098c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:50.511264 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23615f5-8e6f-4940-8941-31c5e1098c4f admin admin] PATH_INFO: `/v3/users/95c2fc4f457e43b1a137e021270da5b2` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:50.512488 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23615f5-8e6f-4940-8941-31c5e1098c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=95c2fc4f457e43b1a137e021270da5b2)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:50.514436 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23615f5-8e6f-4940-8941-31c5e1098c4f admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:50.561735 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f23615f5-8e6f-4940-8941-31c5e1098c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95c2fc4f457e43b1a137e021270da5b2'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:50.573173 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:50.574771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f23615f5-8e6f-4940-8941-31c5e1098c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95c2fc4f457e43b1a137e021270da5b2'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:50.575497 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f23615f5-8e6f-4940-8941-31c5e1098c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95c2fc4f457e43b1a137e021270da5b2'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:50.576459 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f23615f5-8e6f-4940-8941-31c5e1098c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95c2fc4f457e43b1a137e021270da5b2'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:50.586572 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f23615f5-8e6f-4940-8941-31c5e1098c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95c2fc4f457e43b1a137e021270da5b2'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:50.608824 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1436/2876] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:01:50 2022] DELETE /identity/v3/users/95c2fc4f457e43b1a137e021270da5b2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:50.613474 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717947a6-31d5-48cc-9ebd-f8414f21f467 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:50.613811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717947a6-31d5-48cc-9ebd-f8414f21f467 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:50.614172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717947a6-31d5-48cc-9ebd-f8414f21f467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:50.631872 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-717947a6-31d5-48cc-9ebd-f8414f21f467 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:50.633127 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-717947a6-31d5-48cc-9ebd-f8414f21f467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:50.692682 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:50.705018 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1441/2877] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:50.716073 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23615f5-8e6f-4940-8941-31c5e1098c4f admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:50.717634 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f23615f5-8e6f-4940-8941-31c5e1098c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:50.731865 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717947a6-31d5-48cc-9ebd-f8414f21f467 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:50.735061 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-717947a6-31d5-48cc-9ebd-f8414f21f467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:50.757757 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717947a6-31d5-48cc-9ebd-f8414f21f467 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:50.764496 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f58374-d305-47b3-b692-0e3a8a515264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:50.765404 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f58374-d305-47b3-b692-0e3a8a515264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:50.765729 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f58374-d305-47b3-b692-0e3a8a515264 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:50.765971 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f58374-d305-47b3-b692-0e3a8a515264 admin admin] PATH_INFO: `/v3/projects/4661b152c06642ada25e54301305a578` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:50.767156 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f58374-d305-47b3-b692-0e3a8a515264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4661b152c06642ada25e54301305a578)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:50.769113 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f58374-d305-47b3-b692-0e3a8a515264 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:50.782668 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23615f5-8e6f-4940-8941-31c5e1098c4f admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:50.786359 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743ce7c-fac9-4fd6-a6fb-95bf633c2d08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:50.786991 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743ce7c-fac9-4fd6-a6fb-95bf633c2d08 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:50.787269 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743ce7c-fac9-4fd6-a6fb-95bf633c2d08 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:50.787543 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743ce7c-fac9-4fd6-a6fb-95bf633c2d08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:50.797335 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743ce7c-fac9-4fd6-a6fb-95bf633c2d08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:50.798770 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743ce7c-fac9-4fd6-a6fb-95bf633c2d08 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:50.808446 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1437/2878] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:01:50.819213 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d9f58374-d305-47b3-b692-0e3a8a515264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4661b152c06642ada25e54301305a578', 'request_id': 'req-d9f58374-d305-47b3-b692-0e3a8a515264'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:50.825494 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d9f58374-d305-47b3-b692-0e3a8a515264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4661b152c06642ada25e54301305a578', 'request_id': 'req-d9f58374-d305-47b3-b692-0e3a8a515264'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:50.834793 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d9f58374-d305-47b3-b692-0e3a8a515264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4661b152c06642ada25e54301305a578', 'request_id': 'req-d9f58374-d305-47b3-b692-0e3a8a515264'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:50.847660 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d9f58374-d305-47b3-b692-0e3a8a515264 admin admin] The token cache is being invalidate because project 4661b152c06642ada25e54301305a578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:01:50.847958 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d9f58374-d305-47b3-b692-0e3a8a515264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:50.848621 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d9f58374-d305-47b3-b692-0e3a8a515264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:50.850223 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1442/2879] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:01:50 2022] DELETE /identity/v3/projects/4661b152c06642ada25e54301305a578 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:50.854183 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743ce7c-fac9-4fd6-a6fb-95bf633c2d08 service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:50.864711 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743ce7c-fac9-4fd6-a6fb-95bf633c2d08 service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:50.926421 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd6765-fa66-466e-bdb5-7cac498869c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:50.927295 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd6765-fa66-466e-bdb5-7cac498869c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:50.927575 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd6765-fa66-466e-bdb5-7cac498869c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:50.927847 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd6765-fa66-466e-bdb5-7cac498869c1 admin admin] PATH_INFO: `/v3/users/5a7adb839d7e4e58bd07b41386274ee4` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:50.929058 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd6765-fa66-466e-bdb5-7cac498869c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a7adb839d7e4e58bd07b41386274ee4)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:50.930997 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd6765-fa66-466e-bdb5-7cac498869c1 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:50.983107 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-35dd6765-fa66-466e-bdb5-7cac498869c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a7adb839d7e4e58bd07b41386274ee4'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:50.995650 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-35dd6765-fa66-466e-bdb5-7cac498869c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a7adb839d7e4e58bd07b41386274ee4'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:50.996438 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-35dd6765-fa66-466e-bdb5-7cac498869c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a7adb839d7e4e58bd07b41386274ee4'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:50.997124 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-35dd6765-fa66-466e-bdb5-7cac498869c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a7adb839d7e4e58bd07b41386274ee4'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:51.004771 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-35dd6765-fa66-466e-bdb5-7cac498869c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a7adb839d7e4e58bd07b41386274ee4'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:51.017893 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1438/2880] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:01:50 2022] DELETE /identity/v3/users/5a7adb839d7e4e58bd07b41386274ee4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:51.093180 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f58374-d305-47b3-b692-0e3a8a515264 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:51.094850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d9f58374-d305-47b3-b692-0e3a8a515264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:51.108096 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f58374-d305-47b3-b692-0e3a8a515264 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:51.170133 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed7401-ddf6-44d9-8350-5cb0afba0497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:51.171004 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed7401-ddf6-44d9-8350-5cb0afba0497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:51.171283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed7401-ddf6-44d9-8350-5cb0afba0497 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:51.171556 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed7401-ddf6-44d9-8350-5cb0afba0497 admin admin] PATH_INFO: `/v3/projects/ad66afc9e0d64f27a7d9d0e94910801d` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:51.172769 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed7401-ddf6-44d9-8350-5cb0afba0497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad66afc9e0d64f27a7d9d0e94910801d)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:51.174811 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed7401-ddf6-44d9-8350-5cb0afba0497 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:51.225105 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6bed7401-ddf6-44d9-8350-5cb0afba0497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad66afc9e0d64f27a7d9d0e94910801d', 'request_id': 'req-6bed7401-ddf6-44d9-8350-5cb0afba0497'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:51.231634 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6bed7401-ddf6-44d9-8350-5cb0afba0497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad66afc9e0d64f27a7d9d0e94910801d', 'request_id': 'req-6bed7401-ddf6-44d9-8350-5cb0afba0497'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:51.240536 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6bed7401-ddf6-44d9-8350-5cb0afba0497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad66afc9e0d64f27a7d9d0e94910801d', 'request_id': 'req-6bed7401-ddf6-44d9-8350-5cb0afba0497'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:51.251669 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6bed7401-ddf6-44d9-8350-5cb0afba0497 admin admin] The token cache is being invalidate because project ad66afc9e0d64f27a7d9d0e94910801d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:01:51.251961 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6bed7401-ddf6-44d9-8350-5cb0afba0497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:51.252617 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-6bed7401-ddf6-44d9-8350-5cb0afba0497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:51.254202 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1443/2881] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:01:51 2022] DELETE /identity/v3/projects/ad66afc9e0d64f27a7d9d0e94910801d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:51.259141 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0cafe-5de2-41fc-89e8-39b8b42923bc None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:51.259460 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0cafe-5de2-41fc-89e8-39b8b42923bc None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:51.259742 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0cafe-5de2-41fc-89e8-39b8b42923bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:51.266892 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:51.282537 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-a0c0cafe-5de2-41fc-89e8-39b8b42923bc None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:51.283769 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-a0c0cafe-5de2-41fc-89e8-39b8b42923bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:51.348978 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1439/2882] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:51.356881 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630d9f0-0d42-4000-b60f-dc65ddf405ea None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:51.357171 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630d9f0-0d42-4000-b60f-dc65ddf405ea None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:51.357476 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630d9f0-0d42-4000-b60f-dc65ddf405ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:51.377313 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-b630d9f0-0d42-4000-b60f-dc65ddf405ea None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:51.378473 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-b630d9f0-0d42-4000-b60f-dc65ddf405ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:51.387457 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1444/2883] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:51.391789 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0cafe-5de2-41fc-89e8-39b8b42923bc None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:51.401572 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0cafe-5de2-41fc-89e8-39b8b42923bc None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:51.406192 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669fb45-3007-4cb5-a36f-d10e69d2d280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:51.406871 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669fb45-3007-4cb5-a36f-d10e69d2d280 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:51.407151 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669fb45-3007-4cb5-a36f-d10e69d2d280 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:51.407424 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669fb45-3007-4cb5-a36f-d10e69d2d280 admin admin] PATH_INFO: `/v3/domains` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:51.408146 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669fb45-3007-4cb5-a36f-d10e69d2d280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:01:51.408453 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669fb45-3007-4cb5-a36f-d10e69d2d280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:51.410101 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669fb45-3007-4cb5-a36f-d10e69d2d280 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:51.422292 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1440/2884] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 14:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:01:51.426585 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630d9f0-0d42-4000-b60f-dc65ddf405ea None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:51.432836 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:51.438037 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630d9f0-0d42-4000-b60f-dc65ddf405ea None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:51.444034 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d5706-18ce-446f-aff2-c637a6bcc7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:51.444712 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d5706-18ce-446f-aff2-c637a6bcc7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:51.445241 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d5706-18ce-446f-aff2-c637a6bcc7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:51.445770 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d5706-18ce-446f-aff2-c637a6bcc7e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:51.446930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d5706-18ce-446f-aff2-c637a6bcc7e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:51.450428 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d5706-18ce-446f-aff2-c637a6bcc7e3 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:51.479373 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1445/2885] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 14:01:51 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:01:51.480572 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669fb45-3007-4cb5-a36f-d10e69d2d280 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:51.491641 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669fb45-3007-4cb5-a36f-d10e69d2d280 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:51.548371 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a4e8b-f195-4355-9fa1-3c71d74bbfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:51.549029 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a4e8b-f195-4355-9fa1-3c71d74bbfb4 admin admin] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:51.549340 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a4e8b-f195-4355-9fa1-3c71d74bbfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:51.549754 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a4e8b-f195-4355-9fa1-3c71d74bbfb4 admin admin] PATH_INFO: `/v3/users` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:51.550737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a4e8b-f195-4355-9fa1-3c71d74bbfb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:51.553486 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a4e8b-f195-4355-9fa1-3c71d74bbfb4 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:51.575596 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d5706-18ce-446f-aff2-c637a6bcc7e3 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:51.576569 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1441/2886] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 14:01:51 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:01:51.580581 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ec4d5706-18ce-446f-aff2-c637a6bcc7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:51.580920 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a4e8b-f195-4355-9fa1-3c71d74bbfb4 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:51.595978 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a4e8b-f195-4355-9fa1-3c71d74bbfb4 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:51.597968 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d5706-18ce-446f-aff2-c637a6bcc7e3 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:51.601315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8162a76-740c-458b-8406-5d00376ea103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:51.602098 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8162a76-740c-458b-8406-5d00376ea103 admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:51.602398 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8162a76-740c-458b-8406-5d00376ea103 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:51.602680 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8162a76-740c-458b-8406-5d00376ea103 admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:51.603415 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909238d-b366-4a5c-a6de-461dd684a291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:51.603541 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8162a76-740c-458b-8406-5d00376ea103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:51.604029 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909238d-b366-4a5c-a6de-461dd684a291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:51.604312 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909238d-b366-4a5c-a6de-461dd684a291 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:51.604588 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909238d-b366-4a5c-a6de-461dd684a291 admin admin] PATH_INFO: `/v3/projects/61d589df9e784a3f827183a2ae7b9990` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:51.605028 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8162a76-740c-458b-8406-5d00376ea103 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:51.605886 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909238d-b366-4a5c-a6de-461dd684a291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d589df9e784a3f827183a2ae7b9990)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:51.607766 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909238d-b366-4a5c-a6de-461dd684a291 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:51.619566 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1442/2887] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:01:51.621875 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8162a76-740c-458b-8406-5d00376ea103 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:51.632760 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8162a76-740c-458b-8406-5d00376ea103 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:51.639053 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8786f8-a7b5-4e02-88e3-2d69b04b23ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:51.639744 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8786f8-a7b5-4e02-88e3-2d69b04b23ce admin admin] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:51.640031 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8786f8-a7b5-4e02-88e3-2d69b04b23ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:51.640315 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8786f8-a7b5-4e02-88e3-2d69b04b23ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:51.641297 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8786f8-a7b5-4e02-88e3-2d69b04b23ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:51.643178 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8786f8-a7b5-4e02-88e3-2d69b04b23ce admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:51.654194 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1443/2888] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 14:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 14:01:51.658111 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8786f8-a7b5-4e02-88e3-2d69b04b23ce admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:51.660695 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d909238d-b366-4a5c-a6de-461dd684a291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d589df9e784a3f827183a2ae7b9990', 'request_id': 'req-d909238d-b366-4a5c-a6de-461dd684a291'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:51.667554 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8786f8-a7b5-4e02-88e3-2d69b04b23ce admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:51.667736 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d909238d-b366-4a5c-a6de-461dd684a291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d589df9e784a3f827183a2ae7b9990', 'request_id': 'req-d909238d-b366-4a5c-a6de-461dd684a291'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:51.677511 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d909238d-b366-4a5c-a6de-461dd684a291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d589df9e784a3f827183a2ae7b9990', 'request_id': 'req-d909238d-b366-4a5c-a6de-461dd684a291'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:51.692697 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d909238d-b366-4a5c-a6de-461dd684a291 admin admin] The token cache is being invalidate because project 61d589df9e784a3f827183a2ae7b9990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:01:51.693096 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d909238d-b366-4a5c-a6de-461dd684a291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:51.693991 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d909238d-b366-4a5c-a6de-461dd684a291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:51.695930 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1446/2889] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:01:51 2022] DELETE /identity/v3/projects/61d589df9e784a3f827183a2ae7b9990 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:01:51.700082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909238d-b366-4a5c-a6de-461dd684a291 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:51.702042 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d909238d-b366-4a5c-a6de-461dd684a291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:51.726314 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:51.733885 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f338e95-1b2a-4168-b620-609de4512c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:51.735018 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f338e95-1b2a-4168-b620-609de4512c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:51.735471 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f338e95-1b2a-4168-b620-609de4512c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:51.735930 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f338e95-1b2a-4168-b620-609de4512c3b admin admin] PATH_INFO: `/v3/projects/6f806b9627a3465a84c258a5efe26576/users/d02236605cc246488fa76e30105630e1/roles/c7b1597b56ba4b88a4e6ac7689dc83fc` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:51.753037 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f338e95-1b2a-4168-b620-609de4512c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f806b9627a3465a84c258a5efe26576, user_id=d02236605cc246488fa76e30105630e1, role_id=c7b1597b56ba4b88a4e6ac7689dc83fc)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:51.755747 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f338e95-1b2a-4168-b620-609de4512c3b admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:51.767865 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909238d-b366-4a5c-a6de-461dd684a291 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:51.769153 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1444/2890] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 14:01:51 2022] PUT /identity/v3/projects/6f806b9627a3465a84c258a5efe26576/users/d02236605cc246488fa76e30105630e1/roles/c7b1597b56ba4b88a4e6ac7689dc83fc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:01:51.779062 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d92477-26a4-42fd-8187-78a3d29dd239 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:51.779375 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d92477-26a4-42fd-8187-78a3d29dd239 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:51.779655 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d92477-26a4-42fd-8187-78a3d29dd239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:51.806936 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-f5d92477-26a4-42fd-8187-78a3d29dd239 None None] MFA Rules not processed for user `d02236605cc246488fa76e30105630e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:51.808294 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f5d92477-26a4-42fd-8187-78a3d29dd239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:51.830489 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6befda-996d-492f-8802-88a57e1188f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:51.831362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6befda-996d-492f-8802-88a57e1188f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:51.831644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6befda-996d-492f-8802-88a57e1188f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:51.831919 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6befda-996d-492f-8802-88a57e1188f3 admin admin] PATH_INFO: `/v3/users/e675783f183a4c08ae314016828264f6` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:51.833445 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6befda-996d-492f-8802-88a57e1188f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e675783f183a4c08ae314016828264f6)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:51.835040 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6befda-996d-492f-8802-88a57e1188f3 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:51.848078 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:51.874686 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1445/2891] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:01:51.883082 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ca6befda-996d-492f-8802-88a57e1188f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e675783f183a4c08ae314016828264f6'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:51.883680 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ca6befda-996d-492f-8802-88a57e1188f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e675783f183a4c08ae314016828264f6'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:51.884302 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ca6befda-996d-492f-8802-88a57e1188f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e675783f183a4c08ae314016828264f6'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:51.885684 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d92477-26a4-42fd-8187-78a3d29dd239 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:51.887161 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f5d92477-26a4-42fd-8187-78a3d29dd239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:51.892556 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ca6befda-996d-492f-8802-88a57e1188f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e675783f183a4c08ae314016828264f6'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:51.900968 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-ca6befda-996d-492f-8802-88a57e1188f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e675783f183a4c08ae314016828264f6'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:51.920279 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1447/2892] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:01:51 2022] DELETE /identity/v3/users/e675783f183a4c08ae314016828264f6 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:01:51.946488 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d92477-26a4-42fd-8187-78a3d29dd239 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:51.997078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0650382-14a9-4b9d-bb53-60190bcbc0f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8aed4c31eb14a3bbba08bef799ee450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:51.997757 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0650382-14a9-4b9d-bb53-60190bcbc0f3 service cinder] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:51.998042 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0650382-14a9-4b9d-bb53-60190bcbc0f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:51.998319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0650382-14a9-4b9d-bb53-60190bcbc0f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:52.000193 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c0650382-14a9-4b9d-bb53-60190bcbc0f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:52.041284 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:52.064909 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0650382-14a9-4b9d-bb53-60190bcbc0f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:52.066418 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0650382-14a9-4b9d-bb53-60190bcbc0f3 service cinder] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:52.076502 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1446/2893] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 14:01:52.101541 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6befda-996d-492f-8802-88a57e1188f3 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:52.103108 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-ca6befda-996d-492f-8802-88a57e1188f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:52.168821 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6befda-996d-492f-8802-88a57e1188f3 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:52.173516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb331f-e729-42b2-b26a-026ae91ba742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:52.174467 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb331f-e729-42b2-b26a-026ae91ba742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:52.174754 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb331f-e729-42b2-b26a-026ae91ba742 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:52.175032 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb331f-e729-42b2-b26a-026ae91ba742 admin admin] PATH_INFO: `/v3/users/d02236605cc246488fa76e30105630e1` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:52.176262 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb331f-e729-42b2-b26a-026ae91ba742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d02236605cc246488fa76e30105630e1)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:52.178199 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb331f-e729-42b2-b26a-026ae91ba742 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:52.186758 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0650382-14a9-4b9d-bb53-60190bcbc0f3 service cinder] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:52.188248 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-c0650382-14a9-4b9d-bb53-60190bcbc0f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:52.207596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0650382-14a9-4b9d-bb53-60190bcbc0f3 service cinder] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:52.214049 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6ea98-005c-43e5-a90a-5b2ae8bf21d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:52.215661 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6ea98-005c-43e5-a90a-5b2ae8bf21d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:52.216044 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6ea98-005c-43e5-a90a-5b2ae8bf21d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:52.216535 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6ea98-005c-43e5-a90a-5b2ae8bf21d0 admin admin] PATH_INFO: `/v3/projects/ea9eeabff05c4516a9e07e453043b04b` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:52.217943 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6ea98-005c-43e5-a90a-5b2ae8bf21d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9eeabff05c4516a9e07e453043b04b)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:52.220202 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6ea98-005c-43e5-a90a-5b2ae8bf21d0 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:52.235595 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-2bdb331f-e729-42b2-b26a-026ae91ba742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd02236605cc246488fa76e30105630e1'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:52.236328 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-2bdb331f-e729-42b2-b26a-026ae91ba742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd02236605cc246488fa76e30105630e1'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:52.236994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-2bdb331f-e729-42b2-b26a-026ae91ba742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd02236605cc246488fa76e30105630e1'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:52.244605 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-2bdb331f-e729-42b2-b26a-026ae91ba742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd02236605cc246488fa76e30105630e1'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:52.253025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-2bdb331f-e729-42b2-b26a-026ae91ba742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd02236605cc246488fa76e30105630e1'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:52.268608 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-91a6ea98-005c-43e5-a90a-5b2ae8bf21d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9eeabff05c4516a9e07e453043b04b', 'request_id': 'req-91a6ea98-005c-43e5-a90a-5b2ae8bf21d0'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:52.270980 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1448/2894] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:01:52 2022] DELETE /identity/v3/users/d02236605cc246488fa76e30105630e1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:01:52.274785 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-91a6ea98-005c-43e5-a90a-5b2ae8bf21d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9eeabff05c4516a9e07e453043b04b', 'request_id': 'req-91a6ea98-005c-43e5-a90a-5b2ae8bf21d0'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:52.275513 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac29eb-6afc-4c33-a85b-4542184f2702 None None] REQUEST_METHOD: `POST` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:52.275917 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac29eb-6afc-4c33-a85b-4542184f2702 None None] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:52.276090 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac29eb-6afc-4c33-a85b-4542184f2702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:52.280805 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-91a6ea98-005c-43e5-a90a-5b2ae8bf21d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9eeabff05c4516a9e07e453043b04b', 'request_id': 'req-91a6ea98-005c-43e5-a90a-5b2ae8bf21d0'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:52.294025 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.auth.core [None req-40ac29eb-6afc-4c33-a85b-4542184f2702 None None] MFA Rules not processed for user `210b2db5e18c45edbd9a1a18b78d6586`. Rule list: `[]` (Enabled: `True`). {{(pid=91767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:01:52.294227 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-91a6ea98-005c-43e5-a90a-5b2ae8bf21d0 admin admin] The token cache is being invalidate because project ea9eeabff05c4516a9e07e453043b04b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:01:52.294683 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-91a6ea98-005c-43e5-a90a-5b2ae8bf21d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:52.295032 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-91a6ea98-005c-43e5-a90a-5b2ae8bf21d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:52.295237 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-40ac29eb-6afc-4c33-a85b-4542184f2702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:52.296562 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1447/2895] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:01:52 2022] DELETE /identity/v3/projects/ea9eeabff05c4516a9e07e453043b04b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:01:52.301555 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:52.363213 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1449/2896] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 14:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 14:01:52.381355 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6ea98-005c-43e5-a90a-5b2ae8bf21d0 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:52.382872 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-91a6ea98-005c-43e5-a90a-5b2ae8bf21d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:52.448032 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6ea98-005c-43e5-a90a-5b2ae8bf21d0 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:52.502185 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a2843-3584-4cc0-8a42-1846f2193555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:52.502853 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a2843-3584-4cc0-8a42-1846f2193555 service neutron] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:52.503140 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a2843-3584-4cc0-8a42-1846f2193555 service neutron] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:52.503417 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a2843-3584-4cc0-8a42-1846f2193555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:52.513887 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a2843-3584-4cc0-8a42-1846f2193555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:52.515379 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a2843-3584-4cc0-8a42-1846f2193555 service neutron] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:52.526260 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1448/2897] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:01:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:01:52.796913 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac29eb-6afc-4c33-a85b-4542184f2702 None None] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:01:52.798427 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-40ac29eb-6afc-4c33-a85b-4542184f2702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:01:52.810976 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac29eb-6afc-4c33-a85b-4542184f2702 None None] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:01:52.815580 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02057a7-a875-4f63-9fa1-6a870c376d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:01:52.816451 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02057a7-a875-4f63-9fa1-6a870c376d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:01:52.816743 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02057a7-a875-4f63-9fa1-6a870c376d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:01:52.817023 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02057a7-a875-4f63-9fa1-6a870c376d25 admin admin] PATH_INFO: `/v3/projects/6f806b9627a3465a84c258a5efe26576` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:01:52.818248 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02057a7-a875-4f63-9fa1-6a870c376d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f806b9627a3465a84c258a5efe26576)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:01:52.820149 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02057a7-a875-4f63-9fa1-6a870c376d25 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:01:52.865996 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d02057a7-a875-4f63-9fa1-6a870c376d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f806b9627a3465a84c258a5efe26576', 'request_id': 'req-d02057a7-a875-4f63-9fa1-6a870c376d25'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:52.872516 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d02057a7-a875-4f63-9fa1-6a870c376d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f806b9627a3465a84c258a5efe26576', 'request_id': 'req-d02057a7-a875-4f63-9fa1-6a870c376d25'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:52.879698 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d02057a7-a875-4f63-9fa1-6a870c376d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f806b9627a3465a84c258a5efe26576', 'request_id': 'req-d02057a7-a875-4f63-9fa1-6a870c376d25'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:52.890850 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d02057a7-a875-4f63-9fa1-6a870c376d25 admin admin] The token cache is being invalidate because project 6f806b9627a3465a84c258a5efe26576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:01:52.891168 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d02057a7-a875-4f63-9fa1-6a870c376d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:52.891813 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-d02057a7-a875-4f63-9fa1-6a870c376d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:01:52.893399 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1450/2898] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:01:52 2022] DELETE /identity/v3/projects/6f806b9627a3465a84c258a5efe26576 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:02:02.521555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:02:02.887111 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=49,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:02:08.764427 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a2843-3584-4cc0-8a42-1846f2193555 service neutron] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:02:08.766003 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-0f6a2843-3584-4cc0-8a42-1846f2193555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:02:08.844982 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a2843-3584-4cc0-8a42-1846f2193555 service neutron] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:02:08.907896 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759b5ad-3550-4977-9536-b332d31a70fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0db68b7fda4da29eb13689f3fd7b5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:02:08.908555 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759b5ad-3550-4977-9536-b332d31a70fc service placement] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:02:08.908856 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759b5ad-3550-4977-9536-b332d31a70fc service placement] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:02:08.909132 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759b5ad-3550-4977-9536-b332d31a70fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:02:08.911051 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-2759b5ad-3550-4977-9536-b332d31a70fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:02:08.923713 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759b5ad-3550-4977-9536-b332d31a70fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:02:08.925319 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759b5ad-3550-4977-9536-b332d31a70fc service placement] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:02:08.935999 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1449/2899] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:02:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:02:15.887784 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02057a7-a875-4f63-9fa1-6a870c376d25 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:02:15.889386 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-d02057a7-a875-4f63-9fa1-6a870c376d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:02:15.950185 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02057a7-a875-4f63-9fa1-6a870c376d25 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:02:15.954295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fea018-ae1f-4850-aa01-4a7f8b05d14d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45105360300a4cae802fdbda91b9d5cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:02:15.955205 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fea018-ae1f-4850-aa01-4a7f8b05d14d service neutron] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:02:15.955497 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fea018-ae1f-4850-aa01-4a7f8b05d14d service neutron] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:02:15.955771 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fea018-ae1f-4850-aa01-4a7f8b05d14d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:02:15.957552 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-e0fea018-ae1f-4850-aa01-4a7f8b05d14d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:02:16.019135 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fea018-ae1f-4850-aa01-4a7f8b05d14d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:02:16.020547 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fea018-ae1f-4850-aa01-4a7f8b05d14d service neutron] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:02:16.030000 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1451/2900] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:02:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 14:02:16.825940 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759b5ad-3550-4977-9536-b332d31a70fc service placement] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:02:16.827895 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-2759b5ad-3550-4977-9536-b332d31a70fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:02:16.842283 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759b5ad-3550-4977-9536-b332d31a70fc service placement] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:02:16.847420 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972e9b7-f77d-4c3c-9cab-87607346e2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:02:16.848367 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972e9b7-f77d-4c3c-9cab-87607346e2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:02:16.848737 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972e9b7-f77d-4c3c-9cab-87607346e2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:02:16.849078 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972e9b7-f77d-4c3c-9cab-87607346e2a9 admin admin] PATH_INFO: `/v3/users/8245056ce35e4e6886590dd7e20a1906` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:02:16.850373 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972e9b7-f77d-4c3c-9cab-87607346e2a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8245056ce35e4e6886590dd7e20a1906)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:02:16.852324 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972e9b7-f77d-4c3c-9cab-87607346e2a9 admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:02:16.899132 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f972e9b7-f77d-4c3c-9cab-87607346e2a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8245056ce35e4e6886590dd7e20a1906'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:16.911383 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f972e9b7-f77d-4c3c-9cab-87607346e2a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8245056ce35e4e6886590dd7e20a1906'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:16.912067 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f972e9b7-f77d-4c3c-9cab-87607346e2a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8245056ce35e4e6886590dd7e20a1906'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:16.913063 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f972e9b7-f77d-4c3c-9cab-87607346e2a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8245056ce35e4e6886590dd7e20a1906'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:16.921423 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-f972e9b7-f77d-4c3c-9cab-87607346e2a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8245056ce35e4e6886590dd7e20a1906'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:16.935250 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1450/2901] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:02:16 2022] DELETE /identity/v3/users/8245056ce35e4e6886590dd7e20a1906 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:02:17.109163 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fea018-ae1f-4850-aa01-4a7f8b05d14d service neutron] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:02:17.120827 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fea018-ae1f-4850-aa01-4a7f8b05d14d service neutron] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:02:17.178620 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15fac2-d675-47af-8e24-fec2adde6c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:02:17.179468 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15fac2-d675-47af-8e24-fec2adde6c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:02:17.179747 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15fac2-d675-47af-8e24-fec2adde6c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:02:17.180022 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15fac2-d675-47af-8e24-fec2adde6c4f admin admin] PATH_INFO: `/v3/projects/cb0e4c2dd9524b988ed784d8825891b5` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:02:17.181172 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15fac2-d675-47af-8e24-fec2adde6c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb0e4c2dd9524b988ed784d8825891b5)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:02:17.183092 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15fac2-d675-47af-8e24-fec2adde6c4f admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:02:17.227759 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3b15fac2-d675-47af-8e24-fec2adde6c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb0e4c2dd9524b988ed784d8825891b5', 'request_id': 'req-3b15fac2-d675-47af-8e24-fec2adde6c4f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:17.229590 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:02:17.234003 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3b15fac2-d675-47af-8e24-fec2adde6c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb0e4c2dd9524b988ed784d8825891b5', 'request_id': 'req-3b15fac2-d675-47af-8e24-fec2adde6c4f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:17.242401 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3b15fac2-d675-47af-8e24-fec2adde6c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb0e4c2dd9524b988ed784d8825891b5', 'request_id': 'req-3b15fac2-d675-47af-8e24-fec2adde6c4f'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:17.252295 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3b15fac2-d675-47af-8e24-fec2adde6c4f admin admin] The token cache is being invalidate because project cb0e4c2dd9524b988ed784d8825891b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:02:17.252577 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3b15fac2-d675-47af-8e24-fec2adde6c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:17.253204 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-3b15fac2-d675-47af-8e24-fec2adde6c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:17.254724 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1452/2902] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:02:17 2022] DELETE /identity/v3/projects/cb0e4c2dd9524b988ed784d8825891b5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:02:17.258686 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972e9b7-f77d-4c3c-9cab-87607346e2a9 admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:02:17.260129 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-f972e9b7-f77d-4c3c-9cab-87607346e2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:02:17.269752 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:02:17.274097 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972e9b7-f77d-4c3c-9cab-87607346e2a9 admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:02:17.332426 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2235b-5e80-4f07-8faf-7b191ebcf9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:02:17.333330 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2235b-5e80-4f07-8faf-7b191ebcf9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:02:17.333621 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2235b-5e80-4f07-8faf-7b191ebcf9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:02:17.333902 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2235b-5e80-4f07-8faf-7b191ebcf9ce admin admin] PATH_INFO: `/v3/users/48eefaeecf6f4e609e73362138691441` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:02:17.335077 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2235b-5e80-4f07-8faf-7b191ebcf9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=48eefaeecf6f4e609e73362138691441)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:02:17.337010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2235b-5e80-4f07-8faf-7b191ebcf9ce admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:02:17.381521 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b0f2235b-5e80-4f07-8faf-7b191ebcf9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48eefaeecf6f4e609e73362138691441'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:17.393702 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b0f2235b-5e80-4f07-8faf-7b191ebcf9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48eefaeecf6f4e609e73362138691441'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:17.394353 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b0f2235b-5e80-4f07-8faf-7b191ebcf9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48eefaeecf6f4e609e73362138691441'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:17.394969 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b0f2235b-5e80-4f07-8faf-7b191ebcf9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48eefaeecf6f4e609e73362138691441'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:17.402112 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-b0f2235b-5e80-4f07-8faf-7b191ebcf9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48eefaeecf6f4e609e73362138691441'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:17.414765 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1451/2903] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:02:17 2022] DELETE /identity/v3/users/48eefaeecf6f4e609e73362138691441 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:02:17.582345 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15fac2-d675-47af-8e24-fec2adde6c4f admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:02:17.583789 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-3b15fac2-d675-47af-8e24-fec2adde6c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:02:17.598882 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15fac2-d675-47af-8e24-fec2adde6c4f admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:02:17.656432 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f710f7-1358-4164-8f87-e78419365db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:02:17.657219 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f710f7-1358-4164-8f87-e78419365db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:02:17.657530 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f710f7-1358-4164-8f87-e78419365db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:02:17.657805 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f710f7-1358-4164-8f87-e78419365db8 admin admin] PATH_INFO: `/v3/projects/f24e3240fa3c47bc9028bf9d928e065f` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:02:17.658985 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f710f7-1358-4164-8f87-e78419365db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f24e3240fa3c47bc9028bf9d928e065f)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:02:17.660864 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f710f7-1358-4164-8f87-e78419365db8 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:02:17.706972 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b7f710f7-1358-4164-8f87-e78419365db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f24e3240fa3c47bc9028bf9d928e065f', 'request_id': 'req-b7f710f7-1358-4164-8f87-e78419365db8'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:17.712898 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b7f710f7-1358-4164-8f87-e78419365db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f24e3240fa3c47bc9028bf9d928e065f', 'request_id': 'req-b7f710f7-1358-4164-8f87-e78419365db8'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:17.720045 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b7f710f7-1358-4164-8f87-e78419365db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f24e3240fa3c47bc9028bf9d928e065f', 'request_id': 'req-b7f710f7-1358-4164-8f87-e78419365db8'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:17.730352 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b7f710f7-1358-4164-8f87-e78419365db8 admin admin] The token cache is being invalidate because project f24e3240fa3c47bc9028bf9d928e065f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:02:17.730639 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b7f710f7-1358-4164-8f87-e78419365db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:17.731266 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-b7f710f7-1358-4164-8f87-e78419365db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:02:17.732814 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1453/2904] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:02:17 2022] DELETE /identity/v3/projects/f24e3240fa3c47bc9028bf9d928e065f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:02:27.411318 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:02:27.727360 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=56,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:07.177212 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac28cc-5256-4eff-b918-a66c869de580 None None] REQUEST_METHOD: `POST` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:03:07.177740 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac28cc-5256-4eff-b918-a66c869de580 None None] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:03:07.177919 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac28cc-5256-4eff-b918-a66c869de580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:03:07.195463 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.auth.core [None req-9fac28cc-5256-4eff-b918-a66c869de580 None None] MFA Rules not processed for user `135410329e56486c8ccb65b1f2d87aca`. Rule list: `[]` (Enabled: `True`). {{(pid=91766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:03:07.196662 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9fac28cc-5256-4eff-b918-a66c869de580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:03:07.250424 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1452/2905] 10.222.0.45 () {58 vars in 967 bytes} [Thu May 26 14:03:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:03:07.290179 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f710f7-1358-4164-8f87-e78419365db8 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:03:07.291574 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-b7f710f7-1358-4164-8f87-e78419365db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:03:07.359362 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f710f7-1358-4164-8f87-e78419365db8 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:03:07.364283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168405d-a338-4abf-80e2-087b899530ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e517dc43cc6d401e820c65ad4c941386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:03:07.364922 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168405d-a338-4abf-80e2-087b899530ba service swift] REQUEST_METHOD: `GET` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:03:07.365206 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168405d-a338-4abf-80e2-087b899530ba service swift] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:03:07.365582 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168405d-a338-4abf-80e2-087b899530ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:03:07.373726 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168405d-a338-4abf-80e2-087b899530ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:03:07.375283 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168405d-a338-4abf-80e2-087b899530ba service swift] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:03:07.383448 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1454/2906] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 14:03:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 14:03:13.834907 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac28cc-5256-4eff-b918-a66c869de580 None None] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:03:13.836382 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-9fac28cc-5256-4eff-b918-a66c869de580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:03:13.908979 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac28cc-5256-4eff-b918-a66c869de580 None None] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:03:13.913570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e95f74-cc75-42c1-b25a-689042d5063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:03:13.914447 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e95f74-cc75-42c1-b25a-689042d5063c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:03:13.914728 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e95f74-cc75-42c1-b25a-689042d5063c admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:03:13.915005 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e95f74-cc75-42c1-b25a-689042d5063c admin admin] PATH_INFO: `/v3/users/079d9f05586e4f139e68b7f1f434809b` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:03:13.916321 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e95f74-cc75-42c1-b25a-689042d5063c admin admin] RBAC: Authorizing `identity:delete_user(user_id=079d9f05586e4f139e68b7f1f434809b)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:03:13.918162 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e95f74-cc75-42c1-b25a-689042d5063c admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:03:13.966061 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-66e95f74-cc75-42c1-b25a-689042d5063c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '079d9f05586e4f139e68b7f1f434809b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:13.978678 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-66e95f74-cc75-42c1-b25a-689042d5063c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '079d9f05586e4f139e68b7f1f434809b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:13.979358 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-66e95f74-cc75-42c1-b25a-689042d5063c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '079d9f05586e4f139e68b7f1f434809b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:13.979959 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-66e95f74-cc75-42c1-b25a-689042d5063c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '079d9f05586e4f139e68b7f1f434809b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:13.987674 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-66e95f74-cc75-42c1-b25a-689042d5063c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '079d9f05586e4f139e68b7f1f434809b'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:14.000159 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1453/2907] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:03:13 2022] DELETE /identity/v3/users/079d9f05586e4f139e68b7f1f434809b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:03:14.167212 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168405d-a338-4abf-80e2-087b899530ba service swift] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:03:14.178231 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168405d-a338-4abf-80e2-087b899530ba service swift] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:03:14.236111 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e672a2b-5c51-4169-939b-6d79b8e50657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:03:14.236994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e672a2b-5c51-4169-939b-6d79b8e50657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:03:14.237298 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e672a2b-5c51-4169-939b-6d79b8e50657 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:03:14.237612 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e672a2b-5c51-4169-939b-6d79b8e50657 admin admin] PATH_INFO: `/v3/projects/867e13f7785d4c948be1f56faeb6d941` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:03:14.238790 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e672a2b-5c51-4169-939b-6d79b8e50657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=867e13f7785d4c948be1f56faeb6d941)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:03:14.240676 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e672a2b-5c51-4169-939b-6d79b8e50657 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:03:14.285968 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-2e672a2b-5c51-4169-939b-6d79b8e50657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '867e13f7785d4c948be1f56faeb6d941', 'request_id': 'req-2e672a2b-5c51-4169-939b-6d79b8e50657'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:14.291874 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-2e672a2b-5c51-4169-939b-6d79b8e50657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '867e13f7785d4c948be1f56faeb6d941', 'request_id': 'req-2e672a2b-5c51-4169-939b-6d79b8e50657'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:14.298867 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-2e672a2b-5c51-4169-939b-6d79b8e50657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '867e13f7785d4c948be1f56faeb6d941', 'request_id': 'req-2e672a2b-5c51-4169-939b-6d79b8e50657'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:14.309160 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-2e672a2b-5c51-4169-939b-6d79b8e50657 admin admin] The token cache is being invalidate because project 867e13f7785d4c948be1f56faeb6d941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:03:14.309509 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-2e672a2b-5c51-4169-939b-6d79b8e50657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:14.310138 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-2e672a2b-5c51-4169-939b-6d79b8e50657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:14.311653 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1455/2908] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:03:14 2022] DELETE /identity/v3/projects/867e13f7785d4c948be1f56faeb6d941 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:03:14.315857 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e95f74-cc75-42c1-b25a-689042d5063c admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:03:14.317293 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-66e95f74-cc75-42c1-b25a-689042d5063c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:03:14.330772 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e95f74-cc75-42c1-b25a-689042d5063c admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:03:14.350936 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:14.388365 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83090f7b-fcd9-4590-ac55-c98c6db30b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:03:14.389230 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83090f7b-fcd9-4590-ac55-c98c6db30b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:03:14.389547 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83090f7b-fcd9-4590-ac55-c98c6db30b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:03:14.389828 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83090f7b-fcd9-4590-ac55-c98c6db30b5f admin admin] PATH_INFO: `/v3/users/1bd3253fc4ea4ea5942d3ce54206a37f` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:03:14.391010 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83090f7b-fcd9-4590-ac55-c98c6db30b5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd3253fc4ea4ea5942d3ce54206a37f)` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:03:14.396252 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83090f7b-fcd9-4590-ac55-c98c6db30b5f admin admin] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:03:14.442595 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-83090f7b-fcd9-4590-ac55-c98c6db30b5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd3253fc4ea4ea5942d3ce54206a37f'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:14.454035 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-83090f7b-fcd9-4590-ac55-c98c6db30b5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd3253fc4ea4ea5942d3ce54206a37f'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:14.455238 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-83090f7b-fcd9-4590-ac55-c98c6db30b5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd3253fc4ea4ea5942d3ce54206a37f'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:14.455839 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-83090f7b-fcd9-4590-ac55-c98c6db30b5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd3253fc4ea4ea5942d3ce54206a37f'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:14.462854 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.notifications [None req-83090f7b-fcd9-4590-ac55-c98c6db30b5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd3253fc4ea4ea5942d3ce54206a37f'} {{(pid=91766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:14.475069 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1454/2909] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 14:03:14 2022] DELETE /identity/v3/users/1bd3253fc4ea4ea5942d3ce54206a37f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:03:14.647644 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e672a2b-5c51-4169-939b-6d79b8e50657 admin admin] Authenticating user token {{(pid=91767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:03:14.649369 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.fernet_utils [None req-2e672a2b-5c51-4169-939b-6d79b8e50657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:03:14.663343 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e672a2b-5c51-4169-939b-6d79b8e50657 admin admin] Validating token access rules against request {{(pid=91767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:03:14.686051 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:14.737994 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604020ea-11f0-4a8a-b41c-05fc2b301210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210b2db5e18c45edbd9a1a18b78d6586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '066fbe760dac4adba6eafb0592a4a0b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:03:14.738877 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604020ea-11f0-4a8a-b41c-05fc2b301210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:03:14.739163 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604020ea-11f0-4a8a-b41c-05fc2b301210 admin admin] SCRIPT_NAME: `/identity` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:03:14.739443 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604020ea-11f0-4a8a-b41c-05fc2b301210 admin admin] PATH_INFO: `/v3/projects/868206cf31bf4026ab61f493cd62bbab` {{(pid=91767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:03:14.740658 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604020ea-11f0-4a8a-b41c-05fc2b301210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=868206cf31bf4026ab61f493cd62bbab)` {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:03:14.742666 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604020ea-11f0-4a8a-b41c-05fc2b301210 admin admin] RBAC: Authorization granted {{(pid=91767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:03:14.791837 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-604020ea-11f0-4a8a-b41c-05fc2b301210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868206cf31bf4026ab61f493cd62bbab', 'request_id': 'req-604020ea-11f0-4a8a-b41c-05fc2b301210'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:14.800285 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-604020ea-11f0-4a8a-b41c-05fc2b301210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868206cf31bf4026ab61f493cd62bbab', 'request_id': 'req-604020ea-11f0-4a8a-b41c-05fc2b301210'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:14.808255 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-604020ea-11f0-4a8a-b41c-05fc2b301210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868206cf31bf4026ab61f493cd62bbab', 'request_id': 'req-604020ea-11f0-4a8a-b41c-05fc2b301210'} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:14.821323 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-604020ea-11f0-4a8a-b41c-05fc2b301210 admin admin] The token cache is being invalidate because project 868206cf31bf4026ab61f493cd62bbab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 14:03:14.821514 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-604020ea-11f0-4a8a-b41c-05fc2b301210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:14.822167 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG keystone.notifications [None req-604020ea-11f0-4a8a-b41c-05fc2b301210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 14:03:14.823715 dv-cinder-842130-1-smb devstack@keystone.service[91767]: [pid: 91767|app: 0|req: 1456/2910] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 14:03:14 2022] DELETE /identity/v3/projects/868206cf31bf4026ab61f493cd62bbab => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:03:24.471464 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:24.816899 dv-cinder-842130-1-smb devstack@keystone.service[91767]: DEBUG dbcounter [-] [91767] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:07:41.390596 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83090f7b-fcd9-4590-ac55-c98c6db30b5f admin admin] Authenticating user token {{(pid=91766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:07:41.391985 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-83090f7b-fcd9-4590-ac55-c98c6db30b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:07:41.527131 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83090f7b-fcd9-4590-ac55-c98c6db30b5f admin admin] Validating token access rules against request {{(pid=91766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:07:41.583602 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65ca10-2639-4e25-ac72-b80028ef0f93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0db68b7fda4da29eb13689f3fd7b5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095d02b8a79c4915ac8d3c5b81e195a4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:07:41.584242 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65ca10-2639-4e25-ac72-b80028ef0f93 service placement] REQUEST_METHOD: `GET` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:07:41.584525 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65ca10-2639-4e25-ac72-b80028ef0f93 service placement] SCRIPT_NAME: `/identity` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:07:41.584804 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65ca10-2639-4e25-ac72-b80028ef0f93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:07:41.586570 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.fernet_utils [None req-ee65ca10-2639-4e25-ac72-b80028ef0f93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:07:41.598424 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65ca10-2639-4e25-ac72-b80028ef0f93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:07:41.600003 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65ca10-2639-4e25-ac72-b80028ef0f93 service placement] RBAC: Authorization granted {{(pid=91766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:07:41.610616 dv-cinder-842130-1-smb devstack@keystone.service[91766]: [pid: 91766|app: 0|req: 1455/2911] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:07:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:07:51.606214 dv-cinder-842130-1-smb devstack@keystone.service[91766]: DEBUG dbcounter [-] [91766] Writing DB stats keystone:SELECT=89 {{(pid=91766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}